Started by user Ritesh Agarwal [EnvInject] - Loading node environment variables. Building remotely on magma-sc1101-32g-24c (magma_slave) in workspace /data/workspace/magma_temp_job2 [WS-CLEANUP] Deleting project workspace... [WS-CLEANUP] Done Running Prebuild steps [magma_temp_job2] $ /bin/sh -xe /tmp/jenkins7772102776153916111.sh ++ echo couchstore + desc=couchstore + echo Desc: 7.0.0-4498 - couchstore Desc: 7.0.0-4498 - couchstore Success build forhudson.tasks.Shell@22afcae [description-setter] Description set: 7.0.0-4498 - couchstore Success build forhudson.plugins.descriptionsetter.DescriptionSetterBuilder@34e0afb5 Cloning the remote Git repository Cloning repository https://github.com/couchbaselabs/TAF.git > /usr/bin/git init /data/workspace/magma_temp_job2 # timeout=10 Fetching upstream changes from https://github.com/couchbaselabs/TAF.git > /usr/bin/git --version # timeout=10 > /usr/bin/git fetch --tags --progress https://github.com/couchbaselabs/TAF.git +refs/heads/*:refs/remotes/origin/* > /usr/bin/git config remote.origin.url https://github.com/couchbaselabs/TAF.git # timeout=10 > /usr/bin/git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > /usr/bin/git config remote.origin.url https://github.com/couchbaselabs/TAF.git # timeout=10 Fetching upstream changes from https://github.com/couchbaselabs/TAF.git > /usr/bin/git fetch --tags --progress https://github.com/couchbaselabs/TAF.git +refs/heads/*:refs/remotes/origin/* > /usr/bin/git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 89127a687dcded378015f8dff20a28d3b67c7edb (origin/master) > /usr/bin/git config core.sparsecheckout # timeout=10 > /usr/bin/git checkout -f 89127a687dcded378015f8dff20a28d3b67c7edb > /usr/bin/git rev-list 706ee931d19529494a8773080044597e9e8efd28 # timeout=10 > /usr/bin/git tag -a -f -m Jenkins Build #6 jenkins-magma_temp_job2-6 # timeout=10 No emails were triggered. [magma_temp_job2] $ /bin/bash /tmp/jenkins9116371135988436266.sh [global] username:root password:couchbase port:8091 index_port:9102 n1ql_port:8093 data_path:/data [servers] 1:172.23.110.64 2:172.23.110.65 3:172.23.110.66 4:172.23.110.67 5:172.23.110.68 6:172.23.110.69 7:172.23.110.70 [membase] rest_username:Administrator rest_password:password [magma_temp_job2] $ /bin/sh -xe /tmp/jenkins3767303214939902257.sh + echo '' + echo '##############################################' ############################################## + echo 'Installing dependencies from requirements.txt' Installing dependencies from requirements.txt + echo '##############################################' ############################################## + /opt/jython/bin/pip install -r requirements.txt Requirement already satisfied (use --upgrade to upgrade): futures==3.3.0 in /opt/jython/Lib/site-packages (from -r requirements.txt (line 1)) Requirement already satisfied (use --upgrade to upgrade): requests==2.24.0 in /opt/jython/Lib/site-packages (from -r requirements.txt (line 2)) Requirement already satisfied (use --upgrade to upgrade): urllib3==1.25.10 in /opt/jython/Lib/site-packages (from -r requirements.txt (line 3)) Requirement already satisfied (use --upgrade to upgrade): ruamel.yaml==0.16.12 in /opt/jython/Lib/site-packages (from -r requirements.txt (line 4)) Cleaning up... + echo '#################### Done ####################' #################### Done #################### + echo '' + echo version=7.0.0-4498 version=7.0.0-4498 + git clone https://github.com/gradle/guides.git Cloning into 'guides'... [magma_temp_job2] $ /bin/sh -xe /tmp/jenkins4982556049040535134.sh + guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/magma_temp_job2.ini -p bucket_storage=couchstore,bucket_eviction_policy=fullEviction -t volumetests.Magma.volume.SystemTestMagma,nodes_init=2,replicas=1,skip_cleanup=True,num_items=1000000,doc_size=256,bucket_type=membase,compression_mode=off,iterations=10,crashes=0,batch_size=10,sdk_timeout=60,log_level=debug,infra_log_level=info,rerun=False,skip_cleanup=True,key_size=18,randomize_doc_size=False,randomize_value=True,assert_crashes_on_load=True,maxttl=1200,num_buckets=10,num_scopes=5,num_collections=5,doc_ops=create:update:delete:expiry,durability=MAJORITY,sdk_client_pool=True,pc=1 -m rest' Starting a Gradle Daemon, 12 busy Daemons could not be reused, use --status for details > Configure project : Using Transaction_client :: 1.1.0 Running: /opt/jython/bin/jython -J-cp /data/workspace/magma_temp_job2/build/classes/java/main:/data/workspace/magma_temp_job2/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.0/a295271b66684b05dd5345d7b7a6232e03054ef9/couchbase-transactions-1.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.0.7/892363ab817451b9bb8fa91861c0d66c480056eb/java-client-3.0.7.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.0.8/d21bea503f8be1ce9d68143e4aaf2f203a48d2b7/core-io-2.0.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.3.8.RELEASE/e6b2e8dc1f6548ae216b2ecdee0c0a32176317a/reactor-core-3.3.8.RELEASE.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar scripts/ssh.py -i /tmp/magma_temp_job2.ini -p bucket_storage=couchstore,bucket_eviction_policy=fullEviction -t volumetests.Magma.volume.SystemTestMagma,nodes_init=2,replicas=1,skip_cleanup=True,num_items=1000000,doc_size=256,bucket_type=membase,compression_mode=off,iterations=10,crashes=0,batch_size=10,sdk_timeout=60,log_level=debug,infra_log_level=info,rerun=False,skip_cleanup=True,key_size=18,randomize_doc_size=False,randomize_value=True,assert_crashes_on_load=True,maxttl=1200,num_buckets=10,num_scopes=5,num_collections=5,doc_ops=create:update:delete:expiry,durability=MAJORITY,sdk_client_pool=True,pc=1 -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/magma_temp_job2/build/classes/java/main:/data/workspace/magma_temp_job2/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.0/a295271b66684b05dd5345d7b7a6232e03054ef9/couchbase-transactions-1.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.0.7/892363ab817451b9bb8fa91861c0d66c480056eb/java-client-3.0.7.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.0.8/d21bea503f8be1ce9d68143e4aaf2f203a48d2b7/core-io-2.0.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.3.8.RELEASE/e6b2e8dc1f6548ae216b2ecdee0c0a32176317a/reactor-core-3.3.8.RELEASE.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar scripts/eagles_all_around.py -i /tmp/magma_temp_job2.ini -p bucket_storage=couchstore,bucket_eviction_policy=fullEviction -t volumetests.Magma.volume.SystemTestMagma,nodes_init=2,replicas=1,skip_cleanup=True,num_items=1000000,doc_size=256,bucket_type=membase,compression_mode=off,iterations=10,crashes=0,batch_size=10,sdk_timeout=60,log_level=debug,infra_log_level=info,rerun=False,skip_cleanup=True,key_size=18,randomize_doc_size=False,randomize_value=True,assert_crashes_on_load=True,maxttl=1200,num_buckets=10,num_scopes=5,num_collections=5,doc_ops=create:update:delete:expiry,durability=MAJORITY,sdk_client_pool=True,pc=1 -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/magma_temp_job2/build/classes/java/main:/data/workspace/magma_temp_job2/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.0/a295271b66684b05dd5345d7b7a6232e03054ef9/couchbase-transactions-1.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.0.7/892363ab817451b9bb8fa91861c0d66c480056eb/java-client-3.0.7.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.0.8/d21bea503f8be1ce9d68143e4aaf2f203a48d2b7/core-io-2.0.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.3.8.RELEASE/e6b2e8dc1f6548ae216b2ecdee0c0a32176317a/reactor-core-3.3.8.RELEASE.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:build/classes/java/main scripts/install.py -i /tmp/magma_temp_job2.ini -p bucket_storage=couchstore,bucket_eviction_policy=fullEviction -t volumetests.Magma.volume.SystemTestMagma,nodes_init=2,replicas=1,skip_cleanup=True,num_items=1000000,doc_size=256,bucket_type=membase,compression_mode=off,iterations=10,crashes=0,batch_size=10,sdk_timeout=60,log_level=debug,infra_log_level=info,rerun=False,skip_cleanup=True,key_size=18,randomize_doc_size=False,randomize_value=True,assert_crashes_on_load=True,maxttl=1200,num_buckets=10,num_scopes=5,num_collections=5,doc_ops=create:update:delete:expiry,durability=MAJORITY,sdk_client_pool=True,pc=1 -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/magma_temp_job2/build/classes/java/main:/data/workspace/magma_temp_job2/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.0/a295271b66684b05dd5345d7b7a6232e03054ef9/couchbase-transactions-1.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.0.7/892363ab817451b9bb8fa91861c0d66c480056eb/java-client-3.0.7.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.0.8/d21bea503f8be1ce9d68143e4aaf2f203a48d2b7/core-io-2.0.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.3.8.RELEASE/e6b2e8dc1f6548ae216b2ecdee0c0a32176317a/reactor-core-3.3.8.RELEASE.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:build/classes/java/main:src/main/resources testrunner.py -i /tmp/magma_temp_job2.ini -p bucket_storage=couchstore,bucket_eviction_policy=fullEviction -t volumetests.Magma.volume.SystemTestMagma,nodes_init=2,replicas=1,skip_cleanup=True,num_items=1000000,doc_size=256,bucket_type=membase,compression_mode=off,iterations=10,crashes=0,batch_size=10,sdk_timeout=60,log_level=debug,infra_log_level=info,rerun=False,skip_cleanup=True,key_size=18,randomize_doc_size=False,randomize_value=True,assert_crashes_on_load=True,maxttl=1200,num_buckets=10,num_scopes=5,num_collections=5,doc_ops=create:update:delete:expiry,durability=MAJORITY,sdk_client_pool=True,pc=1 -m rest Running: /opt/jython/bin/jython -J-cp /data/workspace/magma_temp_job2/build/classes/java/main:/data/workspace/magma_temp_job2/build/resources/main:/root/.gradle/caches/modules-2/files-2.1/com.jcraft/jsch/0.1.54/da3584329a263616e277e15462b387addd1b208d/jsch-0.1.54.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/couchbase-transactions/1.1.0/a295271b66684b05dd5345d7b7a6232e03054ef9/couchbase-transactions-1.1.0.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/java-client/3.0.7/892363ab817451b9bb8fa91861c0d66c480056eb/java-client-3.0.7.jar:/root/.gradle/caches/modules-2/files-2.1/com.couchbase.client/core-io/2.0.8/d21bea503f8be1ce9d68143e4aaf2f203a48d2b7/core-io-2.0.8.jar:/root/.gradle/caches/modules-2/files-2.1/io.projectreactor/reactor-core/3.3.8.RELEASE/e6b2e8dc1f6548ae216b2ecdee0c0a32176317a/reactor-core-3.3.8.RELEASE.jar:/root/.gradle/caches/modules-2/files-2.1/org.reactivestreams/reactive-streams/1.0.3/d9fb7a7926ffa635b3dcaa5049fb2bfa25b3e7d0/reactive-streams-1.0.3.jar:build/classes/java/main:src/main/resources scripts/rerun_jobs.py -i /tmp/magma_temp_job2.ini -p bucket_storage=couchstore,bucket_eviction_policy=fullEviction -t volumetests.Magma.volume.SystemTestMagma,nodes_init=2,replicas=1,skip_cleanup=True,num_items=1000000,doc_size=256,bucket_type=membase,compression_mode=off,iterations=10,crashes=0,batch_size=10,sdk_timeout=60,log_level=debug,infra_log_level=info,rerun=False,skip_cleanup=True,key_size=18,randomize_doc_size=False,randomize_value=True,assert_crashes_on_load=True,maxttl=1200,num_buckets=10,num_scopes=5,num_collections=5,doc_ops=create:update:delete:expiry,durability=MAJORITY,sdk_client_pool=True,pc=1 -m rest > Task :compileJava Note: /data/workspace/magma_temp_job2/src/main/java/com/couchbase/test/transactions/SimpleTransaction.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :testrunner Global Test input params: {'bucket_eviction_policy': 'fullEviction', 'bucket_storage': 'couchstore', 'cluster_name': 'magma_temp_job2', 'ini': '/tmp/magma_temp_job2.ini', 'num_nodes': 7} Logs will be stored at /data/workspace/magma_temp_job2/logs/testrunner-21-Feb-19_03-10-18/test_1 guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/magma_temp_job2.ini bucket_storage=couchstore,bucket_eviction_policy=fullEviction -t volumetests.Magma.volume.SystemTestMagma,nodes_init=2,replicas=1,skip_cleanup=True,num_items=1000000,doc_size=256,bucket_type=membase,compression_mode=off,iterations=10,crashes=0,batch_size=10,sdk_timeout=60,log_level=debug,infra_log_level=info,rerun=False,skip_cleanup=True,key_size=18,randomize_doc_size=False,randomize_value=True,assert_crashes_on_load=True,maxttl=1200,num_buckets=10,num_scopes=5,num_collections=5,doc_ops=create:update:delete:expiry,durability=MAJORITY,sdk_client_pool=True,pc=1' Test Input params: {'doc_size': '256', 'bucket_type': 'membase', 'num_collections': '5', 'maxttl': '1200', 'crashes': '0', 'sdk_client_pool': 'True', 'rerun': 'False', 'num_nodes': 7, 'doc_ops': 'create:update:delete:expiry', 'sdk_timeout': '60', 'case_number': 1, 'cluster_name': 'magma_temp_job2', 'batch_size': '10', 'ini': '/tmp/magma_temp_job2.ini', 'replicas': '1', 'num_buckets': '10', 'durability': 'MAJORITY', 'log_level': 'debug', 'bucket_storage': 'couchstore', 'bucket_eviction_policy': 'fullEviction', 'compression_mode': 'off', 'iterations': '10', 'logs_folder': '/data/workspace/magma_temp_job2/logs/testrunner-21-Feb-19_03-10-18/test_1', 'skip_cleanup': 'True', 'nodes_init': '2', 'num_scopes': '5', 'pc': '1', 'num_items': '1000000', 'assert_crashes_on_load': 'True', 'randomize_doc_size': 'False', 'randomize_value': 'True', 'infra_log_level': 'info', 'key_size': '18'} SystemTestMagma (volumetests.Magma.volume) ... 2021-02-19 03:10:22,825 | infra | INFO | MainThread | [task_manager:__init__:14] Initiating TaskManager with 30 threads 2021-02-19 03:10:22,831 | test | INFO | MainThread | [basetestcase:log_setup_status:540] ========= volume setup started for test #1 SystemTestMagma ========= 2021-02-19 03:10:23,286 | test | INFO | MainThread | [basetestcase:log_setup_status:540] ========= BaseTestCase setup started for test #1 SystemTestMagma ========= 2021-02-19 03:10:23,288 | test | DEBUG | MainThread | [basetestcase:setUp:292] Cleaning up cluster 2021-02-19 03:10:26,101 | test | WARNING | MainThread | [cluster_ready_functions:cluster_cleanup:125] Rebalance still running, test should be verified 2021-02-19 03:10:30,948 | test | INFO | MainThread | [rest_client:stop_rebalance:2014] Rebalance stopped 2021-02-19 03:10:31,125 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 158493744, u'itemCount': 205230, u'quotaPercentUsed': 0.833827513956429, u'storageTotals': {u'hdd': {u'usedByData': 10420768812L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1197747884, u'vbActiveNumNonResident': 0, u'memUsed': 323887368} 2021-02-19 03:10:31,131 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 221420282, u'itemCount': 300721, u'quotaPercentUsed': 1.007628103605731, u'storageTotals': {u'hdd': {u'usedByData': 10420768812L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1246069050, u'vbActiveNumNonResident': 0, u'memUsed': 391397512} 2021-02-19 03:10:31,138 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 207708982, u'itemCount': 286205, u'quotaPercentUsed': 0.9740426619924849, u'storageTotals': {u'hdd': {u'usedByData': 10420768812L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 830457027, u'vbActiveNumNonResident': 0, u'memUsed': 378351768} 2021-02-19 03:10:31,144 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 204486010, u'itemCount': 284763, u'quotaPercentUsed': 1.008752947066801, u'storageTotals': {u'hdd': {u'usedByData': 10420768812L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 546144972, u'vbActiveNumNonResident': 0, u'memUsed': 391834440} 2021-02-19 03:10:31,150 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 200292228, u'itemCount': 280976, u'quotaPercentUsed': 0.9970889159971714, u'storageTotals': {u'hdd': {u'usedByData': 10420768812L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 417918698, u'vbActiveNumNonResident': 0, u'memUsed': 387303728} 2021-02-19 03:10:31,158 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 134583466, u'itemCount': 188163, u'quotaPercentUsed': 0.5146257692762745, u'storageTotals': {u'hdd': {u'usedByData': 10420768812L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 277378057, u'vbActiveNumNonResident': 0, u'memUsed': 299847600} 2021-02-19 03:10:31,164 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 127746664, u'itemCount': 177864, u'quotaPercentUsed': 0.5073028082243976, u'storageTotals': {u'hdd': {u'usedByData': 10420768812L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1035775284, u'vbActiveNumNonResident': 0, u'memUsed': 295580864} 2021-02-19 03:10:31,167 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 137514403, u'itemCount': 180669, u'quotaPercentUsed': 0.4958982735049521, u'storageTotals': {u'hdd': {u'usedByData': 10420768812L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1308941596, u'vbActiveNumNonResident': 0, u'memUsed': 288935992} 2021-02-19 03:10:31,173 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 147777843, u'itemCount': 191041, u'quotaPercentUsed': 0.4790152277299602, u'storageTotals': {u'hdd': {u'usedByData': 10420768812L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1670204998, u'vbActiveNumNonResident': 0, u'memUsed': 279099056} 2021-02-19 03:10:31,177 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 148198870, u'itemCount': 188897, u'quotaPercentUsed': 0.4738735765625281, u'storageTotals': {u'hdd': {u'usedByData': 10420768812L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1890131246, u'vbActiveNumNonResident': 0, u'memUsed': 276103264} 2021-02-19 03:10:31,180 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1567] Deleting existing buckets [u'GleamBookUsers0', u'GleamBookUsers1', u'GleamBookUsers2', u'GleamBookUsers3', u'GleamBookUsers4', u'GleamBookUsers5', u'GleamBookUsers6', u'GleamBookUsers7', u'GleamBookUsers8', u'GleamBookUsers9'] on 172.23.110.64 2021-02-19 03:10:31,180 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1569] Remove bucket GleamBookUsers0 ... 2021-02-19 03:10:31,180 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1489] Deleting existing bucket GleamBookUsers0 on ip:172.23.110.64 port:8091 ssh_username:root 2021-02-19 03:10:31,348 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 158493744, u'itemCount': 205230, u'quotaPercentUsed': 0.833827513956429, u'storageTotals': {u'hdd': {u'usedByData': 10249446246L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1197747884, u'vbActiveNumNonResident': 0, u'memUsed': 323887368} 2021-02-19 03:10:31,352 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 221420282, u'itemCount': 300721, u'quotaPercentUsed': 1.007628103605731, u'storageTotals': {u'hdd': {u'usedByData': 10249446246L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1246069050, u'vbActiveNumNonResident': 0, u'memUsed': 391397512} 2021-02-19 03:10:31,358 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 207708982, u'itemCount': 286205, u'quotaPercentUsed': 0.9740426619924849, u'storageTotals': {u'hdd': {u'usedByData': 10249446246L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 830457027, u'vbActiveNumNonResident': 0, u'memUsed': 378351768} 2021-02-19 03:10:31,361 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 204486010, u'itemCount': 284763, u'quotaPercentUsed': 1.008752947066801, u'storageTotals': {u'hdd': {u'usedByData': 10249446246L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 546144972, u'vbActiveNumNonResident': 0, u'memUsed': 391834440} 2021-02-19 03:10:31,367 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 200292228, u'itemCount': 280976, u'quotaPercentUsed': 0.9970889159971714, u'storageTotals': {u'hdd': {u'usedByData': 10249446246L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 417918698, u'vbActiveNumNonResident': 0, u'memUsed': 387303728} 2021-02-19 03:10:31,374 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 134583466, u'itemCount': 188163, u'quotaPercentUsed': 0.5146257692762745, u'storageTotals': {u'hdd': {u'usedByData': 10249446246L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 237800019, u'vbActiveNumNonResident': 0, u'memUsed': 299847600} 2021-02-19 03:10:31,378 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 127746664, u'itemCount': 177864, u'quotaPercentUsed': 0.5073028082243976, u'storageTotals': {u'hdd': {u'usedByData': 10249446246L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1029010546, u'vbActiveNumNonResident': 0, u'memUsed': 295580864} 2021-02-19 03:10:31,382 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 137514403, u'itemCount': 180669, u'quotaPercentUsed': 0.4958982735049521, u'storageTotals': {u'hdd': {u'usedByData': 10249446246L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1310065750, u'vbActiveNumNonResident': 0, u'memUsed': 288935992} 2021-02-19 03:10:31,387 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 147777843, u'itemCount': 191041, u'quotaPercentUsed': 0.4790152277299602, u'storageTotals': {u'hdd': {u'usedByData': 10249446246L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1669801331, u'vbActiveNumNonResident': 0, u'memUsed': 279099056} 2021-02-19 03:10:31,391 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 130565045, u'itemCount': 188897, u'quotaPercentUsed': 0.4676939674550169, u'storageTotals': {u'hdd': {u'usedByData': 10249446246L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3312341592L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1764684921, u'vbActiveNumNonResident': 0, u'memUsed': 272502704} 2021-02-19 03:10:34,012 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1509] Deleted bucket: GleamBookUsers0 from 172.23.110.64 2021-02-19 03:10:34,013 | test | DEBUG | MainThread | [bucket_ready_functions:wait_for_bucket_deletion:1529] Waiting for bucket GleamBookUsers0 deletion to finish 2021-02-19 03:10:34,134 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 72168187, u'itemCount': 140853, u'quotaPercentUsed': 0.5122796336590967, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1246069050, u'vbActiveNumNonResident': 0, u'memUsed': 198987080} 2021-02-19 03:10:34,140 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 64935783, u'itemCount': 139105, u'quotaPercentUsed': 0.7166896161424484, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 830719171, u'vbActiveNumNonResident': 0, u'memUsed': 278386968} 2021-02-19 03:10:34,144 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 59421005, u'itemCount': 141712, u'quotaPercentUsed': 0.4986521312374621, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 546407116, u'vbActiveNumNonResident': 0, u'memUsed': 193693688} 2021-02-19 03:10:34,148 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 55339847, u'itemCount': 141426, u'quotaPercentUsed': 0.7318175208451436, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 419245802, u'vbActiveNumNonResident': 0, u'memUsed': 284263168} 2021-02-19 03:10:34,155 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 60692658, u'itemCount': 229400, u'quotaPercentUsed': 0.5667440517886739, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 285100329, u'vbActiveNumNonResident': 0, u'memUsed': 330214408} 2021-02-19 03:10:34,161 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 63836934, u'itemCount': 177864, u'quotaPercentUsed': 0.4596332209124763, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 272958796, u'vbActiveNumNonResident': 0, u'memUsed': 267806096} 2021-02-19 03:10:34,164 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 62285991, u'itemCount': 171671, u'quotaPercentUsed': 0.4558594949481529, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 521405828, u'vbActiveNumNonResident': 0, u'memUsed': 265607328} 2021-02-19 03:10:34,168 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 93697342, u'itemCount': 186311, u'quotaPercentUsed': 0.4659031755838496, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1175983572, u'vbActiveNumNonResident': 0, u'memUsed': 271459296} 2021-02-19 03:10:34,173 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 98224472, u'itemCount': 184657, u'quotaPercentUsed': 0.4682435101370864, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1225090403, u'vbActiveNumNonResident': 0, u'memUsed': 272822896} 2021-02-19 03:10:34,174 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1569] Remove bucket GleamBookUsers1 ... 2021-02-19 03:10:34,174 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1489] Deleting existing bucket GleamBookUsers1 on ip:172.23.110.64 port:8091 ssh_username:root 2021-02-19 03:10:34,315 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 72168187, u'itemCount': 140853, u'quotaPercentUsed': 0.5122796336590967, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1246069050, u'vbActiveNumNonResident': 0, u'memUsed': 198987080} 2021-02-19 03:10:34,319 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 64935783, u'itemCount': 139105, u'quotaPercentUsed': 0.7166896161424484, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 830719171, u'vbActiveNumNonResident': 0, u'memUsed': 278386968} 2021-02-19 03:10:34,323 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 59421005, u'itemCount': 141712, u'quotaPercentUsed': 0.4986521312374621, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 546407116, u'vbActiveNumNonResident': 0, u'memUsed': 193693688} 2021-02-19 03:10:34,328 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 55339847, u'itemCount': 141426, u'quotaPercentUsed': 0.7318175208451436, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 419245802, u'vbActiveNumNonResident': 0, u'memUsed': 284263168} 2021-02-19 03:10:34,335 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 60692658, u'itemCount': 229400, u'quotaPercentUsed': 0.5667440517886739, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 285100329, u'vbActiveNumNonResident': 0, u'memUsed': 330214408} 2021-02-19 03:10:34,339 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 63836934, u'itemCount': 177864, u'quotaPercentUsed': 0.4596332209124763, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 272958796, u'vbActiveNumNonResident': 0, u'memUsed': 267806096} 2021-02-19 03:10:34,345 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 62285991, u'itemCount': 171671, u'quotaPercentUsed': 0.4558594949481529, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 521405828, u'vbActiveNumNonResident': 0, u'memUsed': 265607328} 2021-02-19 03:10:34,348 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 93697342, u'itemCount': 186311, u'quotaPercentUsed': 0.4659031755838496, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1175983572, u'vbActiveNumNonResident': 0, u'memUsed': 271459296} 2021-02-19 03:10:34,351 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 98224472, u'itemCount': 184657, u'quotaPercentUsed': 0.4682435101370864, u'storageTotals': {u'hdd': {u'usedByData': 7720727951L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 524386566144L, u'quotaUsedPerNode': 174795522048L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1225090403, u'vbActiveNumNonResident': 0, u'memUsed': 272822896} 2021-02-19 03:10:36,092 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1509] Deleted bucket: GleamBookUsers1 from 172.23.110.64 2021-02-19 03:10:36,092 | test | DEBUG | MainThread | [bucket_ready_functions:wait_for_bucket_deletion:1529] Waiting for bucket GleamBookUsers1 deletion to finish 2021-02-19 03:10:36,226 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 64935783, u'itemCount': 139105, u'quotaPercentUsed': 0.7166896161424484, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 466121392128L, u'quotaUsedPerNode': 155373797376L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 826518606, u'vbActiveNumNonResident': 0, u'memUsed': 278386968} 2021-02-19 03:10:36,230 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 59421005, u'itemCount': 141712, u'quotaPercentUsed': 0.4986521312374621, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 466121392128L, u'quotaUsedPerNode': 155373797376L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 546706593, u'vbActiveNumNonResident': 0, u'memUsed': 193693688} 2021-02-19 03:10:36,236 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 55339847, u'itemCount': 141426, u'quotaPercentUsed': 0.7318175208451436, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 466121392128L, u'quotaUsedPerNode': 155373797376L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 419546814, u'vbActiveNumNonResident': 0, u'memUsed': 284263168} 2021-02-19 03:10:36,246 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 60692658, u'itemCount': 229400, u'quotaPercentUsed': 0.5667440517886739, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 466121392128L, u'quotaUsedPerNode': 155373797376L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 285055780, u'vbActiveNumNonResident': 0, u'memUsed': 330214408} 2021-02-19 03:10:36,250 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 63836934, u'itemCount': 177864, u'quotaPercentUsed': 0.4596332209124763, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 466121392128L, u'quotaUsedPerNode': 155373797376L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 272557900, u'vbActiveNumNonResident': 0, u'memUsed': 267806096} 2021-02-19 03:10:36,253 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 62285991, u'itemCount': 171671, u'quotaPercentUsed': 0.4558594949481529, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 466121392128L, u'quotaUsedPerNode': 155373797376L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 521004921, u'vbActiveNumNonResident': 0, u'memUsed': 265607328} 2021-02-19 03:10:36,257 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 93697342, u'itemCount': 186311, u'quotaPercentUsed': 0.4659031755838496, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 466121392128L, u'quotaUsedPerNode': 155373797376L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1175582653, u'vbActiveNumNonResident': 0, u'memUsed': 271459296} 2021-02-19 03:10:36,262 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 98224472, u'itemCount': 184657, u'quotaPercentUsed': 0.4682435101370864, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 466121392128L, u'quotaUsedPerNode': 155373797376L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 966014850, u'vbActiveNumNonResident': 0, u'memUsed': 272822896} 2021-02-19 03:10:36,262 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1569] Remove bucket GleamBookUsers2 ... 2021-02-19 03:10:36,263 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1489] Deleting existing bucket GleamBookUsers2 on ip:172.23.110.64 port:8091 ssh_username:root 2021-02-19 03:10:36,516 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 64935783, u'itemCount': 139105, u'quotaPercentUsed': 0.7166896161424484, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 466121392128L, u'quotaUsedPerNode': 155373797376L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 826518606, u'vbActiveNumNonResident': 0, u'memUsed': 278386968} 2021-02-19 03:10:36,523 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 59421005, u'itemCount': 141712, u'quotaPercentUsed': 0.4986521312374621, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 466121392128L, u'quotaUsedPerNode': 155373797376L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 546706593, u'vbActiveNumNonResident': 0, u'memUsed': 193693688} 2021-02-19 03:10:36,526 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 55339847, u'itemCount': 141426, u'quotaPercentUsed': 0.7318175208451436, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 466121392128L, u'quotaUsedPerNode': 155373797376L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 419546814, u'vbActiveNumNonResident': 0, u'memUsed': 284263168} 2021-02-19 03:10:36,529 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 60692658, u'itemCount': 229400, u'quotaPercentUsed': 0.5667440517886739, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 466121392128L, u'quotaUsedPerNode': 155373797376L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 285055780, u'vbActiveNumNonResident': 0, u'memUsed': 330214408} 2021-02-19 03:10:36,532 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 63836934, u'itemCount': 177864, u'quotaPercentUsed': 0.4596332209124763, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 466121392128L, u'quotaUsedPerNode': 155373797376L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 272557900, u'vbActiveNumNonResident': 0, u'memUsed': 267806096} 2021-02-19 03:10:36,533 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 62285991, u'itemCount': 171671, u'quotaPercentUsed': 0.4558594949481529, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 466121392128L, u'quotaUsedPerNode': 155373797376L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 521004921, u'vbActiveNumNonResident': 0, u'memUsed': 265607328} 2021-02-19 03:10:36,536 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 93697342, u'itemCount': 186311, u'quotaPercentUsed': 0.4659031755838496, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 466121392128L, u'quotaUsedPerNode': 155373797376L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1175582653, u'vbActiveNumNonResident': 0, u'memUsed': 271459296} 2021-02-19 03:10:36,539 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 98224472, u'itemCount': 184657, u'quotaPercentUsed': 0.4682435101370864, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 466121392128L, u'quotaUsedPerNode': 155373797376L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 966014850, u'vbActiveNumNonResident': 0, u'memUsed': 272822896} 2021-02-19 03:10:38,578 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1509] Deleted bucket: GleamBookUsers2 from 172.23.110.64 2021-02-19 03:10:38,579 | test | DEBUG | MainThread | [bucket_ready_functions:wait_for_bucket_deletion:1529] Waiting for bucket GleamBookUsers2 deletion to finish 2021-02-19 03:10:38,683 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 59421005, u'itemCount': 141712, u'quotaPercentUsed': 0.4986521312374621, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 407856218112L, u'quotaUsedPerNode': 135952072704L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 546706593, u'vbActiveNumNonResident': 0, u'memUsed': 193693688} 2021-02-19 03:10:38,684 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 55339847, u'itemCount': 141426, u'quotaPercentUsed': 0.7318175208451436, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 407856218112L, u'quotaUsedPerNode': 135952072704L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 419546814, u'vbActiveNumNonResident': 0, u'memUsed': 284263168} 2021-02-19 03:10:38,688 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 60692658, u'itemCount': 229400, u'quotaPercentUsed': 0.5667440517886739, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 407856218112L, u'quotaUsedPerNode': 135952072704L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 285055780, u'vbActiveNumNonResident': 0, u'memUsed': 330214408} 2021-02-19 03:10:38,691 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 63836934, u'itemCount': 177864, u'quotaPercentUsed': 0.4596332209124763, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 407856218112L, u'quotaUsedPerNode': 135952072704L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 272557900, u'vbActiveNumNonResident': 0, u'memUsed': 267806096} 2021-02-19 03:10:38,694 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 62285991, u'itemCount': 171671, u'quotaPercentUsed': 0.4558594949481529, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 407856218112L, u'quotaUsedPerNode': 135952072704L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 521004921, u'vbActiveNumNonResident': 0, u'memUsed': 265607328} 2021-02-19 03:10:38,696 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 93697342, u'itemCount': 186311, u'quotaPercentUsed': 0.4659031755838496, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 407856218112L, u'quotaUsedPerNode': 135952072704L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1175582653, u'vbActiveNumNonResident': 0, u'memUsed': 271459296} 2021-02-19 03:10:38,698 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 98224472, u'itemCount': 184657, u'quotaPercentUsed': 0.4682435101370864, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 407856218112L, u'quotaUsedPerNode': 135952072704L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 966014850, u'vbActiveNumNonResident': 0, u'memUsed': 272822896} 2021-02-19 03:10:38,698 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1569] Remove bucket GleamBookUsers3 ... 2021-02-19 03:10:38,700 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1489] Deleting existing bucket GleamBookUsers3 on ip:172.23.110.64 port:8091 ssh_username:root 2021-02-19 03:10:38,806 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 59421005, u'itemCount': 141712, u'quotaPercentUsed': 0.4986521312374621, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 407856218112L, u'quotaUsedPerNode': 135952072704L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 546706593, u'vbActiveNumNonResident': 0, u'memUsed': 193693688} 2021-02-19 03:10:38,809 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 55339847, u'itemCount': 141426, u'quotaPercentUsed': 0.7318175208451436, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 407856218112L, u'quotaUsedPerNode': 135952072704L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 419546814, u'vbActiveNumNonResident': 0, u'memUsed': 284263168} 2021-02-19 03:10:38,815 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 60692658, u'itemCount': 229400, u'quotaPercentUsed': 0.5667440517886739, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 407856218112L, u'quotaUsedPerNode': 135952072704L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 285055780, u'vbActiveNumNonResident': 0, u'memUsed': 330214408} 2021-02-19 03:10:38,816 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 63836934, u'itemCount': 177864, u'quotaPercentUsed': 0.4596332209124763, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 407856218112L, u'quotaUsedPerNode': 135952072704L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 272557900, u'vbActiveNumNonResident': 0, u'memUsed': 267806096} 2021-02-19 03:10:38,819 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 62285991, u'itemCount': 171671, u'quotaPercentUsed': 0.4558594949481529, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 407856218112L, u'quotaUsedPerNode': 135952072704L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 521004921, u'vbActiveNumNonResident': 0, u'memUsed': 265607328} 2021-02-19 03:10:38,822 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 93697342, u'itemCount': 186311, u'quotaPercentUsed': 0.4659031755838496, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 407856218112L, u'quotaUsedPerNode': 135952072704L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1175582653, u'vbActiveNumNonResident': 0, u'memUsed': 271459296} 2021-02-19 03:10:38,825 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 98224472, u'itemCount': 184657, u'quotaPercentUsed': 0.4682435101370864, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 407856218112L, u'quotaUsedPerNode': 135952072704L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 966014850, u'vbActiveNumNonResident': 0, u'memUsed': 272822896} 2021-02-19 03:10:40,500 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1509] Deleted bucket: GleamBookUsers3 from 172.23.110.64 2021-02-19 03:10:40,500 | test | DEBUG | MainThread | [bucket_ready_functions:wait_for_bucket_deletion:1529] Waiting for bucket GleamBookUsers3 deletion to finish 2021-02-19 03:10:40,589 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 55339847, u'itemCount': 141426, u'quotaPercentUsed': 0.7318175208451436, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 349591044096L, u'quotaUsedPerNode': 116530348032L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 419546814, u'vbActiveNumNonResident': 0, u'memUsed': 284263168} 2021-02-19 03:10:40,595 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 60692658, u'itemCount': 229400, u'quotaPercentUsed': 0.5667440517886739, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 349591044096L, u'quotaUsedPerNode': 116530348032L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 285055780, u'vbActiveNumNonResident': 0, u'memUsed': 330214408} 2021-02-19 03:10:40,598 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 63836934, u'itemCount': 177864, u'quotaPercentUsed': 0.4596332209124763, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 349591044096L, u'quotaUsedPerNode': 116530348032L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 272557900, u'vbActiveNumNonResident': 0, u'memUsed': 267806096} 2021-02-19 03:10:40,601 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 62285991, u'itemCount': 171671, u'quotaPercentUsed': 0.4558594949481529, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 349591044096L, u'quotaUsedPerNode': 116530348032L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 521004921, u'vbActiveNumNonResident': 0, u'memUsed': 265607328} 2021-02-19 03:10:40,602 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 93697342, u'itemCount': 186311, u'quotaPercentUsed': 0.4659031755838496, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 349591044096L, u'quotaUsedPerNode': 116530348032L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1175582653, u'vbActiveNumNonResident': 0, u'memUsed': 271459296} 2021-02-19 03:10:40,607 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 98224472, u'itemCount': 184657, u'quotaPercentUsed': 0.4682435101370864, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 349591044096L, u'quotaUsedPerNode': 116530348032L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 966014850, u'vbActiveNumNonResident': 0, u'memUsed': 272822896} 2021-02-19 03:10:40,608 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1569] Remove bucket GleamBookUsers4 ... 2021-02-19 03:10:40,609 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1489] Deleting existing bucket GleamBookUsers4 on ip:172.23.110.64 port:8091 ssh_username:root 2021-02-19 03:10:40,707 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 55339847, u'itemCount': 141426, u'quotaPercentUsed': 0.7318175208451436, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 349591044096L, u'quotaUsedPerNode': 116530348032L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 419546814, u'vbActiveNumNonResident': 0, u'memUsed': 284263168} 2021-02-19 03:10:40,713 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 60692658, u'itemCount': 229400, u'quotaPercentUsed': 0.5667440517886739, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 349591044096L, u'quotaUsedPerNode': 116530348032L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 285055780, u'vbActiveNumNonResident': 0, u'memUsed': 330214408} 2021-02-19 03:10:40,716 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 63836934, u'itemCount': 177864, u'quotaPercentUsed': 0.4596332209124763, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 349591044096L, u'quotaUsedPerNode': 116530348032L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 272557900, u'vbActiveNumNonResident': 0, u'memUsed': 267806096} 2021-02-19 03:10:40,717 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 62285991, u'itemCount': 171671, u'quotaPercentUsed': 0.4558594949481529, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 349591044096L, u'quotaUsedPerNode': 116530348032L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 521004921, u'vbActiveNumNonResident': 0, u'memUsed': 265607328} 2021-02-19 03:10:40,720 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 93697342, u'itemCount': 186311, u'quotaPercentUsed': 0.4659031755838496, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 349591044096L, u'quotaUsedPerNode': 116530348032L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 1175582653, u'vbActiveNumNonResident': 0, u'memUsed': 271459296} 2021-02-19 03:10:40,723 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 98224472, u'itemCount': 184657, u'quotaPercentUsed': 0.4682435101370864, u'storageTotals': {u'hdd': {u'usedByData': 6057564398L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 2363240928L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 349591044096L, u'quotaUsedPerNode': 116530348032L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 966014850, u'vbActiveNumNonResident': 0, u'memUsed': 272822896} 2021-02-19 03:10:41,361 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1509] Deleted bucket: GleamBookUsers4 from 172.23.110.64 2021-02-19 03:10:41,361 | test | DEBUG | MainThread | [bucket_ready_functions:wait_for_bucket_deletion:1529] Waiting for bucket GleamBookUsers4 deletion to finish 2021-02-19 03:10:41,450 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 98262747, u'itemCount': 274692, u'quotaPercentUsed': 0.7017972826919087, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 291325870080L, u'quotaUsedPerNode': 97108623360L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 285055780, u'vbActiveNumNonResident': 0, u'memUsed': 408903408} 2021-02-19 03:10:41,453 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 95487794, u'itemCount': 266361, u'quotaPercentUsed': 0.6896360970099535, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 291325870080L, u'quotaUsedPerNode': 97108623360L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 272557900, u'vbActiveNumNonResident': 0, u'memUsed': 401817672} 2021-02-19 03:10:41,456 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 107930765, u'itemCount': 257143, u'quotaPercentUsed': 0.6861399982950667, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 291325870080L, u'quotaUsedPerNode': 97108623360L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 271517561, u'vbActiveNumNonResident': 0, u'memUsed': 399780664} 2021-02-19 03:10:41,460 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 112512891, u'itemCount': 254890, u'quotaPercentUsed': 0.7065132250132092, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 291325870080L, u'quotaUsedPerNode': 97108623360L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 535914429, u'vbActiveNumNonResident': 0, u'memUsed': 411651160} 2021-02-19 03:10:41,461 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 127650153, u'itemCount': 266631, u'quotaPercentUsed': 0.6979519256019516, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 291325870080L, u'quotaUsedPerNode': 97108623360L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 966014850, u'vbActiveNumNonResident': 0, u'memUsed': 406662904} 2021-02-19 03:10:41,461 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1569] Remove bucket GleamBookUsers5 ... 2021-02-19 03:10:41,463 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1489] Deleting existing bucket GleamBookUsers5 on ip:172.23.110.64 port:8091 ssh_username:root 2021-02-19 03:10:41,553 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 98262747, u'itemCount': 274692, u'quotaPercentUsed': 0.7017972826919087, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 291325870080L, u'quotaUsedPerNode': 97108623360L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 285055780, u'vbActiveNumNonResident': 0, u'memUsed': 408903408} 2021-02-19 03:10:41,555 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 95487794, u'itemCount': 266361, u'quotaPercentUsed': 0.6896360970099535, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 291325870080L, u'quotaUsedPerNode': 97108623360L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 272557900, u'vbActiveNumNonResident': 0, u'memUsed': 401817672} 2021-02-19 03:10:41,558 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 107930765, u'itemCount': 257143, u'quotaPercentUsed': 0.6861399982950667, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 291325870080L, u'quotaUsedPerNode': 97108623360L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 271517561, u'vbActiveNumNonResident': 0, u'memUsed': 399780664} 2021-02-19 03:10:41,561 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 112512891, u'itemCount': 254890, u'quotaPercentUsed': 0.7065132250132092, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 291325870080L, u'quotaUsedPerNode': 97108623360L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 535914429, u'vbActiveNumNonResident': 0, u'memUsed': 411651160} 2021-02-19 03:10:41,563 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 127650153, u'itemCount': 266631, u'quotaPercentUsed': 0.6979519256019516, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 291325870080L, u'quotaUsedPerNode': 97108623360L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 966014850, u'vbActiveNumNonResident': 0, u'memUsed': 406662904} 2021-02-19 03:10:42,645 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1509] Deleted bucket: GleamBookUsers5 from 172.23.110.64 2021-02-19 03:10:42,647 | test | DEBUG | MainThread | [bucket_ready_functions:wait_for_bucket_deletion:1529] Waiting for bucket GleamBookUsers5 deletion to finish 2021-02-19 03:10:42,703 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 95487794, u'itemCount': 266361, u'quotaPercentUsed': 0.6896360970099535, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 233060696064L, u'quotaUsedPerNode': 77686898688L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 272557900, u'vbActiveNumNonResident': 0, u'memUsed': 401817672} 2021-02-19 03:10:42,707 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 107930765, u'itemCount': 257143, u'quotaPercentUsed': 0.6861399982950667, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 233060696064L, u'quotaUsedPerNode': 77686898688L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 271517561, u'vbActiveNumNonResident': 0, u'memUsed': 399780664} 2021-02-19 03:10:42,710 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 112512891, u'itemCount': 254890, u'quotaPercentUsed': 0.7065132250132092, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 233060696064L, u'quotaUsedPerNode': 77686898688L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 535914429, u'vbActiveNumNonResident': 0, u'memUsed': 411651160} 2021-02-19 03:10:42,711 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 127650153, u'itemCount': 266631, u'quotaPercentUsed': 0.6979519256019516, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 233060696064L, u'quotaUsedPerNode': 77686898688L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 966014850, u'vbActiveNumNonResident': 0, u'memUsed': 406662904} 2021-02-19 03:10:42,713 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1569] Remove bucket GleamBookUsers6 ... 2021-02-19 03:10:42,713 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1489] Deleting existing bucket GleamBookUsers6 on ip:172.23.110.64 port:8091 ssh_username:root 2021-02-19 03:10:42,786 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 95487794, u'itemCount': 266361, u'quotaPercentUsed': 0.6896360970099535, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 233060696064L, u'quotaUsedPerNode': 77686898688L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 272557900, u'vbActiveNumNonResident': 0, u'memUsed': 401817672} 2021-02-19 03:10:42,788 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 107930765, u'itemCount': 257143, u'quotaPercentUsed': 0.6861399982950667, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 233060696064L, u'quotaUsedPerNode': 77686898688L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 271517561, u'vbActiveNumNonResident': 0, u'memUsed': 399780664} 2021-02-19 03:10:42,789 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 112512891, u'itemCount': 254890, u'quotaPercentUsed': 0.7065132250132092, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 233060696064L, u'quotaUsedPerNode': 77686898688L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 535914429, u'vbActiveNumNonResident': 0, u'memUsed': 411651160} 2021-02-19 03:10:42,792 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 127650153, u'itemCount': 266631, u'quotaPercentUsed': 0.6979519256019516, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 3001608744L, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 233060696064L, u'quotaUsedPerNode': 77686898688L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 966014850, u'vbActiveNumNonResident': 0, u'memUsed': 406662904} 2021-02-19 03:10:43,278 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1509] Deleted bucket: GleamBookUsers6 from 172.23.110.64 2021-02-19 03:10:43,279 | test | DEBUG | MainThread | [bucket_ready_functions:wait_for_bucket_deletion:1529] Waiting for bucket GleamBookUsers6 deletion to finish 2021-02-19 03:10:43,325 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 107930765, u'itemCount': 257143, u'quotaPercentUsed': 0.6883541236654735, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 1928210384, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 174795522048L, u'quotaUsedPerNode': 58265174016L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 271517561, u'vbActiveNumNonResident': 0, u'memUsed': 401070728} 2021-02-19 03:10:43,326 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 112512891, u'itemCount': 254890, u'quotaPercentUsed': 0.7084923420749438, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 1928210384, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 174795522048L, u'quotaUsedPerNode': 58265174016L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 535914429, u'vbActiveNumNonResident': 0, u'memUsed': 412804296} 2021-02-19 03:10:43,328 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 120877650, u'itemCount': 264802, u'quotaPercentUsed': 0.6999205526924415, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 1928210384, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 174795522048L, u'quotaUsedPerNode': 58265174016L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 966014850, u'vbActiveNumNonResident': 0, u'memUsed': 407809928} 2021-02-19 03:10:43,329 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1569] Remove bucket GleamBookUsers7 ... 2021-02-19 03:10:43,329 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1489] Deleting existing bucket GleamBookUsers7 on ip:172.23.110.64 port:8091 ssh_username:root 2021-02-19 03:10:43,387 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 107930765, u'itemCount': 257143, u'quotaPercentUsed': 0.6883541236654735, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 1928210384, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 174795522048L, u'quotaUsedPerNode': 58265174016L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 271517561, u'vbActiveNumNonResident': 0, u'memUsed': 401070728} 2021-02-19 03:10:43,388 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 112512891, u'itemCount': 254890, u'quotaPercentUsed': 0.7084923420749438, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 1928210384, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 174795522048L, u'quotaUsedPerNode': 58265174016L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 535914429, u'vbActiveNumNonResident': 0, u'memUsed': 412804296} 2021-02-19 03:10:43,391 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 120877650, u'itemCount': 264802, u'quotaPercentUsed': 0.6999205526924415, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 1928210384, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 174795522048L, u'quotaUsedPerNode': 58265174016L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 966014850, u'vbActiveNumNonResident': 0, u'memUsed': 407809928} 2021-02-19 03:10:43,869 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1509] Deleted bucket: GleamBookUsers7 from 172.23.110.64 2021-02-19 03:10:43,869 | test | DEBUG | MainThread | [bucket_ready_functions:wait_for_bucket_deletion:1529] Waiting for bucket GleamBookUsers7 deletion to finish 2021-02-19 03:10:43,913 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 112512891, u'itemCount': 254890, u'quotaPercentUsed': 0.7084923420749438, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 1928210384, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 116530348032L, u'quotaUsedPerNode': 38843449344L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 535914429, u'vbActiveNumNonResident': 0, u'memUsed': 412804296} 2021-02-19 03:10:43,914 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 120877650, u'itemCount': 264802, u'quotaPercentUsed': 0.6999205526924415, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 1928210384, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 116530348032L, u'quotaUsedPerNode': 38843449344L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 966014850, u'vbActiveNumNonResident': 0, u'memUsed': 407809928} 2021-02-19 03:10:43,915 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1569] Remove bucket GleamBookUsers8 ... 2021-02-19 03:10:43,915 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1489] Deleting existing bucket GleamBookUsers8 on ip:172.23.110.64 port:8091 ssh_username:root 2021-02-19 03:10:43,970 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 112512891, u'itemCount': 254890, u'quotaPercentUsed': 0.7084923420749438, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 1928210384, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 116530348032L, u'quotaUsedPerNode': 38843449344L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 535914429, u'vbActiveNumNonResident': 0, u'memUsed': 412804296} 2021-02-19 03:10:43,973 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 120877650, u'itemCount': 264802, u'quotaPercentUsed': 0.6999205526924415, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 1928210384, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 116530348032L, u'quotaUsedPerNode': 38843449344L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 966014850, u'vbActiveNumNonResident': 0, u'memUsed': 407809928} 2021-02-19 03:10:44,448 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1509] Deleted bucket: GleamBookUsers8 from 172.23.110.64 2021-02-19 03:10:44,448 | test | DEBUG | MainThread | [bucket_ready_functions:wait_for_bucket_deletion:1529] Waiting for bucket GleamBookUsers8 deletion to finish 2021-02-19 03:10:44,480 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 120877650, u'itemCount': 264802, u'quotaPercentUsed': 0.6999205526924415, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 1928210384, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 58265174016L, u'quotaUsedPerNode': 19421724672L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 966014850, u'vbActiveNumNonResident': 0, u'memUsed': 407809928} 2021-02-19 03:10:44,482 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1569] Remove bucket GleamBookUsers9 ... 2021-02-19 03:10:44,483 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1489] Deleting existing bucket GleamBookUsers9 on ip:172.23.110.64 port:8091 ssh_username:root 2021-02-19 03:10:44,535 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 120877650, u'itemCount': 264802, u'quotaPercentUsed': 0.6999205526924415, u'storageTotals': {u'hdd': {u'usedByData': 3510074748L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 1928210384, u'used': 35538124800L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 58265174016L, u'quotaUsedPerNode': 19421724672L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 966014850, u'vbActiveNumNonResident': 0, u'memUsed': 407809928} 2021-02-19 03:10:46,523 | test | DEBUG | MainThread | [bucket_ready_functions:delete_bucket:1509] Deleted bucket: GleamBookUsers9 from 172.23.110.64 2021-02-19 03:10:46,523 | test | DEBUG | MainThread | [bucket_ready_functions:wait_for_bucket_deletion:1529] Waiting for bucket GleamBookUsers9 deletion to finish 2021-02-19 03:10:46,588 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1567] Deleting existing buckets [] on 172.23.110.65 2021-02-19 03:10:46,733 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1567] Deleting existing buckets [] on 172.23.110.66 2021-02-19 03:10:46,759 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1567] Deleting existing buckets [] on 172.23.110.67 2021-02-19 03:10:46,782 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1567] Deleting existing buckets [] on 172.23.110.68 2021-02-19 03:10:46,805 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1567] Deleting existing buckets [] on 172.23.110.69 2021-02-19 03:10:46,826 | test | DEBUG | MainThread | [bucket_ready_functions:delete_all_buckets:1567] Deleting existing buckets [] on 172.23.110.70 2021-02-19 03:10:46,872 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 120secs 2021-02-19 03:10:46,911 | test | DEBUG | MainThread | [cluster_ready_functions:cleanup_cluster:166] Rebalancing all nodes in order to remove nodes 2021-02-19 03:10:46,921 | test | DEBUG | MainThread | [rest_client:remove_nodes:124] Ejecting nodes '[u'ns_1@172.23.110.69', u'ns_1@172.23.110.65']' from cluster 2021-02-19 03:10:46,921 | test | DEBUG | MainThread | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': u'ns_1@172.23.110.69,ns_1@172.23.110.65', 'user': 'Administrator'} 2021-02-19 03:10:46,954 | test | DEBUG | MainThread | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 03:10:46,967 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 03:10:58,444 | test | INFO | MainThread | [rest_client:monitorRebalance:1448] Rebalance done. Taken 11.4869999886 seconds to complete 2021-02-19 03:10:58,459 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> monitorRebalance():L1451 2021-02-19 03:10:58,460 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 5 seconds. Reason: Wait after rebalance complete 2021-02-19 03:11:03,506 | test | DEBUG | MainThread | [cluster_ready_functions:cleanup_cluster:213] Removed all the nodes from cluster associated with ip:172.23.110.64 port:8091 ssh_username:root ? [(u'ns_1@172.23.110.69', 8091), (u'ns_1@172.23.110.65', 8091)] 2021-02-19 03:11:03,517 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.64:8091 2021-02-19 03:11:03,519 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 360secs 2021-02-19 03:11:03,529 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.64:8091 is running 2021-02-19 03:11:03,542 | test | WARNING | MainThread | [basetestcase:tearDownEverything:466] CLEANUP WAS SKIPPED 2021-02-19 03:11:03,542 | infra | INFO | MainThread | [basetestcase:tearDownEverything:508] ========== tasks in thread pool ========== 2021-02-19 03:11:03,542 | infra | INFO | MainThread | [basetestcase:tearDownEverything:510] ========================================== 2021-02-19 03:11:03,542 | test | INFO | MainThread | [basetestcase:setUp:318] Initializing cluster 2021-02-19 03:11:05,891 | test | DEBUG | MainThread | [cluster_ready_functions:stop_server:407] Couchbase stopped on ip:172.23.110.64 port:8091 ssh_username:root 2021-02-19 03:11:06,282 | test | DEBUG | MainThread | [cluster_ready_functions:start_server:421] Couchbase started on ip:172.23.110.64 port:8091 ssh_username:root 2021-02-19 03:11:08,447 | test | DEBUG | MainThread | [cluster_ready_functions:stop_server:407] Couchbase stopped on ip:172.23.110.65 port:8091 ssh_username:root 2021-02-19 03:11:08,826 | test | DEBUG | MainThread | [cluster_ready_functions:start_server:421] Couchbase started on ip:172.23.110.65 port:8091 ssh_username:root 2021-02-19 03:11:11,096 | test | DEBUG | MainThread | [cluster_ready_functions:stop_server:407] Couchbase stopped on ip:172.23.110.66 port:8091 ssh_username:root 2021-02-19 03:11:11,489 | test | DEBUG | MainThread | [cluster_ready_functions:start_server:421] Couchbase started on ip:172.23.110.66 port:8091 ssh_username:root 2021-02-19 03:11:13,711 | test | DEBUG | MainThread | [cluster_ready_functions:stop_server:407] Couchbase stopped on ip:172.23.110.67 port:8091 ssh_username:root 2021-02-19 03:11:14,112 | test | DEBUG | MainThread | [cluster_ready_functions:start_server:421] Couchbase started on ip:172.23.110.67 port:8091 ssh_username:root 2021-02-19 03:11:16,414 | test | DEBUG | MainThread | [cluster_ready_functions:stop_server:407] Couchbase stopped on ip:172.23.110.68 port:8091 ssh_username:root 2021-02-19 03:11:16,799 | test | DEBUG | MainThread | [cluster_ready_functions:start_server:421] Couchbase started on ip:172.23.110.68 port:8091 ssh_username:root 2021-02-19 03:11:19,091 | test | DEBUG | MainThread | [cluster_ready_functions:stop_server:407] Couchbase stopped on ip:172.23.110.69 port:8091 ssh_username:root 2021-02-19 03:11:19,503 | test | DEBUG | MainThread | [cluster_ready_functions:start_server:421] Couchbase started on ip:172.23.110.69 port:8091 ssh_username:root 2021-02-19 03:11:21,779 | test | DEBUG | MainThread | [cluster_ready_functions:stop_server:407] Couchbase stopped on ip:172.23.110.70 port:8091 ssh_username:root 2021-02-19 03:11:22,170 | test | DEBUG | MainThread | [cluster_ready_functions:start_server:421] Couchbase started on ip:172.23.110.70 port:8091 ssh_username:root 2021-02-19 03:11:22,180 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/cluster_utils/cluster_ready_functions.py -> reset_cluster():L492 2021-02-19 03:11:22,180 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:11:32,492 | test | DEBUG | MainThread | [rest_client:set_data_path:2043] /nodes/self/controller/settings: path=%2Fdata&index_path=%2Fdata 2021-02-19 03:11:32,502 | test | DEBUG | MainThread | [rest_client:set_data_path:2046] Setting paths: path=%2Fdata&index_path=%2Fdata: status 1 2021-02-19 03:11:32,503 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: node_init_task_172.23.110.64_8091 2021-02-19 03:11:32,503 | infra | INFO | pool-1-thread-1 | [task:start_task:84] Thread 'node_init_task_172.23.110.64_8091' started 2021-02-19 03:11:32,598 | test | DEBUG | pool-1-thread-1 | [task:call:5519] server: ip:172.23.110.64 port:8091 ssh_username:root, nodes/self: {'memcached': 11210, 'memoryFree': 267945357312L, 'eventingMemoryQuota': 256, 'rest_password': '', 'storage': [], 'ports': [], 'cbasMemoryQuota': 21503, 'hostname': u'172.23.110.64:8091', 'ftsMemoryQuota': 512, 'clusterCompatibility': 458752, 'id': u'ns_1@172.23.110.64', 'mcdMemoryReserved': 206022, 'moxi': 11211, 'rest_username': '', 'os': u'x86_64-unknown-linux-gnu', 'ip': u'172.23.110.64', 'curr_items': 0, 'mcdMemoryAllocated': 206022, 'services': [u'kv'], 'version': u'7.0.0-4498-enterprise', 'indexMemoryQuota': 512, 'uptime': u'24', 'clusterMembership': u'active', 'storageTotalRam': 257527L, 'port': u'8091', 'availableStorage': [], 'memoryTotal': 270037663744L, 'memoryQuota': 185329, 'status': u'healthy'} 2021-02-19 03:11:32,598 | test | DEBUG | pool-1-thread-1 | [rest_client:init_cluster_memoryQuota:863] pools/default params: memoryQuota=185329 2021-02-19 03:11:32,611 | test | DEBUG | pool-1-thread-1 | [rest_client:set_indexer_storage_mode:897] settings/indexes params: storageMode=plasma 2021-02-19 03:11:32,628 | test | DEBUG | pool-1-thread-1 | [rest_client:init_cluster:769] settings/web params on 172.23.110.64:8091:password=password&port=8091&username=Administrator 2021-02-19 03:11:32,880 | test | DEBUG | MainThread | [rest_client:set_data_path:2043] /nodes/self/controller/settings: path=%2Fdata&index_path=%2Fdata 2021-02-19 03:11:32,890 | test | DEBUG | MainThread | [rest_client:set_data_path:2046] Setting paths: path=%2Fdata&index_path=%2Fdata: status 1 2021-02-19 03:11:32,890 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: node_init_task_172.23.110.65_8091 2021-02-19 03:11:32,891 | infra | INFO | pool-1-thread-2 | [task:start_task:84] Thread 'node_init_task_172.23.110.65_8091' started 2021-02-19 03:11:32,917 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L133 2021-02-19 03:11:32,917 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:24] Sleep 0.01 seconds. Reason: None 2021-02-19 03:11:32,941 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L133 2021-02-19 03:11:32,941 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:24] Sleep 0.02 seconds. Reason: None 2021-02-19 03:11:32,974 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L133 2021-02-19 03:11:32,976 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:24] Sleep 0.04 seconds. Reason: None 2021-02-19 03:11:33,029 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L133 2021-02-19 03:11:33,029 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:24] Sleep 0.08 seconds. Reason: None 2021-02-19 03:11:33,121 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L133 2021-02-19 03:11:33,122 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:24] Sleep 0.16 seconds. Reason: None 2021-02-19 03:11:33,207 | test | DEBUG | MainThread | [rest_client:set_data_path:2043] /nodes/self/controller/settings: path=%2Fdata&index_path=%2Fdata 2021-02-19 03:11:33,217 | test | DEBUG | MainThread | [rest_client:set_data_path:2046] Setting paths: path=%2Fdata&index_path=%2Fdata: status 1 2021-02-19 03:11:33,217 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: node_init_task_172.23.110.66_8091 2021-02-19 03:11:33,217 | infra | INFO | pool-1-thread-3 | [task:start_task:84] Thread 'node_init_task_172.23.110.66_8091' started 2021-02-19 03:11:33,240 | test | DEBUG | pool-1-thread-3 | [task:call:5519] server: ip:172.23.110.66 port:8091 ssh_username:root, nodes/self: {'memcached': 11210, 'memoryFree': 268463288320L, 'eventingMemoryQuota': 256, 'rest_password': '', 'storage': [], 'ports': [], 'cbasMemoryQuota': 21503, 'hostname': u'172.23.110.66:8091', 'ftsMemoryQuota': 512, 'clusterCompatibility': 458752, 'id': u'ns_1@cb.local', 'mcdMemoryReserved': 206022, 'moxi': 11211, 'rest_username': '', 'os': u'x86_64-unknown-linux-gnu', 'ip': u'172.23.110.66', 'curr_items': 0, 'mcdMemoryAllocated': 206022, 'services': [u'kv'], 'version': u'7.0.0-4498-enterprise', 'indexMemoryQuota': 512, 'uptime': u'18', 'clusterMembership': u'active', 'storageTotalRam': 257527L, 'port': u'8091', 'availableStorage': [], 'memoryTotal': 270037663744L, 'memoryQuota': 185329, 'status': u'healthy'} 2021-02-19 03:11:33,240 | test | DEBUG | pool-1-thread-3 | [rest_client:init_cluster_memoryQuota:863] pools/default params: memoryQuota=185329 2021-02-19 03:11:33,253 | test | DEBUG | pool-1-thread-3 | [rest_client:set_indexer_storage_mode:897] settings/indexes params: storageMode=plasma 2021-02-19 03:11:33,266 | test | DEBUG | pool-1-thread-3 | [rest_client:init_cluster:769] settings/web params on 172.23.110.66:8091:password=password&port=8091&username=Administrator 2021-02-19 03:11:33,296 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L133 2021-02-19 03:11:33,296 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:24] Sleep 0.32 seconds. Reason: None 2021-02-19 03:11:33,520 | test | DEBUG | MainThread | [rest_client:set_data_path:2043] /nodes/self/controller/settings: path=%2Fdata&index_path=%2Fdata 2021-02-19 03:11:33,530 | test | DEBUG | MainThread | [rest_client:set_data_path:2046] Setting paths: path=%2Fdata&index_path=%2Fdata: status 1 2021-02-19 03:11:33,532 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: node_init_task_172.23.110.67_8091 2021-02-19 03:11:33,532 | infra | INFO | pool-1-thread-4 | [task:start_task:84] Thread 'node_init_task_172.23.110.67_8091' started 2021-02-19 03:11:33,553 | test | DEBUG | pool-1-thread-4 | [task:call:5519] server: ip:172.23.110.67 port:8091 ssh_username:root, nodes/self: {'memcached': 11210, 'memoryFree': 268445024256L, 'eventingMemoryQuota': 256, 'rest_password': '', 'storage': [], 'ports': [], 'cbasMemoryQuota': 21503, 'hostname': u'172.23.110.67:8091', 'ftsMemoryQuota': 512, 'clusterCompatibility': 458752, 'id': u'ns_1@cb.local', 'mcdMemoryReserved': 206022, 'moxi': 11211, 'rest_username': '', 'os': u'x86_64-unknown-linux-gnu', 'ip': u'172.23.110.67', 'curr_items': 0, 'mcdMemoryAllocated': 206022, 'services': [u'kv'], 'version': u'7.0.0-4498-enterprise', 'indexMemoryQuota': 512, 'uptime': u'13', 'clusterMembership': u'active', 'storageTotalRam': 257527L, 'port': u'8091', 'availableStorage': [], 'memoryTotal': 270037663744L, 'memoryQuota': 185329, 'status': u'healthy'} 2021-02-19 03:11:33,555 | test | DEBUG | pool-1-thread-4 | [rest_client:init_cluster_memoryQuota:863] pools/default params: memoryQuota=185329 2021-02-19 03:11:33,568 | test | DEBUG | pool-1-thread-4 | [rest_client:set_indexer_storage_mode:897] settings/indexes params: storageMode=plasma 2021-02-19 03:11:33,578 | test | DEBUG | pool-1-thread-4 | [rest_client:init_cluster:769] settings/web params on 172.23.110.67:8091:password=password&port=8091&username=Administrator 2021-02-19 03:11:33,630 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L133 2021-02-19 03:11:33,631 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:24] Sleep 0.64 seconds. Reason: None 2021-02-19 03:11:33,828 | test | DEBUG | MainThread | [rest_client:set_data_path:2043] /nodes/self/controller/settings: path=%2Fdata&index_path=%2Fdata 2021-02-19 03:11:33,838 | test | DEBUG | MainThread | [rest_client:set_data_path:2046] Setting paths: path=%2Fdata&index_path=%2Fdata: status 1 2021-02-19 03:11:33,838 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: node_init_task_172.23.110.68_8091 2021-02-19 03:11:33,838 | infra | INFO | pool-1-thread-5 | [task:start_task:84] Thread 'node_init_task_172.23.110.68_8091' started 2021-02-19 03:11:33,861 | test | DEBUG | pool-1-thread-5 | [task:call:5519] server: ip:172.23.110.68 port:8091 ssh_username:root, nodes/self: {'memcached': 11210, 'memoryFree': 268440080384L, 'eventingMemoryQuota': 256, 'rest_password': '', 'storage': [], 'ports': [], 'cbasMemoryQuota': 21503, 'hostname': u'172.23.110.68:8091', 'ftsMemoryQuota': 512, 'clusterCompatibility': 458752, 'id': u'ns_1@cb.local', 'mcdMemoryReserved': 206022, 'moxi': 11211, 'rest_username': '', 'os': u'x86_64-unknown-linux-gnu', 'ip': u'172.23.110.68', 'curr_items': 0, 'mcdMemoryAllocated': 206022, 'services': [u'kv'], 'version': u'7.0.0-4498-enterprise', 'indexMemoryQuota': 512, 'uptime': u'13', 'clusterMembership': u'active', 'storageTotalRam': 257527L, 'port': u'8091', 'availableStorage': [], 'memoryTotal': 270037663744L, 'memoryQuota': 185329, 'status': u'healthy'} 2021-02-19 03:11:33,861 | test | DEBUG | pool-1-thread-5 | [rest_client:init_cluster_memoryQuota:863] pools/default params: memoryQuota=185329 2021-02-19 03:11:33,874 | test | DEBUG | pool-1-thread-5 | [rest_client:set_indexer_storage_mode:897] settings/indexes params: storageMode=plasma 2021-02-19 03:11:33,884 | test | DEBUG | pool-1-thread-5 | [rest_client:init_cluster:769] settings/web params on 172.23.110.68:8091:password=password&port=8091&username=Administrator 2021-02-19 03:11:34,161 | test | DEBUG | MainThread | [rest_client:set_data_path:2043] /nodes/self/controller/settings: path=%2Fdata&index_path=%2Fdata 2021-02-19 03:11:34,170 | test | DEBUG | MainThread | [rest_client:set_data_path:2046] Setting paths: path=%2Fdata&index_path=%2Fdata: status 1 2021-02-19 03:11:34,171 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: node_init_task_172.23.110.69_8091 2021-02-19 03:11:34,171 | infra | INFO | pool-1-thread-6 | [task:start_task:84] Thread 'node_init_task_172.23.110.69_8091' started 2021-02-19 03:11:34,191 | test | DEBUG | pool-1-thread-6 | [task:call:5519] server: ip:172.23.110.69 port:8091 ssh_username:root, nodes/self: {'memcached': 11210, 'memoryFree': 268196499456L, 'eventingMemoryQuota': 256, 'rest_password': '', 'storage': [], 'ports': [], 'cbasMemoryQuota': 21503, 'hostname': u'172.23.110.69:8091', 'ftsMemoryQuota': 512, 'clusterCompatibility': 458752, 'id': u'ns_1@172.23.110.69', 'mcdMemoryReserved': 206022, 'moxi': 11211, 'rest_username': '', 'os': u'x86_64-unknown-linux-gnu', 'ip': u'172.23.110.69', 'curr_items': 0, 'mcdMemoryAllocated': 206022, 'services': [u'kv'], 'version': u'7.0.0-4498-enterprise', 'indexMemoryQuota': 512, 'uptime': u'8', 'clusterMembership': u'active', 'storageTotalRam': 257527L, 'port': u'8091', 'availableStorage': [], 'memoryTotal': 270037663744L, 'memoryQuota': 153850, 'status': u'healthy'} 2021-02-19 03:11:34,193 | test | DEBUG | pool-1-thread-6 | [rest_client:init_cluster_memoryQuota:863] pools/default params: memoryQuota=185329 2021-02-19 03:11:34,206 | test | DEBUG | pool-1-thread-6 | [rest_client:set_indexer_storage_mode:897] settings/indexes params: storageMode=plasma 2021-02-19 03:11:34,219 | test | DEBUG | pool-1-thread-6 | [rest_client:init_cluster:769] settings/web params on 172.23.110.69:8091:password=password&port=8091&username=Administrator 2021-02-19 03:11:34,283 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L133 2021-02-19 03:11:34,285 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:24] Sleep 1.28 seconds. Reason: None 2021-02-19 03:11:34,479 | test | DEBUG | MainThread | [rest_client:set_data_path:2043] /nodes/self/controller/settings: path=%2Fdata&index_path=%2Fdata 2021-02-19 03:11:34,489 | test | DEBUG | MainThread | [rest_client:set_data_path:2046] Setting paths: path=%2Fdata&index_path=%2Fdata: status 1 2021-02-19 03:11:34,490 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: node_init_task_172.23.110.70_8091 2021-02-19 03:11:34,490 | infra | INFO | pool-1-thread-7 | [task:start_task:84] Thread 'node_init_task_172.23.110.70_8091' started 2021-02-19 03:11:34,513 | test | DEBUG | pool-1-thread-7 | [task:call:5519] server: ip:172.23.110.70 port:8091 ssh_username:root, nodes/self: {'memcached': 11210, 'memoryFree': 268451311616L, 'eventingMemoryQuota': 256, 'rest_password': '', 'storage': [], 'ports': [], 'cbasMemoryQuota': 21503, 'hostname': u'172.23.110.70:8091', 'ftsMemoryQuota': 512, 'clusterCompatibility': 458752, 'id': u'ns_1@cb.local', 'mcdMemoryReserved': 206022, 'moxi': 11211, 'rest_username': '', 'os': u'x86_64-unknown-linux-gnu', 'ip': u'172.23.110.70', 'curr_items': 0, 'mcdMemoryAllocated': 206022, 'services': [u'kv'], 'version': u'7.0.0-4498-enterprise', 'indexMemoryQuota': 512, 'uptime': u'8', 'clusterMembership': u'active', 'storageTotalRam': 257527L, 'port': u'8091', 'availableStorage': [], 'memoryTotal': 270037663744L, 'memoryQuota': 185329, 'status': u'healthy'} 2021-02-19 03:11:34,513 | test | DEBUG | pool-1-thread-7 | [rest_client:init_cluster_memoryQuota:863] pools/default params: memoryQuota=185329 2021-02-19 03:11:34,526 | test | DEBUG | pool-1-thread-7 | [rest_client:set_indexer_storage_mode:897] settings/indexes params: storageMode=plasma 2021-02-19 03:11:34,539 | test | DEBUG | pool-1-thread-7 | [rest_client:init_cluster:769] settings/web params on 172.23.110.70:8091:password=password&port=8091&username=Administrator 2021-02-19 03:11:35,578 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L133 2021-02-19 03:11:35,578 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:24] Sleep 2.56 seconds. Reason: None 2021-02-19 03:11:38,151 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:17] Sleep is called from lib/Jython_tasks/task.py -> wait_until():L133 2021-02-19 03:11:38,153 | test | DEBUG | pool-1-thread-2 | [common_lib:sleep:24] Sleep 5.12 seconds. Reason: None 2021-02-19 03:11:43,283 | test | DEBUG | pool-1-thread-2 | [task:call:5519] server: ip:172.23.110.65 port:8091 ssh_username:root, nodes/self: {'memcached': 11210, 'memoryFree': 268278038528L, 'eventingMemoryQuota': 256, 'rest_password': '', 'storage': [], 'ports': [], 'cbasMemoryQuota': 21503, 'hostname': u'172.23.110.65:8091', 'ftsMemoryQuota': 512, 'clusterCompatibility': 458752, 'id': u'ns_1@172.23.110.65', 'mcdMemoryReserved': 206022, 'moxi': 11211, 'rest_username': '', 'os': u'x86_64-unknown-linux-gnu', 'ip': u'172.23.110.65', 'curr_items': 0, 'mcdMemoryAllocated': 206022, 'services': [u'kv'], 'version': u'7.0.0-4498-enterprise', 'indexMemoryQuota': 512, 'uptime': u'28', 'clusterMembership': u'active', 'storageTotalRam': 257527L, 'port': u'8091', 'availableStorage': [], 'memoryTotal': 270037663744L, 'memoryQuota': 153850, 'status': u'healthy'} 2021-02-19 03:11:43,285 | test | DEBUG | pool-1-thread-2 | [rest_client:init_cluster_memoryQuota:863] pools/default params: memoryQuota=185329 2021-02-19 03:11:43,296 | test | DEBUG | pool-1-thread-2 | [rest_client:set_indexer_storage_mode:897] settings/indexes params: storageMode=plasma 2021-02-19 03:11:43,308 | test | DEBUG | pool-1-thread-2 | [rest_client:init_cluster:769] settings/web params on 172.23.110.65:8091:password=password&port=8091&username=Administrator 2021-02-19 03:11:43,388 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:587] RAM quota was defined less than 100 MB: 2021-02-19 03:11:43,663 | test | DEBUG | MainThread | [basetestcase:_initialize_nodes:591] 172.23.110.64: ['MemTotal: 263708656 kB\n', 'MemFree: 257871808 kB\n', 'MemAvailable: 261133052 kB\n', 'Buffers: 2320 kB\n', 'Cached: 3783396 kB\n', 'SwapCached: 0 kB\n', 'Active: 2030180 kB\n', 'Inactive: 2454016 kB\n', 'Active(anon): 699888 kB\n', 'Inactive(anon): 8436 kB\n', 'Active(file): 1330292 kB\n', 'Inactive(file): 2445580 kB\n', 'Unevictable: 0 kB\n', 'Mlocked: 0 kB\n', 'SwapTotal: 4194300 kB\n', 'SwapFree: 4194300 kB\n', 'Dirty: 3604 kB\n', 'Writeback: 0 kB\n', 'AnonPages: 698976 kB\n', 'Mapped: 151780 kB\n', 'Shmem: 9836 kB\n', 'Slab: 616396 kB\n', 'SReclaimable: 369472 kB\n', 'SUnreclaim: 246924 kB\n', 'KernelStack: 33616 kB\n', 'PageTables: 14716 kB\n', 'NFS_Unstable: 0 kB\n', 'Bounce: 0 kB\n', 'WritebackTmp: 0 kB\n', 'CommitLimit: 136048628 kB\n', 'Committed_AS: 3988256 kB\n', 'VmallocTotal: 34359738367 kB\n', 'VmallocUsed: 0 kB\n', 'VmallocChunk: 0 kB\n', 'HardwareCorrupted: 0 kB\n', 'AnonHugePages: 8192 kB\n', 'HugePages_Total: 0\n', 'HugePages_Free: 0\n', 'HugePages_Rsvd: 0\n', 'HugePages_Surp: 0\n', 'Hugepagesize: 2048 kB\n', 'DirectMap4k: 353280 kB\n', 'DirectMap2M: 10790912 kB\n', 'DirectMap1G: 258998272 kB\n'] 2021-02-19 03:11:43,956 | test | DEBUG | MainThread | [basetestcase:_initialize_nodes:591] 172.23.110.65: ['MemTotal: 263708656 kB\n', 'MemFree: 258307556 kB\n', 'MemAvailable: 261405636 kB\n', 'Buffers: 2320 kB\n', 'Cached: 3655384 kB\n', 'SwapCached: 0 kB\n', 'Active: 1670852 kB\n', 'Inactive: 2429536 kB\n', 'Active(anon): 443000 kB\n', 'Inactive(anon): 9576 kB\n', 'Active(file): 1227852 kB\n', 'Inactive(file): 2419960 kB\n', 'Unevictable: 0 kB\n', 'Mlocked: 0 kB\n', 'SwapTotal: 4194300 kB\n', 'SwapFree: 4194300 kB\n', 'Dirty: 96 kB\n', 'Writeback: 0 kB\n', 'AnonPages: 441580 kB\n', 'Mapped: 143808 kB\n', 'Shmem: 9892 kB\n', 'Slab: 569340 kB\n', 'SReclaimable: 334368 kB\n', 'SUnreclaim: 234972 kB\n', 'KernelStack: 32912 kB\n', 'PageTables: 14532 kB\n', 'NFS_Unstable: 0 kB\n', 'Bounce: 0 kB\n', 'WritebackTmp: 0 kB\n', 'CommitLimit: 136048628 kB\n', 'Committed_AS: 3704368 kB\n', 'VmallocTotal: 34359738367 kB\n', 'VmallocUsed: 0 kB\n', 'VmallocChunk: 0 kB\n', 'HardwareCorrupted: 0 kB\n', 'AnonHugePages: 6144 kB\n', 'HugePages_Total: 0\n', 'HugePages_Free: 0\n', 'HugePages_Rsvd: 0\n', 'HugePages_Surp: 0\n', 'Hugepagesize: 2048 kB\n', 'DirectMap4k: 365568 kB\n', 'DirectMap2M: 10778624 kB\n', 'DirectMap1G: 258998272 kB\n'] 2021-02-19 03:11:44,233 | test | DEBUG | MainThread | [basetestcase:_initialize_nodes:591] 172.23.110.66: ['MemTotal: 263708656 kB\n', 'MemFree: 258796776 kB\n', 'MemAvailable: 261458576 kB\n', 'Buffers: 2320 kB\n', 'Cached: 3361588 kB\n', 'SwapCached: 0 kB\n', 'Active: 1550000 kB\n', 'Inactive: 2272216 kB\n', 'Active(anon): 458608 kB\n', 'Inactive(anon): 9560 kB\n', 'Active(file): 1091392 kB\n', 'Inactive(file): 2262656 kB\n', 'Unevictable: 0 kB\n', 'Mlocked: 0 kB\n', 'SwapTotal: 4194300 kB\n', 'SwapFree: 4194300 kB\n', 'Dirty: 348 kB\n', 'Writeback: 0 kB\n', 'AnonPages: 458836 kB\n', 'Mapped: 145264 kB\n', 'Shmem: 9836 kB\n', 'Slab: 358652 kB\n', 'SReclaimable: 158456 kB\n', 'SUnreclaim: 200196 kB\n', 'KernelStack: 32368 kB\n', 'PageTables: 13308 kB\n', 'NFS_Unstable: 0 kB\n', 'Bounce: 0 kB\n', 'WritebackTmp: 0 kB\n', 'CommitLimit: 136048628 kB\n', 'Committed_AS: 3619216 kB\n', 'VmallocTotal: 34359738367 kB\n', 'VmallocUsed: 0 kB\n', 'VmallocChunk: 0 kB\n', 'HardwareCorrupted: 0 kB\n', 'AnonHugePages: 10240 kB\n', 'HugePages_Total: 0\n', 'HugePages_Free: 0\n', 'HugePages_Rsvd: 0\n', 'HugePages_Surp: 0\n', 'Hugepagesize: 2048 kB\n', 'DirectMap4k: 279552 kB\n', 'DirectMap2M: 5621760 kB\n', 'DirectMap1G: 264241152 kB\n'] 2021-02-19 03:11:44,513 | test | DEBUG | MainThread | [basetestcase:_initialize_nodes:591] 172.23.110.67: ['MemTotal: 263708656 kB\n', 'MemFree: 258804456 kB\n', 'MemAvailable: 261465256 kB\n', 'Buffers: 2320 kB\n', 'Cached: 3360460 kB\n', 'SwapCached: 0 kB\n', 'Active: 1544244 kB\n', 'Inactive: 2270628 kB\n', 'Active(anon): 452424 kB\n', 'Inactive(anon): 9576 kB\n', 'Active(file): 1091820 kB\n', 'Inactive(file): 2261052 kB\n', 'Unevictable: 0 kB\n', 'Mlocked: 0 kB\n', 'SwapTotal: 4194300 kB\n', 'SwapFree: 4194300 kB\n', 'Dirty: 1072 kB\n', 'Writeback: 0 kB\n', 'AnonPages: 453304 kB\n', 'Mapped: 144648 kB\n', 'Shmem: 9892 kB\n', 'Slab: 359128 kB\n', 'SReclaimable: 158808 kB\n', 'SUnreclaim: 200320 kB\n', 'KernelStack: 32720 kB\n', 'PageTables: 14596 kB\n', 'NFS_Unstable: 0 kB\n', 'Bounce: 0 kB\n', 'WritebackTmp: 0 kB\n', 'CommitLimit: 136048628 kB\n', 'Committed_AS: 3594008 kB\n', 'VmallocTotal: 34359738367 kB\n', 'VmallocUsed: 0 kB\n', 'VmallocChunk: 0 kB\n', 'HardwareCorrupted: 0 kB\n', 'AnonHugePages: 14336 kB\n', 'HugePages_Total: 0\n', 'HugePages_Free: 0\n', 'HugePages_Rsvd: 0\n', 'HugePages_Surp: 0\n', 'Hugepagesize: 2048 kB\n', 'DirectMap4k: 293888 kB\n', 'DirectMap2M: 4558848 kB\n', 'DirectMap1G: 265289728 kB\n'] 2021-02-19 03:11:44,802 | test | DEBUG | MainThread | [basetestcase:_initialize_nodes:591] 172.23.110.68: ['MemTotal: 263708656 kB\n', 'MemFree: 258771868 kB\n', 'MemAvailable: 261455592 kB\n', 'Buffers: 2320 kB\n', 'Cached: 3383044 kB\n', 'SwapCached: 0 kB\n', 'Active: 1562908 kB\n', 'Inactive: 2276344 kB\n', 'Active(anon): 454264 kB\n', 'Inactive(anon): 9576 kB\n', 'Active(file): 1108644 kB\n', 'Inactive(file): 2266768 kB\n', 'Unevictable: 0 kB\n', 'Mlocked: 0 kB\n', 'SwapTotal: 4194300 kB\n', 'SwapFree: 4194300 kB\n', 'Dirty: 676 kB\n', 'Writeback: 0 kB\n', 'AnonPages: 454028 kB\n', 'Mapped: 147624 kB\n', 'Shmem: 9924 kB\n', 'Slab: 360908 kB\n', 'SReclaimable: 159576 kB\n', 'SUnreclaim: 201332 kB\n', 'KernelStack: 32496 kB\n', 'PageTables: 13848 kB\n', 'NFS_Unstable: 0 kB\n', 'Bounce: 0 kB\n', 'WritebackTmp: 0 kB\n', 'CommitLimit: 136048628 kB\n', 'Committed_AS: 3701852 kB\n', 'VmallocTotal: 34359738367 kB\n', 'VmallocUsed: 0 kB\n', 'VmallocChunk: 0 kB\n', 'HardwareCorrupted: 0 kB\n', 'AnonHugePages: 10240 kB\n', 'HugePages_Total: 0\n', 'HugePages_Free: 0\n', 'HugePages_Rsvd: 0\n', 'HugePages_Surp: 0\n', 'Hugepagesize: 2048 kB\n', 'DirectMap4k: 283648 kB\n', 'DirectMap2M: 3520512 kB\n', 'DirectMap1G: 266338304 kB\n'] 2021-02-19 03:11:45,082 | test | DEBUG | MainThread | [basetestcase:_initialize_nodes:591] 172.23.110.69: ['MemTotal: 263708656 kB\n', 'MemFree: 258358816 kB\n', 'MemAvailable: 261413700 kB\n', 'Buffers: 2320 kB\n', 'Cached: 3643620 kB\n', 'SwapCached: 0 kB\n', 'Active: 1694636 kB\n', 'Inactive: 2397856 kB\n', 'Active(anon): 446884 kB\n', 'Inactive(anon): 9576 kB\n', 'Active(file): 1247752 kB\n', 'Inactive(file): 2388280 kB\n', 'Unevictable: 0 kB\n', 'Mlocked: 0 kB\n', 'SwapTotal: 4194300 kB\n', 'SwapFree: 4194300 kB\n', 'Dirty: 532 kB\n', 'Writeback: 0 kB\n', 'AnonPages: 447032 kB\n', 'Mapped: 145100 kB\n', 'Shmem: 9892 kB\n', 'Slab: 530540 kB\n', 'SReclaimable: 302952 kB\n', 'SUnreclaim: 227588 kB\n', 'KernelStack: 32944 kB\n', 'PageTables: 13408 kB\n', 'NFS_Unstable: 0 kB\n', 'Bounce: 0 kB\n', 'WritebackTmp: 0 kB\n', 'CommitLimit: 136048628 kB\n', 'Committed_AS: 3670352 kB\n', 'VmallocTotal: 34359738367 kB\n', 'VmallocUsed: 0 kB\n', 'VmallocChunk: 0 kB\n', 'HardwareCorrupted: 0 kB\n', 'AnonHugePages: 8192 kB\n', 'HugePages_Total: 0\n', 'HugePages_Free: 0\n', 'HugePages_Rsvd: 0\n', 'HugePages_Surp: 0\n', 'Hugepagesize: 2048 kB\n', 'DirectMap4k: 343040 kB\n', 'DirectMap2M: 8704000 kB\n', 'DirectMap1G: 261095424 kB\n'] 2021-02-19 03:11:45,351 | test | DEBUG | MainThread | [basetestcase:_initialize_nodes:591] 172.23.110.70: ['MemTotal: 263708656 kB\n', 'MemFree: 258793820 kB\n', 'MemAvailable: 261454516 kB\n', 'Buffers: 2320 kB\n', 'Cached: 3360536 kB\n', 'SwapCached: 0 kB\n', 'Active: 1559196 kB\n', 'Inactive: 2270788 kB\n', 'Active(anon): 467464 kB\n', 'Inactive(anon): 9576 kB\n', 'Active(file): 1091732 kB\n', 'Inactive(file): 2261212 kB\n', 'Unevictable: 0 kB\n', 'Mlocked: 0 kB\n', 'SwapTotal: 4194300 kB\n', 'SwapFree: 4194300 kB\n', 'Dirty: 676 kB\n', 'Writeback: 0 kB\n', 'AnonPages: 467620 kB\n', 'Mapped: 143956 kB\n', 'Shmem: 9892 kB\n', 'Slab: 357120 kB\n', 'SReclaimable: 158456 kB\n', 'SUnreclaim: 198664 kB\n', 'KernelStack: 32400 kB\n', 'PageTables: 14232 kB\n', 'NFS_Unstable: 0 kB\n', 'Bounce: 0 kB\n', 'WritebackTmp: 0 kB\n', 'CommitLimit: 136048628 kB\n', 'Committed_AS: 3692108 kB\n', 'VmallocTotal: 34359738367 kB\n', 'VmallocUsed: 0 kB\n', 'VmallocChunk: 0 kB\n', 'HardwareCorrupted: 0 kB\n', 'AnonHugePages: 14336 kB\n', 'HugePages_Total: 0\n', 'HugePages_Free: 0\n', 'HugePages_Rsvd: 0\n', 'HugePages_Surp: 0\n', 'Hugepagesize: 2048 kB\n', 'DirectMap4k: 285696 kB\n', 'DirectMap2M: 4567040 kB\n', 'DirectMap1G: 265289728 kB\n'] 2021-02-19 03:11:45,625 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:291] Current vBuckets on node ip:172.23.110.64 port:8091 ssh_username:root: [] 2021-02-19 03:11:45,625 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:308] ========= CHANGED ENVIRONMENT SETTING =========== 2021-02-19 03:11:45,931 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:291] Current vBuckets on node ip:172.23.110.65 port:8091 ssh_username:root: [] 2021-02-19 03:11:45,931 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:308] ========= CHANGED ENVIRONMENT SETTING =========== 2021-02-19 03:11:46,220 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:291] Current vBuckets on node ip:172.23.110.66 port:8091 ssh_username:root: [] 2021-02-19 03:11:46,220 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:308] ========= CHANGED ENVIRONMENT SETTING =========== 2021-02-19 03:11:46,505 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:291] Current vBuckets on node ip:172.23.110.67 port:8091 ssh_username:root: [] 2021-02-19 03:11:46,505 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:308] ========= CHANGED ENVIRONMENT SETTING =========== 2021-02-19 03:11:46,802 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:291] Current vBuckets on node ip:172.23.110.68 port:8091 ssh_username:root: [] 2021-02-19 03:11:46,802 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:308] ========= CHANGED ENVIRONMENT SETTING =========== 2021-02-19 03:11:47,076 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:291] Current vBuckets on node ip:172.23.110.69 port:8091 ssh_username:root: [] 2021-02-19 03:11:47,076 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:308] ========= CHANGED ENVIRONMENT SETTING =========== 2021-02-19 03:11:47,355 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:291] Current vBuckets on node ip:172.23.110.70 port:8091 ssh_username:root: [] 2021-02-19 03:11:47,357 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:308] ========= CHANGED ENVIRONMENT SETTING =========== 2021-02-19 03:11:47,357 | test | DEBUG | MainThread | [cluster_ready_functions:change_env_variables:310] Wait for all the services to come up after change_env_vars update 2021-02-19 03:11:57,365 | test | INFO | MainThread | [basetestcase:setUp:340] Couchbase Cluster: C1, Nodes: 172.23.110.64, 172.23.110.65, 172.23.110.66, 172.23.110.67, 172.23.110.68, 172.23.110.69, 172.23.110.70 initialized 2021-02-19 03:11:57,377 | test | INFO | MainThread | [basetestcase:log_setup_status:540] ========= BaseTestCase setup finished for test #1 SystemTestMagma ========= Total Doc-Tasks workers = 64 Total Doc-Tasks = 1001 2021-02-19 03:11:57,398 | infra | INFO | MainThread | [task_manager:__init__:14] Initiating TaskManager with 64 threads ############################################################ # # Step 1: Create a 2 node cluster # ############################################################ 2021-02-19 03:11:57,433 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[172.23.110.65]_OUT=[]_1613733117.41 2021-02-19 03:11:57,434 | infra | INFO | pool-1-thread-8 | [task:start_task:84] Thread 'Rebalance_task_IN=[172.23.110.65]_OUT=[]_1613733117.41' started 2021-02-19 03:11:57,436 | test | DEBUG | pool-1-thread-8 | [rest_client:add_node:1103] Adding remote node 172.23.110.65:8091 to cluster 172.23.110.64:8091 2021-02-19 03:11:59,522 | test | DEBUG | pool-1-thread-8 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.65', 'ejectedNodes': '', 'user': 'Administrator'} 2021-02-19 03:11:59,555 | test | DEBUG | pool-1-thread-8 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 03:11:59,555 | test | INFO | pool-1-thread-8 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+-----------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+-----------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 0.0861218763457 | Cluster node | | 172.23.110.65 | None | | | <--- IN --- | +---------------+----------+-----------------------+-----------------+--------------+ 2021-02-19 03:11:59,566 | test | DEBUG | pool-1-thread-8 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 03:11:59,566 | test | INFO | pool-1-thread-8 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 03:12:09,604 | test | INFO | pool-1-thread-8 | [task:check:330] Rebalance - status: none, progress: 100 2021-02-19 03:12:09,619 | test | INFO | pool-1-thread-8 | [task:check:389] Rebalance completed with progress: 100% in 10.0649998188 sec 2021-02-19 03:12:09,621 | infra | INFO | pool-1-thread-8 | [task:complete_task:99] Thread 'Rebalance_task_IN=[172.23.110.65]_OUT=[]_1613733117.41' completed 2021-02-19 03:12:09,637 | test | INFO | MainThread | [rest_client:set_metadata_purge_interval:1996] Successfully set Metadata Purge Interval to 0.04 ############################################################ # # Step 2: Create required buckets and collections. # ############################################################ 2021-02-19 03:12:09,638 | test | INFO | MainThread | [Magma:create_required_buckets:207] Get the available memory quota 2021-02-19 03:12:09,651 | test | INFO | MainThread | [Magma:create_required_buckets:214] Create CB buckets 2021-02-19 03:12:09,651 | test | DEBUG | MainThread | [bucket_ready_functions:async_create_bucket:1458] Creating bucket: GleamBookUsers0 2021-02-19 03:12:09,651 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: bucket_GleamBookUsers0_create_task 2021-02-19 03:12:09,786 | infra | INFO | pool-1-thread-9 | [BucketOperations_Rest:create_bucket:340] Creating 'membase' bucket GleamBookUsers0 2021-02-19 03:12:09,819 | infra | INFO | pool-1-thread-9 | [task:complete_task:99] Thread 'bucket_GleamBookUsers0_create_task' completed 2021-02-19 03:12:09,819 | test | DEBUG | MainThread | [bucket_ready_functions:create_bucket:1470] Wait for memcached to accept cbstats or any other bucket request connections 2021-02-19 03:12:09,834 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> create_bucket():L1472 2021-02-19 03:12:09,834 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-02-19 03:12:11,882 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:582] All nodes in cluster: [ip:172.23.110.64 port:8091 ssh_username:root, ip:172.23.110.65 port:8091 ssh_username:root] 2021-02-19 03:12:11,882 | test | DEBUG | MainThread | [bucket_ready_functions:async_create_bucket:1458] Creating bucket: GleamBookUsers1 2021-02-19 03:12:11,884 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: bucket_GleamBookUsers1_create_task 2021-02-19 03:12:11,948 | infra | INFO | pool-1-thread-10 | [BucketOperations_Rest:create_bucket:340] Creating 'membase' bucket GleamBookUsers1 2021-02-19 03:12:11,983 | infra | INFO | pool-1-thread-10 | [task:complete_task:99] Thread 'bucket_GleamBookUsers1_create_task' completed 2021-02-19 03:12:11,983 | test | DEBUG | MainThread | [bucket_ready_functions:create_bucket:1470] Wait for memcached to accept cbstats or any other bucket request connections 2021-02-19 03:12:11,990 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> create_bucket():L1472 2021-02-19 03:12:11,990 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-02-19 03:12:14,038 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:582] All nodes in cluster: [ip:172.23.110.64 port:8091 ssh_username:root, ip:172.23.110.65 port:8091 ssh_username:root] 2021-02-19 03:12:14,038 | test | DEBUG | MainThread | [bucket_ready_functions:async_create_bucket:1458] Creating bucket: GleamBookUsers2 2021-02-19 03:12:14,039 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: bucket_GleamBookUsers2_create_task 2021-02-19 03:12:14,105 | infra | INFO | pool-1-thread-11 | [BucketOperations_Rest:create_bucket:340] Creating 'membase' bucket GleamBookUsers2 2021-02-19 03:12:14,138 | infra | INFO | pool-1-thread-11 | [task:complete_task:99] Thread 'bucket_GleamBookUsers2_create_task' completed 2021-02-19 03:12:14,138 | test | DEBUG | MainThread | [bucket_ready_functions:create_bucket:1470] Wait for memcached to accept cbstats or any other bucket request connections 2021-02-19 03:12:14,147 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> create_bucket():L1472 2021-02-19 03:12:14,148 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-02-19 03:12:16,197 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:582] All nodes in cluster: [ip:172.23.110.64 port:8091 ssh_username:root, ip:172.23.110.65 port:8091 ssh_username:root] 2021-02-19 03:12:16,197 | test | DEBUG | MainThread | [bucket_ready_functions:async_create_bucket:1458] Creating bucket: GleamBookUsers3 2021-02-19 03:12:16,198 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: bucket_GleamBookUsers3_create_task 2021-02-19 03:12:16,263 | infra | INFO | pool-1-thread-12 | [BucketOperations_Rest:create_bucket:340] Creating 'membase' bucket GleamBookUsers3 2021-02-19 03:12:16,298 | infra | INFO | pool-1-thread-12 | [task:complete_task:99] Thread 'bucket_GleamBookUsers3_create_task' completed 2021-02-19 03:12:16,298 | test | DEBUG | MainThread | [bucket_ready_functions:create_bucket:1470] Wait for memcached to accept cbstats or any other bucket request connections 2021-02-19 03:12:16,305 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> create_bucket():L1472 2021-02-19 03:12:16,305 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-02-19 03:12:18,354 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:582] All nodes in cluster: [ip:172.23.110.64 port:8091 ssh_username:root, ip:172.23.110.65 port:8091 ssh_username:root] 2021-02-19 03:12:18,355 | test | DEBUG | MainThread | [bucket_ready_functions:async_create_bucket:1458] Creating bucket: GleamBookUsers4 2021-02-19 03:12:18,355 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: bucket_GleamBookUsers4_create_task 2021-02-19 03:12:18,427 | infra | INFO | pool-1-thread-13 | [BucketOperations_Rest:create_bucket:340] Creating 'membase' bucket GleamBookUsers4 2021-02-19 03:12:18,461 | infra | INFO | pool-1-thread-13 | [task:complete_task:99] Thread 'bucket_GleamBookUsers4_create_task' completed 2021-02-19 03:12:18,461 | test | DEBUG | MainThread | [bucket_ready_functions:create_bucket:1470] Wait for memcached to accept cbstats or any other bucket request connections 2021-02-19 03:12:18,469 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> create_bucket():L1472 2021-02-19 03:12:18,470 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-02-19 03:12:20,523 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:582] All nodes in cluster: [ip:172.23.110.64 port:8091 ssh_username:root, ip:172.23.110.65 port:8091 ssh_username:root] 2021-02-19 03:12:20,523 | test | DEBUG | MainThread | [bucket_ready_functions:async_create_bucket:1458] Creating bucket: GleamBookUsers5 2021-02-19 03:12:20,526 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: bucket_GleamBookUsers5_create_task 2021-02-19 03:12:20,591 | infra | INFO | pool-1-thread-14 | [BucketOperations_Rest:create_bucket:340] Creating 'membase' bucket GleamBookUsers5 2021-02-19 03:12:20,625 | infra | INFO | pool-1-thread-14 | [task:complete_task:99] Thread 'bucket_GleamBookUsers5_create_task' completed 2021-02-19 03:12:20,625 | test | DEBUG | MainThread | [bucket_ready_functions:create_bucket:1470] Wait for memcached to accept cbstats or any other bucket request connections 2021-02-19 03:12:20,635 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> create_bucket():L1472 2021-02-19 03:12:20,635 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-02-19 03:12:22,690 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:582] All nodes in cluster: [ip:172.23.110.64 port:8091 ssh_username:root, ip:172.23.110.65 port:8091 ssh_username:root] 2021-02-19 03:12:22,691 | test | DEBUG | MainThread | [bucket_ready_functions:async_create_bucket:1458] Creating bucket: GleamBookUsers6 2021-02-19 03:12:22,691 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: bucket_GleamBookUsers6_create_task 2021-02-19 03:12:22,759 | infra | INFO | pool-1-thread-15 | [BucketOperations_Rest:create_bucket:340] Creating 'membase' bucket GleamBookUsers6 2021-02-19 03:12:22,795 | infra | INFO | pool-1-thread-15 | [task:complete_task:99] Thread 'bucket_GleamBookUsers6_create_task' completed 2021-02-19 03:12:22,795 | test | DEBUG | MainThread | [bucket_ready_functions:create_bucket:1470] Wait for memcached to accept cbstats or any other bucket request connections 2021-02-19 03:12:22,802 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> create_bucket():L1472 2021-02-19 03:12:22,802 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-02-19 03:12:24,859 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:582] All nodes in cluster: [ip:172.23.110.64 port:8091 ssh_username:root, ip:172.23.110.65 port:8091 ssh_username:root] 2021-02-19 03:12:24,859 | test | DEBUG | MainThread | [bucket_ready_functions:async_create_bucket:1458] Creating bucket: GleamBookUsers7 2021-02-19 03:12:24,861 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: bucket_GleamBookUsers7_create_task 2021-02-19 03:12:24,930 | infra | INFO | pool-1-thread-16 | [BucketOperations_Rest:create_bucket:340] Creating 'membase' bucket GleamBookUsers7 2021-02-19 03:12:24,966 | infra | INFO | pool-1-thread-16 | [task:complete_task:99] Thread 'bucket_GleamBookUsers7_create_task' completed 2021-02-19 03:12:24,966 | test | DEBUG | MainThread | [bucket_ready_functions:create_bucket:1470] Wait for memcached to accept cbstats or any other bucket request connections 2021-02-19 03:12:24,973 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> create_bucket():L1472 2021-02-19 03:12:24,973 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-02-19 03:12:27,026 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:582] All nodes in cluster: [ip:172.23.110.64 port:8091 ssh_username:root, ip:172.23.110.65 port:8091 ssh_username:root] 2021-02-19 03:12:27,028 | test | DEBUG | MainThread | [bucket_ready_functions:async_create_bucket:1458] Creating bucket: GleamBookUsers8 2021-02-19 03:12:27,029 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: bucket_GleamBookUsers8_create_task 2021-02-19 03:12:27,096 | infra | INFO | pool-1-thread-17 | [BucketOperations_Rest:create_bucket:340] Creating 'membase' bucket GleamBookUsers8 2021-02-19 03:12:27,131 | infra | INFO | pool-1-thread-17 | [task:complete_task:99] Thread 'bucket_GleamBookUsers8_create_task' completed 2021-02-19 03:12:27,131 | test | DEBUG | MainThread | [bucket_ready_functions:create_bucket:1470] Wait for memcached to accept cbstats or any other bucket request connections 2021-02-19 03:12:27,138 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> create_bucket():L1472 2021-02-19 03:12:27,138 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-02-19 03:12:29,194 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:582] All nodes in cluster: [ip:172.23.110.64 port:8091 ssh_username:root, ip:172.23.110.65 port:8091 ssh_username:root] 2021-02-19 03:12:29,196 | test | DEBUG | MainThread | [bucket_ready_functions:async_create_bucket:1458] Creating bucket: GleamBookUsers9 2021-02-19 03:12:29,197 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: bucket_GleamBookUsers9_create_task 2021-02-19 03:12:29,299 | infra | INFO | pool-1-thread-18 | [BucketOperations_Rest:create_bucket:340] Creating 'membase' bucket GleamBookUsers9 2021-02-19 03:12:29,335 | infra | INFO | pool-1-thread-18 | [task:complete_task:99] Thread 'bucket_GleamBookUsers9_create_task' completed 2021-02-19 03:12:29,335 | test | DEBUG | MainThread | [bucket_ready_functions:create_bucket:1470] Wait for memcached to accept cbstats or any other bucket request connections 2021-02-19 03:12:29,342 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> create_bucket():L1472 2021-02-19 03:12:29,342 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 2 seconds. Reason: None 2021-02-19 03:12:31,398 | test | DEBUG | MainThread | [cluster_ready_functions:get_nodes_from_services_map:582] All nodes in cluster: [ip:172.23.110.64 port:8091 ssh_username:root, ip:172.23.110.65 port:8091 ssh_username:root] 2021-02-19 03:12:31,400 | test | INFO | MainThread | [Magma:create_required_buckets:235] Rebalance Starts 2021-02-19 03:12:31,423 | test | DEBUG | MainThread | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.65', 'ejectedNodes': '', 'user': 'Administrator'} 2021-02-19 03:12:31,454 | test | DEBUG | MainThread | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 03:12:31,463 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 03:12:42,516 | test | INFO | MainThread | [rest_client:monitorRebalance:1448] Rebalance done. Taken 11.0590000153 seconds to complete 2021-02-19 03:12:42,522 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> monitorRebalance():L1451 2021-02-19 03:12:42,523 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 5 seconds. Reason: Wait after rebalance complete 2021-02-19 03:12:49,792 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope0 2021-02-19 03:12:49,792 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers0:VolumeScope0 2021-02-19 03:12:49,844 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:49,844 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:50,345 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope1 2021-02-19 03:12:50,345 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers0:VolumeScope1 2021-02-19 03:12:50,394 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:50,395 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:50,895 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope2 2021-02-19 03:12:50,895 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers0:VolumeScope2 2021-02-19 03:12:50,947 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:50,947 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:51,447 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope3 2021-02-19 03:12:51,447 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers0:VolumeScope3 2021-02-19 03:12:51,497 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:51,497 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:51,999 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope4 2021-02-19 03:12:51,999 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers0:VolumeScope4 2021-02-19 03:12:52,051 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:52,052 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:52,552 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope0 2021-02-19 03:12:52,552 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers1:VolumeScope0 2021-02-19 03:12:52,602 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:52,604 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:53,104 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope1 2021-02-19 03:12:53,104 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers1:VolumeScope1 2021-02-19 03:12:53,154 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:53,154 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:53,654 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope2 2021-02-19 03:12:53,654 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers1:VolumeScope2 2021-02-19 03:12:53,703 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:53,703 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:54,203 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope3 2021-02-19 03:12:54,204 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers1:VolumeScope3 2021-02-19 03:12:54,255 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:54,255 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:54,755 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope4 2021-02-19 03:12:54,756 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers1:VolumeScope4 2021-02-19 03:12:54,805 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:54,805 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:55,305 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope0 2021-02-19 03:12:55,306 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers2:VolumeScope0 2021-02-19 03:12:55,357 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:55,357 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:55,858 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope1 2021-02-19 03:12:55,858 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers2:VolumeScope1 2021-02-19 03:12:55,910 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:55,910 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:56,411 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope2 2021-02-19 03:12:56,411 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers2:VolumeScope2 2021-02-19 03:12:56,464 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:56,464 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:56,964 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope3 2021-02-19 03:12:56,966 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers2:VolumeScope3 2021-02-19 03:12:57,015 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:57,015 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:57,515 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope4 2021-02-19 03:12:57,516 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers2:VolumeScope4 2021-02-19 03:12:57,566 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:57,566 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:58,066 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope0 2021-02-19 03:12:58,068 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers3:VolumeScope0 2021-02-19 03:12:58,118 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:58,118 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:58,618 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope1 2021-02-19 03:12:58,618 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers3:VolumeScope1 2021-02-19 03:12:58,671 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:58,671 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:59,171 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope2 2021-02-19 03:12:59,171 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers3:VolumeScope2 2021-02-19 03:12:59,221 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:59,221 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:12:59,723 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope3 2021-02-19 03:12:59,723 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers3:VolumeScope3 2021-02-19 03:12:59,775 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:12:59,775 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:00,275 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope4 2021-02-19 03:13:00,276 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers3:VolumeScope4 2021-02-19 03:13:00,325 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:00,325 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:00,826 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope0 2021-02-19 03:13:00,826 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers4:VolumeScope0 2021-02-19 03:13:00,878 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:00,878 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:01,378 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope1 2021-02-19 03:13:01,378 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers4:VolumeScope1 2021-02-19 03:13:01,430 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:01,430 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:01,930 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope2 2021-02-19 03:13:01,930 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers4:VolumeScope2 2021-02-19 03:13:01,980 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:01,982 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:02,482 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope3 2021-02-19 03:13:02,482 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers4:VolumeScope3 2021-02-19 03:13:02,532 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:02,533 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:03,033 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope4 2021-02-19 03:13:03,033 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers4:VolumeScope4 2021-02-19 03:13:03,088 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:03,088 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:03,588 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope0 2021-02-19 03:13:03,588 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers5:VolumeScope0 2021-02-19 03:13:03,638 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:03,638 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:04,140 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope1 2021-02-19 03:13:04,140 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers5:VolumeScope1 2021-02-19 03:13:04,187 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:04,188 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:04,688 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope2 2021-02-19 03:13:04,688 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers5:VolumeScope2 2021-02-19 03:13:04,737 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:04,737 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:05,237 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope3 2021-02-19 03:13:05,237 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers5:VolumeScope3 2021-02-19 03:13:05,289 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:05,289 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:05,789 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope4 2021-02-19 03:13:05,789 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers5:VolumeScope4 2021-02-19 03:13:05,842 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:05,842 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:06,342 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope0 2021-02-19 03:13:06,342 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers6:VolumeScope0 2021-02-19 03:13:06,391 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:06,391 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:06,891 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope1 2021-02-19 03:13:06,891 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers6:VolumeScope1 2021-02-19 03:13:06,940 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:06,940 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:07,440 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope2 2021-02-19 03:13:07,440 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers6:VolumeScope2 2021-02-19 03:13:07,490 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:07,490 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:07,990 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope3 2021-02-19 03:13:07,992 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers6:VolumeScope3 2021-02-19 03:13:08,039 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:08,040 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:08,540 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope4 2021-02-19 03:13:08,540 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers6:VolumeScope4 2021-02-19 03:13:08,588 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:08,589 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:09,089 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope0 2021-02-19 03:13:09,089 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers7:VolumeScope0 2021-02-19 03:13:09,138 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:09,138 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:09,638 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope1 2021-02-19 03:13:09,638 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers7:VolumeScope1 2021-02-19 03:13:09,714 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:09,714 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:10,214 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope2 2021-02-19 03:13:10,216 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers7:VolumeScope2 2021-02-19 03:13:10,269 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:10,270 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:10,770 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope3 2021-02-19 03:13:10,772 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers7:VolumeScope3 2021-02-19 03:13:10,822 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:10,822 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:11,323 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope4 2021-02-19 03:13:11,323 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers7:VolumeScope4 2021-02-19 03:13:11,375 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:11,375 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:11,875 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope0 2021-02-19 03:13:11,875 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers8:VolumeScope0 2021-02-19 03:13:11,924 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:11,924 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:12,424 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope1 2021-02-19 03:13:12,424 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers8:VolumeScope1 2021-02-19 03:13:12,473 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:12,473 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:12,973 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope2 2021-02-19 03:13:12,974 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers8:VolumeScope2 2021-02-19 03:13:13,023 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:13,023 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:13,523 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope3 2021-02-19 03:13:13,523 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers8:VolumeScope3 2021-02-19 03:13:13,572 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:13,572 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:14,072 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope4 2021-02-19 03:13:14,072 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers8:VolumeScope4 2021-02-19 03:13:14,121 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:14,121 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:14,622 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope0 2021-02-19 03:13:14,622 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers9:VolumeScope0 2021-02-19 03:13:14,671 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:14,671 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:15,173 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope1 2021-02-19 03:13:15,173 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers9:VolumeScope1 2021-02-19 03:13:15,223 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:15,223 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:15,723 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope2 2021-02-19 03:13:15,723 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers9:VolumeScope2 2021-02-19 03:13:15,772 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:15,772 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:16,273 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope3 2021-02-19 03:13:16,273 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers9:VolumeScope3 2021-02-19 03:13:16,322 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:16,322 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:16,822 | test | INFO | MainThread | [Magma:setUp:157] Creating scope: VolumeScope4 2021-02-19 03:13:16,823 | test | DEBUG | MainThread | [bucket_ready_functions:create_scope:1092] Creating Scope GleamBookUsers9:VolumeScope4 2021-02-19 03:13:16,874 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L162 2021-02-19 03:13:16,874 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:17,374 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope2:VolumeCollection0 2021-02-19 03:13:17,424 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:17,424 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:17,924 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope2:VolumeCollection1 2021-02-19 03:13:17,971 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:17,971 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:18,473 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope2:VolumeCollection2 2021-02-19 03:13:18,522 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:18,523 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:19,023 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope2:VolumeCollection3 2021-02-19 03:13:19,072 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:19,072 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:19,575 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope2:VolumeCollection4 2021-02-19 03:13:19,625 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:19,625 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:20,125 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:_default:VolumeCollection0 2021-02-19 03:13:20,176 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:20,176 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:20,676 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:_default:VolumeCollection1 2021-02-19 03:13:20,724 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:20,726 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:21,226 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:_default:VolumeCollection2 2021-02-19 03:13:21,276 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:21,276 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:21,776 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:_default:VolumeCollection3 2021-02-19 03:13:21,826 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:21,826 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:22,326 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:_default:VolumeCollection4 2021-02-19 03:13:22,375 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:22,375 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:22,875 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope3:VolumeCollection0 2021-02-19 03:13:22,923 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:22,923 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:23,424 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope3:VolumeCollection1 2021-02-19 03:13:23,473 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:23,473 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:23,973 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope3:VolumeCollection2 2021-02-19 03:13:24,023 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:24,023 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:24,525 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope3:VolumeCollection3 2021-02-19 03:13:24,572 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:24,573 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:25,073 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope3:VolumeCollection4 2021-02-19 03:13:25,124 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:25,124 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:25,625 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope4:VolumeCollection0 2021-02-19 03:13:25,674 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:25,674 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:26,174 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope4:VolumeCollection1 2021-02-19 03:13:26,223 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:26,223 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:26,724 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope4:VolumeCollection2 2021-02-19 03:13:26,773 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:26,773 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:27,275 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope4:VolumeCollection3 2021-02-19 03:13:27,323 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:27,325 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:27,825 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope4:VolumeCollection4 2021-02-19 03:13:27,875 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:27,875 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:28,375 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope0:VolumeCollection0 2021-02-19 03:13:28,424 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:28,424 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:28,924 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope0:VolumeCollection1 2021-02-19 03:13:28,973 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:28,973 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:29,473 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope0:VolumeCollection2 2021-02-19 03:13:29,523 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:29,523 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:30,023 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope0:VolumeCollection3 2021-02-19 03:13:30,072 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:30,072 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:30,573 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope0:VolumeCollection4 2021-02-19 03:13:30,624 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:30,624 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:31,124 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope1:VolumeCollection0 2021-02-19 03:13:31,174 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:31,174 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:31,674 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope1:VolumeCollection1 2021-02-19 03:13:31,723 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:31,723 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:32,224 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope1:VolumeCollection2 2021-02-19 03:13:32,276 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:32,276 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:32,776 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope1:VolumeCollection3 2021-02-19 03:13:32,826 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:32,826 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:33,326 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers0:VolumeScope1:VolumeCollection4 2021-02-19 03:13:33,378 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:33,378 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:33,878 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope2:VolumeCollection0 2021-02-19 03:13:33,926 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:33,927 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:34,427 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope2:VolumeCollection1 2021-02-19 03:13:34,474 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:34,474 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:34,976 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope2:VolumeCollection2 2021-02-19 03:13:35,023 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:35,023 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:35,523 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope2:VolumeCollection3 2021-02-19 03:13:35,572 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:35,572 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:36,072 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope2:VolumeCollection4 2021-02-19 03:13:36,121 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:36,121 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:36,622 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:_default:VolumeCollection0 2021-02-19 03:13:36,680 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:36,680 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:37,180 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:_default:VolumeCollection1 2021-02-19 03:13:37,229 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:37,229 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:37,730 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:_default:VolumeCollection2 2021-02-19 03:13:37,778 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:37,778 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:38,279 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:_default:VolumeCollection3 2021-02-19 03:13:38,326 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:38,328 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:38,828 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:_default:VolumeCollection4 2021-02-19 03:13:38,875 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:38,875 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:39,377 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope3:VolumeCollection0 2021-02-19 03:13:39,424 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:39,424 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:39,926 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope3:VolumeCollection1 2021-02-19 03:13:39,974 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:39,976 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:40,476 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope3:VolumeCollection2 2021-02-19 03:13:40,549 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:40,549 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:41,051 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope3:VolumeCollection3 2021-02-19 03:13:41,101 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:41,101 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:41,601 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope3:VolumeCollection4 2021-02-19 03:13:41,650 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:41,651 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:42,151 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope4:VolumeCollection0 2021-02-19 03:13:42,200 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:42,200 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:42,700 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope4:VolumeCollection1 2021-02-19 03:13:42,749 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:42,750 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:43,250 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope4:VolumeCollection2 2021-02-19 03:13:43,299 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:43,299 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:43,799 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope4:VolumeCollection3 2021-02-19 03:13:43,848 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:43,848 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:44,349 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope4:VolumeCollection4 2021-02-19 03:13:44,398 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:44,398 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:44,898 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope0:VolumeCollection0 2021-02-19 03:13:44,950 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:44,950 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:45,450 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope0:VolumeCollection1 2021-02-19 03:13:45,500 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:45,500 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:46,000 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope0:VolumeCollection2 2021-02-19 03:13:46,051 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:46,052 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:46,552 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope0:VolumeCollection3 2021-02-19 03:13:46,602 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:46,602 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:47,102 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope0:VolumeCollection4 2021-02-19 03:13:47,151 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:47,153 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:47,653 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope1:VolumeCollection0 2021-02-19 03:13:47,701 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:47,701 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:48,201 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope1:VolumeCollection1 2021-02-19 03:13:48,250 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:48,250 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:48,750 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope1:VolumeCollection2 2021-02-19 03:13:48,799 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:48,799 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:49,299 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope1:VolumeCollection3 2021-02-19 03:13:49,348 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:49,348 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:49,848 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers1:VolumeScope1:VolumeCollection4 2021-02-19 03:13:49,901 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:49,901 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:50,401 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope2:VolumeCollection0 2021-02-19 03:13:50,450 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:50,450 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:50,950 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope2:VolumeCollection1 2021-02-19 03:13:51,000 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:51,002 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:51,502 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope2:VolumeCollection2 2021-02-19 03:13:51,551 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:51,552 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:52,052 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope2:VolumeCollection3 2021-02-19 03:13:52,099 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:52,101 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:52,601 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope2:VolumeCollection4 2021-02-19 03:13:52,648 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:52,650 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:53,150 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:_default:VolumeCollection0 2021-02-19 03:13:53,197 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:53,197 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:53,698 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:_default:VolumeCollection1 2021-02-19 03:13:53,747 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:53,747 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:54,247 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:_default:VolumeCollection2 2021-02-19 03:13:54,296 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:54,296 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:54,796 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:_default:VolumeCollection3 2021-02-19 03:13:54,848 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:54,848 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:55,348 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:_default:VolumeCollection4 2021-02-19 03:13:55,398 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:55,398 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:55,898 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope3:VolumeCollection0 2021-02-19 03:13:55,947 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:55,947 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:56,448 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope3:VolumeCollection1 2021-02-19 03:13:56,500 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:56,500 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:57,000 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope3:VolumeCollection2 2021-02-19 03:13:57,049 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:57,049 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:57,549 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope3:VolumeCollection3 2021-02-19 03:13:57,601 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:57,601 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:58,101 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope3:VolumeCollection4 2021-02-19 03:13:58,151 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:58,151 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:58,651 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope4:VolumeCollection0 2021-02-19 03:13:58,700 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:58,700 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:59,201 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope4:VolumeCollection1 2021-02-19 03:13:59,252 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:59,252 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:13:59,752 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope4:VolumeCollection2 2021-02-19 03:13:59,802 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:13:59,802 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:00,303 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope4:VolumeCollection3 2021-02-19 03:14:00,355 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:00,355 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:00,855 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope4:VolumeCollection4 2021-02-19 03:14:00,905 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:00,907 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:01,407 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope0:VolumeCollection0 2021-02-19 03:14:01,457 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:01,457 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:01,959 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope0:VolumeCollection1 2021-02-19 03:14:02,009 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:02,009 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:02,509 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope0:VolumeCollection2 2021-02-19 03:14:02,559 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:02,561 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:03,061 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope0:VolumeCollection3 2021-02-19 03:14:03,108 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:03,109 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:03,609 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope0:VolumeCollection4 2021-02-19 03:14:03,660 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:03,660 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:04,160 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope1:VolumeCollection0 2021-02-19 03:14:04,211 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:04,211 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:04,711 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope1:VolumeCollection1 2021-02-19 03:14:04,762 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:04,762 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:05,263 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope1:VolumeCollection2 2021-02-19 03:14:05,312 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:05,312 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:05,812 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope1:VolumeCollection3 2021-02-19 03:14:05,861 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:05,862 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:06,362 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers2:VolumeScope1:VolumeCollection4 2021-02-19 03:14:06,411 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:06,411 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:06,911 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope2:VolumeCollection0 2021-02-19 03:14:06,963 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:06,963 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:07,463 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope2:VolumeCollection1 2021-02-19 03:14:07,513 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:07,513 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:08,015 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope2:VolumeCollection2 2021-02-19 03:14:08,062 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:08,063 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:08,563 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope2:VolumeCollection3 2021-02-19 03:14:08,611 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:08,612 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:09,112 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope2:VolumeCollection4 2021-02-19 03:14:09,163 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:09,163 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:09,663 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:_default:VolumeCollection0 2021-02-19 03:14:09,734 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:09,736 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:10,236 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:_default:VolumeCollection1 2021-02-19 03:14:10,286 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:10,286 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:10,786 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:_default:VolumeCollection2 2021-02-19 03:14:10,835 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:10,835 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:11,335 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:_default:VolumeCollection3 2021-02-19 03:14:11,387 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:11,387 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:11,887 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:_default:VolumeCollection4 2021-02-19 03:14:11,940 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:11,940 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:12,440 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope3:VolumeCollection0 2021-02-19 03:14:12,492 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:12,492 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:12,992 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope3:VolumeCollection1 2021-02-19 03:14:13,042 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:13,042 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:13,542 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope3:VolumeCollection2 2021-02-19 03:14:13,592 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:13,592 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:14,092 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope3:VolumeCollection3 2021-02-19 03:14:14,147 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:14,148 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:14,648 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope3:VolumeCollection4 2021-02-19 03:14:14,697 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:14,697 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:15,197 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope4:VolumeCollection0 2021-02-19 03:14:15,249 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:15,249 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:15,749 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope4:VolumeCollection1 2021-02-19 03:14:15,798 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:15,799 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:16,299 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope4:VolumeCollection2 2021-02-19 03:14:16,351 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:16,351 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:16,851 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope4:VolumeCollection3 2021-02-19 03:14:16,901 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:16,901 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:17,401 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope4:VolumeCollection4 2021-02-19 03:14:17,451 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:17,451 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:17,951 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope0:VolumeCollection0 2021-02-19 03:14:18,003 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:18,003 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:18,503 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope0:VolumeCollection1 2021-02-19 03:14:18,552 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:18,553 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:19,053 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope0:VolumeCollection2 2021-02-19 03:14:19,102 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:19,104 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:19,604 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope0:VolumeCollection3 2021-02-19 03:14:19,654 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:19,654 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:20,154 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope0:VolumeCollection4 2021-02-19 03:14:20,203 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:20,203 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:20,703 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope1:VolumeCollection0 2021-02-19 03:14:20,753 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:20,753 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:21,253 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope1:VolumeCollection1 2021-02-19 03:14:21,305 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:21,305 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:21,805 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope1:VolumeCollection2 2021-02-19 03:14:21,855 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:21,855 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:22,357 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope1:VolumeCollection3 2021-02-19 03:14:22,408 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:22,408 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:22,908 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers3:VolumeScope1:VolumeCollection4 2021-02-19 03:14:22,960 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:22,960 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:23,460 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope2:VolumeCollection0 2021-02-19 03:14:23,509 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:23,509 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:24,009 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope2:VolumeCollection1 2021-02-19 03:14:24,059 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:24,059 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:24,559 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope2:VolumeCollection2 2021-02-19 03:14:24,608 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:24,609 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:25,109 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope2:VolumeCollection3 2021-02-19 03:14:25,158 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:25,158 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:25,660 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope2:VolumeCollection4 2021-02-19 03:14:25,710 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:25,710 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:26,210 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:_default:VolumeCollection0 2021-02-19 03:14:26,259 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:26,260 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:26,760 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:_default:VolumeCollection1 2021-02-19 03:14:26,809 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:26,809 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:27,309 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:_default:VolumeCollection2 2021-02-19 03:14:27,358 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:27,358 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:27,858 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:_default:VolumeCollection3 2021-02-19 03:14:27,908 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:27,908 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:28,408 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:_default:VolumeCollection4 2021-02-19 03:14:28,457 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:28,457 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:28,957 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope3:VolumeCollection0 2021-02-19 03:14:29,006 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:29,006 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:29,506 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope3:VolumeCollection1 2021-02-19 03:14:29,558 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:29,558 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:30,058 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope3:VolumeCollection2 2021-02-19 03:14:30,108 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:30,108 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:30,608 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope3:VolumeCollection3 2021-02-19 03:14:30,657 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:30,657 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:31,157 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope3:VolumeCollection4 2021-02-19 03:14:31,207 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:31,207 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:31,707 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope4:VolumeCollection0 2021-02-19 03:14:31,759 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:31,759 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:32,259 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope4:VolumeCollection1 2021-02-19 03:14:32,309 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:32,309 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:32,809 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope4:VolumeCollection2 2021-02-19 03:14:32,859 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:32,859 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:33,359 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope4:VolumeCollection3 2021-02-19 03:14:33,408 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:33,408 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:33,908 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope4:VolumeCollection4 2021-02-19 03:14:33,959 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:33,959 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:34,459 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope0:VolumeCollection0 2021-02-19 03:14:34,507 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:34,509 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:35,009 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope0:VolumeCollection1 2021-02-19 03:14:35,059 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:35,059 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:35,559 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope0:VolumeCollection2 2021-02-19 03:14:35,608 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:35,609 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:36,109 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope0:VolumeCollection3 2021-02-19 03:14:36,158 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:36,160 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:36,660 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope0:VolumeCollection4 2021-02-19 03:14:36,709 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:36,710 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:37,210 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope1:VolumeCollection0 2021-02-19 03:14:37,259 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:37,260 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:37,760 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope1:VolumeCollection1 2021-02-19 03:14:37,811 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:37,811 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:38,311 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope1:VolumeCollection2 2021-02-19 03:14:38,361 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:38,361 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:38,861 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope1:VolumeCollection3 2021-02-19 03:14:38,937 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:38,937 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:39,437 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers4:VolumeScope1:VolumeCollection4 2021-02-19 03:14:39,489 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:39,489 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:39,989 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope2:VolumeCollection0 2021-02-19 03:14:40,039 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:40,039 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:40,539 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope2:VolumeCollection1 2021-02-19 03:14:40,588 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:40,588 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:41,088 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope2:VolumeCollection2 2021-02-19 03:14:41,135 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:41,137 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:41,637 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope2:VolumeCollection3 2021-02-19 03:14:41,687 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:41,687 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:42,187 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope2:VolumeCollection4 2021-02-19 03:14:42,236 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:42,236 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:42,736 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:_default:VolumeCollection0 2021-02-19 03:14:42,789 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:42,789 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:43,289 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:_default:VolumeCollection1 2021-02-19 03:14:43,338 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:43,339 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:43,839 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:_default:VolumeCollection2 2021-02-19 03:14:43,890 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:43,891 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:44,391 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:_default:VolumeCollection3 2021-02-19 03:14:44,438 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:44,440 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:44,940 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:_default:VolumeCollection4 2021-02-19 03:14:44,990 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:44,992 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:45,492 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope3:VolumeCollection0 2021-02-19 03:14:45,542 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:45,542 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:46,042 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope3:VolumeCollection1 2021-02-19 03:14:46,092 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:46,092 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:46,594 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope3:VolumeCollection2 2021-02-19 03:14:46,644 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:46,644 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:47,144 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope3:VolumeCollection3 2021-02-19 03:14:47,196 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:47,196 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:47,696 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope3:VolumeCollection4 2021-02-19 03:14:47,744 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:47,746 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:48,246 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope4:VolumeCollection0 2021-02-19 03:14:48,296 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:48,296 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:48,796 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope4:VolumeCollection1 2021-02-19 03:14:48,845 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:48,845 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:49,345 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope4:VolumeCollection2 2021-02-19 03:14:49,394 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:49,394 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:49,894 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope4:VolumeCollection3 2021-02-19 03:14:49,946 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:49,946 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:50,446 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope4:VolumeCollection4 2021-02-19 03:14:50,496 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:50,496 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:50,996 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope0:VolumeCollection0 2021-02-19 03:14:51,048 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:51,048 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:51,548 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope0:VolumeCollection1 2021-02-19 03:14:51,596 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:51,598 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:52,098 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope0:VolumeCollection2 2021-02-19 03:14:52,150 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:52,150 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:52,650 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope0:VolumeCollection3 2021-02-19 03:14:52,700 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:52,700 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:53,200 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope0:VolumeCollection4 2021-02-19 03:14:53,250 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:53,250 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:53,750 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope1:VolumeCollection0 2021-02-19 03:14:53,799 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:53,801 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:54,301 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope1:VolumeCollection1 2021-02-19 03:14:54,351 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:54,351 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:54,851 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope1:VolumeCollection2 2021-02-19 03:14:54,903 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:54,904 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:55,404 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope1:VolumeCollection3 2021-02-19 03:14:55,453 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:55,453 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:55,953 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers5:VolumeScope1:VolumeCollection4 2021-02-19 03:14:56,005 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:56,005 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:56,506 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope2:VolumeCollection0 2021-02-19 03:14:56,555 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:56,555 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:57,055 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope2:VolumeCollection1 2021-02-19 03:14:57,105 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:57,107 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:57,607 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope2:VolumeCollection2 2021-02-19 03:14:57,657 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:57,657 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:58,157 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope2:VolumeCollection3 2021-02-19 03:14:58,206 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:58,207 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:58,707 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope2:VolumeCollection4 2021-02-19 03:14:58,756 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:58,756 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:59,256 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:_default:VolumeCollection0 2021-02-19 03:14:59,305 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:59,305 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:14:59,805 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:_default:VolumeCollection1 2021-02-19 03:14:59,855 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:14:59,855 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:00,355 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:_default:VolumeCollection2 2021-02-19 03:15:00,405 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:00,405 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:00,905 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:_default:VolumeCollection3 2021-02-19 03:15:00,956 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:00,956 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:01,456 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:_default:VolumeCollection4 2021-02-19 03:15:01,506 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:01,506 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:02,006 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope3:VolumeCollection0 2021-02-19 03:15:02,059 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:02,059 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:02,559 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope3:VolumeCollection1 2021-02-19 03:15:02,609 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:02,609 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:03,109 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope3:VolumeCollection2 2021-02-19 03:15:03,158 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:03,160 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:03,660 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope3:VolumeCollection3 2021-02-19 03:15:03,710 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:03,710 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:04,210 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope3:VolumeCollection4 2021-02-19 03:15:04,259 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:04,259 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:04,759 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope4:VolumeCollection0 2021-02-19 03:15:04,811 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:04,811 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:05,312 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope4:VolumeCollection1 2021-02-19 03:15:05,362 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:05,362 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:05,862 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope4:VolumeCollection2 2021-02-19 03:15:05,915 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:05,915 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:06,415 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope4:VolumeCollection3 2021-02-19 03:15:06,464 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:06,466 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:06,966 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope4:VolumeCollection4 2021-02-19 03:15:07,038 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:07,038 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:07,538 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope0:VolumeCollection0 2021-02-19 03:15:07,591 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:07,591 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:08,091 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope0:VolumeCollection1 2021-02-19 03:15:08,141 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:08,141 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:08,641 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope0:VolumeCollection2 2021-02-19 03:15:08,691 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:08,691 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:09,191 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope0:VolumeCollection3 2021-02-19 03:15:09,240 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:09,242 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:09,742 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope0:VolumeCollection4 2021-02-19 03:15:09,792 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:09,792 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:10,292 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope1:VolumeCollection0 2021-02-19 03:15:10,342 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:10,342 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:10,842 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope1:VolumeCollection1 2021-02-19 03:15:10,894 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:10,894 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:11,394 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope1:VolumeCollection2 2021-02-19 03:15:11,444 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:11,444 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:11,944 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope1:VolumeCollection3 2021-02-19 03:15:11,996 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:11,996 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:12,496 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers6:VolumeScope1:VolumeCollection4 2021-02-19 03:15:12,548 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:12,548 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:13,048 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope2:VolumeCollection0 2021-02-19 03:15:13,098 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:13,098 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:13,598 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope2:VolumeCollection1 2021-02-19 03:15:13,648 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:13,648 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:14,148 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope2:VolumeCollection2 2021-02-19 03:15:14,197 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:14,197 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:14,697 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope2:VolumeCollection3 2021-02-19 03:15:14,746 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:14,746 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:15,246 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope2:VolumeCollection4 2021-02-19 03:15:15,296 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:15,296 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:15,796 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:_default:VolumeCollection0 2021-02-19 03:15:15,845 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:15,845 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:16,345 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:_default:VolumeCollection1 2021-02-19 03:15:16,391 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:16,392 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:16,892 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:_default:VolumeCollection2 2021-02-19 03:15:16,943 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:16,943 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:17,443 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:_default:VolumeCollection3 2021-02-19 03:15:17,492 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:17,492 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:17,993 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:_default:VolumeCollection4 2021-02-19 03:15:18,042 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:18,042 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:18,542 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope3:VolumeCollection0 2021-02-19 03:15:18,592 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:18,592 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:19,094 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope3:VolumeCollection1 2021-02-19 03:15:19,142 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:19,142 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:19,644 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope3:VolumeCollection2 2021-02-19 03:15:19,693 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:19,693 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:20,193 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope3:VolumeCollection3 2021-02-19 03:15:20,243 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:20,243 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:20,743 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope3:VolumeCollection4 2021-02-19 03:15:20,792 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:20,792 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:21,292 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope4:VolumeCollection0 2021-02-19 03:15:21,341 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:21,342 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:21,842 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope4:VolumeCollection1 2021-02-19 03:15:21,891 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:21,891 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:22,391 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope4:VolumeCollection2 2021-02-19 03:15:22,443 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:22,444 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:22,944 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope4:VolumeCollection3 2021-02-19 03:15:22,993 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:22,993 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:23,494 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope4:VolumeCollection4 2021-02-19 03:15:23,543 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:23,543 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:24,043 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope0:VolumeCollection0 2021-02-19 03:15:24,095 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:24,095 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:24,595 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope0:VolumeCollection1 2021-02-19 03:15:24,644 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:24,644 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:25,144 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope0:VolumeCollection2 2021-02-19 03:15:25,194 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:25,194 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:25,694 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope0:VolumeCollection3 2021-02-19 03:15:25,743 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:25,743 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:26,243 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope0:VolumeCollection4 2021-02-19 03:15:26,293 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:26,293 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:26,793 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope1:VolumeCollection0 2021-02-19 03:15:26,848 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:26,848 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:27,348 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope1:VolumeCollection1 2021-02-19 03:15:27,398 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:27,398 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:27,898 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope1:VolumeCollection2 2021-02-19 03:15:27,950 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:27,950 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:28,450 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope1:VolumeCollection3 2021-02-19 03:15:28,500 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:28,500 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:29,002 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers7:VolumeScope1:VolumeCollection4 2021-02-19 03:15:29,052 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:29,052 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:29,552 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope2:VolumeCollection0 2021-02-19 03:15:29,602 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:29,602 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:30,104 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope2:VolumeCollection1 2021-02-19 03:15:30,153 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:30,153 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:30,653 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope2:VolumeCollection2 2021-02-19 03:15:30,701 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:30,701 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:31,201 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope2:VolumeCollection3 2021-02-19 03:15:31,250 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:31,250 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:31,752 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope2:VolumeCollection4 2021-02-19 03:15:31,801 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:31,801 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:32,301 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:_default:VolumeCollection0 2021-02-19 03:15:32,351 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:32,351 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:32,851 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:_default:VolumeCollection1 2021-02-19 03:15:32,901 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:32,901 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:33,401 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:_default:VolumeCollection2 2021-02-19 03:15:33,450 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:33,450 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:33,950 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:_default:VolumeCollection3 2021-02-19 03:15:33,999 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:33,999 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:34,499 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:_default:VolumeCollection4 2021-02-19 03:15:34,572 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:34,572 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:35,072 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope3:VolumeCollection0 2021-02-19 03:15:35,122 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:35,122 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:35,622 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope3:VolumeCollection1 2021-02-19 03:15:35,674 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:35,674 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:36,174 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope3:VolumeCollection2 2021-02-19 03:15:36,223 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:36,223 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:36,723 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope3:VolumeCollection3 2021-02-19 03:15:36,773 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:36,773 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:37,273 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope3:VolumeCollection4 2021-02-19 03:15:37,322 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:37,322 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:37,822 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope4:VolumeCollection0 2021-02-19 03:15:37,872 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:37,872 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:38,374 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope4:VolumeCollection1 2021-02-19 03:15:38,423 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:38,423 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:38,923 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope4:VolumeCollection2 2021-02-19 03:15:38,973 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:38,973 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:39,473 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope4:VolumeCollection3 2021-02-19 03:15:39,523 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:39,523 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:40,023 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope4:VolumeCollection4 2021-02-19 03:15:40,072 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:40,072 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:40,572 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope0:VolumeCollection0 2021-02-19 03:15:40,621 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:40,621 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:41,121 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope0:VolumeCollection1 2021-02-19 03:15:41,171 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:41,171 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:41,671 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope0:VolumeCollection2 2021-02-19 03:15:41,721 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:41,721 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:42,223 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope0:VolumeCollection3 2021-02-19 03:15:42,272 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:42,272 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:42,772 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope0:VolumeCollection4 2021-02-19 03:15:42,822 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:42,822 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:43,322 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope1:VolumeCollection0 2021-02-19 03:15:43,371 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:43,371 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:43,871 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope1:VolumeCollection1 2021-02-19 03:15:43,920 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:43,920 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:44,420 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope1:VolumeCollection2 2021-02-19 03:15:44,469 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:44,469 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:44,970 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope1:VolumeCollection3 2021-02-19 03:15:45,019 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:45,019 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:45,520 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers8:VolumeScope1:VolumeCollection4 2021-02-19 03:15:45,569 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:45,569 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:46,071 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope2:VolumeCollection0 2021-02-19 03:15:46,119 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:46,119 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:46,619 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope2:VolumeCollection1 2021-02-19 03:15:46,668 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:46,668 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:47,170 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope2:VolumeCollection2 2021-02-19 03:15:47,217 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:47,217 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:47,717 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope2:VolumeCollection3 2021-02-19 03:15:47,766 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:47,766 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:48,266 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope2:VolumeCollection4 2021-02-19 03:15:48,315 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:48,315 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:48,815 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:_default:VolumeCollection0 2021-02-19 03:15:48,865 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:48,865 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:49,365 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:_default:VolumeCollection1 2021-02-19 03:15:49,414 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:49,414 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:49,914 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:_default:VolumeCollection2 2021-02-19 03:15:49,963 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:49,963 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:50,463 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:_default:VolumeCollection3 2021-02-19 03:15:50,512 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:50,512 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:51,012 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:_default:VolumeCollection4 2021-02-19 03:15:51,062 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:51,062 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:51,562 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope3:VolumeCollection0 2021-02-19 03:15:51,611 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:51,611 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:52,112 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope3:VolumeCollection1 2021-02-19 03:15:52,161 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:52,161 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:52,661 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope3:VolumeCollection2 2021-02-19 03:15:52,711 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:52,711 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:53,211 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope3:VolumeCollection3 2021-02-19 03:15:53,260 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:53,260 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:53,760 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope3:VolumeCollection4 2021-02-19 03:15:53,809 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:53,809 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:54,309 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope4:VolumeCollection0 2021-02-19 03:15:54,359 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:54,359 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:54,861 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope4:VolumeCollection1 2021-02-19 03:15:54,910 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:54,910 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:55,410 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope4:VolumeCollection2 2021-02-19 03:15:55,459 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:55,459 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:55,959 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope4:VolumeCollection3 2021-02-19 03:15:56,007 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:56,007 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:56,507 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope4:VolumeCollection4 2021-02-19 03:15:56,556 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:56,556 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:57,056 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope0:VolumeCollection0 2021-02-19 03:15:57,105 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:57,107 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:57,607 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope0:VolumeCollection1 2021-02-19 03:15:57,657 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:57,657 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:58,157 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope0:VolumeCollection2 2021-02-19 03:15:58,207 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:58,207 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:58,707 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope0:VolumeCollection3 2021-02-19 03:15:58,756 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:58,757 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:59,257 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope0:VolumeCollection4 2021-02-19 03:15:59,306 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:59,306 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:15:59,806 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope1:VolumeCollection0 2021-02-19 03:15:59,855 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:15:59,855 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:16:00,357 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope1:VolumeCollection1 2021-02-19 03:16:00,405 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:16:00,405 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:16:00,907 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope1:VolumeCollection2 2021-02-19 03:16:00,980 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:16:00,982 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:16:01,482 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope1:VolumeCollection3 2021-02-19 03:16:01,532 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:16:01,532 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:16:02,032 | test | DEBUG | MainThread | [bucket_ready_functions:create_collection:854] Creating Collection GleamBookUsers9:VolumeScope1:VolumeCollection4 2021-02-19 03:16:02,084 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> setUp():L176 2021-02-19 03:16:02,084 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 0.5 seconds. Reason: None 2021-02-19 03:16:02,598 | test | DEBUG | MainThread | [rest_client:update_autofailover_settings:1892] settings/autoFailover params: failoverServerGroup=false&failoverOnDataDiskIssues%5Benabled%5D=false&maxCount=1&timeout=600&enabled=false&canAbortRebalance=false 2021-02-19 03:16:02,607 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers0' 2021-02-19 03:16:04,016 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers0' 2021-02-19 03:16:04,230 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers1' 2021-02-19 03:16:04,437 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers1' 2021-02-19 03:16:04,664 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers2' 2021-02-19 03:16:04,871 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers2' 2021-02-19 03:16:05,102 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers3' 2021-02-19 03:16:05,312 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers3' 2021-02-19 03:16:05,523 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers4' 2021-02-19 03:16:05,720 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers4' 2021-02-19 03:16:05,924 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers5' 2021-02-19 03:16:06,131 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers5' 2021-02-19 03:16:06,325 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers6' 2021-02-19 03:16:06,530 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers6' 2021-02-19 03:16:06,760 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers7' 2021-02-19 03:16:06,956 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers7' 2021-02-19 03:16:07,157 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers8' 2021-02-19 03:16:07,352 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers8' 2021-02-19 03:16:07,553 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers9' 2021-02-19 03:16:07,765 | test | DEBUG | MainThread | [sdk_client3:_SDKClient__create_conn:239] Creating SDK connection for 'GleamBookUsers9' ############################################################ # # Step 3: Create 1000000 items sequentially # ############################################################ ############################################################ # # RAM FootPrint: 1151.05078125 # ############################################################ 2021-02-19 03:16:08,029 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: MutateDocsFromSpecTask_1613733368.03 2021-02-19 03:16:08,029 | infra | INFO | pool-2-thread-1 | [task:start_task:84] Thread 'MutateDocsFromSpecTask_1613733368.03' started 2021-02-19 03:16:08,086 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> SystemTestMagma():L1803 2021-02-19 03:16:08,088 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 300 seconds. Reason: None 2021-02-19 03:16:08,464 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: PrintBucketStats_GleamBookUsers5_1613733368.45 2021-02-19 03:16:08,464 | infra | INFO | pool-2-thread-2 | [task:start_task:84] Thread 'PrintBucketStats_GleamBookUsers5_1613733368.45' started 2021-02-19 03:16:08,480 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: PrintBucketStats_GleamBookUsers9_1613733368.47 2021-02-19 03:16:08,480 | infra | INFO | pool-2-thread-3 | [task:start_task:84] Thread 'PrintBucketStats_GleamBookUsers9_1613733368.47' started 2021-02-19 03:16:08,532 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: PrintBucketStats_GleamBookUsers1_1613733368.48 2021-02-19 03:16:08,532 | infra | INFO | pool-2-thread-4 | [task:start_task:84] Thread 'PrintBucketStats_GleamBookUsers1_1613733368.48' started 2021-02-19 03:16:08,548 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: PrintBucketStats_GleamBookUsers8_1613733368.53 2021-02-19 03:16:08,548 | infra | INFO | pool-2-thread-5 | [task:start_task:84] Thread 'PrintBucketStats_GleamBookUsers8_1613733368.53' started 2021-02-19 03:16:08,562 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: PrintBucketStats_GleamBookUsers2_1613733368.55 2021-02-19 03:16:08,562 | infra | INFO | pool-2-thread-6 | [task:start_task:84] Thread 'PrintBucketStats_GleamBookUsers2_1613733368.55' started 2021-02-19 03:16:08,578 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: PrintBucketStats_GleamBookUsers3_1613733368.56 2021-02-19 03:16:08,578 | infra | INFO | pool-2-thread-7 | [task:start_task:84] Thread 'PrintBucketStats_GleamBookUsers3_1613733368.56' started 2021-02-19 03:16:08,592 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: PrintBucketStats_GleamBookUsers7_1613733368.58 2021-02-19 03:16:08,592 | infra | INFO | pool-2-thread-8 | [task:start_task:84] Thread 'PrintBucketStats_GleamBookUsers7_1613733368.58' started 2021-02-19 03:16:08,607 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: PrintBucketStats_GleamBookUsers6_1613733368.59 2021-02-19 03:16:08,607 | infra | INFO | pool-2-thread-9 | [task:start_task:84] Thread 'PrintBucketStats_GleamBookUsers6_1613733368.59' started 2021-02-19 03:16:08,621 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: PrintBucketStats_GleamBookUsers0_1613733368.61 2021-02-19 03:16:08,621 | infra | INFO | pool-2-thread-10 | [task:start_task:84] Thread 'PrintBucketStats_GleamBookUsers0_1613733368.61' started 2021-02-19 03:16:08,635 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: PrintBucketStats_GleamBookUsers4_1613733368.62 2021-02-19 03:16:08,635 | infra | INFO | pool-2-thread-11 | [task:start_task:84] Thread 'PrintBucketStats_GleamBookUsers4_1613733368.62' started 2021-02-19 03:16:08,635 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.23 2021-02-19 03:16:08,637 | infra | INFO | pool-2-thread-12 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.23' started 2021-02-19 03:16:08,637 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.24 2021-02-19 03:16:08,637 | infra | INFO | pool-2-thread-13 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.24' started 2021-02-19 03:16:08,638 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.24 2021-02-19 03:16:08,638 | infra | INFO | pool-2-thread-14 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.24' started 2021-02-19 03:16:08,641 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.26 2021-02-19 03:16:08,641 | infra | INFO | pool-2-thread-15 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.26' started 2021-02-19 03:16:08,642 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.26 2021-02-19 03:16:08,642 | infra | INFO | pool-2-thread-16 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.26' started 2021-02-19 03:16:08,644 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.26 2021-02-19 03:16:08,645 | infra | INFO | pool-2-thread-17 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.26' started 2021-02-19 03:16:08,645 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.27 2021-02-19 03:16:08,651 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.28 2021-02-19 03:16:08,645 | infra | INFO | pool-2-thread-18 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.27' started 2021-02-19 03:16:08,651 | infra | INFO | pool-2-thread-19 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.28' started 2021-02-19 03:16:08,651 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.28 2021-02-19 03:16:08,651 | infra | INFO | pool-2-thread-20 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.28' started 2021-02-19 03:16:08,654 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.29 2021-02-19 03:16:08,654 | infra | INFO | pool-2-thread-21 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.29' started 2021-02-19 03:16:08,654 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.3 2021-02-19 03:16:08,654 | infra | INFO | pool-2-thread-22 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.3' started 2021-02-19 03:16:08,657 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope2_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.3 2021-02-19 03:16:08,657 | infra | INFO | pool-2-thread-23 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope2_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.3' started 2021-02-19 03:16:08,660 | infra | INFO | pool-2-thread-24 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.3' started 2021-02-19 03:16:08,657 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.3 2021-02-19 03:16:08,661 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.31 2021-02-19 03:16:08,661 | infra | INFO | pool-2-thread-25 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.31' started 2021-02-19 03:16:08,661 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.31 2021-02-19 03:16:08,664 | infra | INFO | pool-2-thread-26 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.31' started 2021-02-19 03:16:08,665 | infra | INFO | pool-2-thread-27 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.31' started 2021-02-19 03:16:08,664 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.31 2021-02-19 03:16:08,668 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.32 2021-02-19 03:16:08,668 | infra | INFO | pool-2-thread-28 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.32' started 2021-02-19 03:16:08,670 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.32 2021-02-19 03:16:08,670 | infra | INFO | pool-2-thread-29 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.32' started 2021-02-19 03:16:08,676 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.32 2021-02-19 03:16:08,677 | infra | INFO | pool-2-thread-30 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.32' started 2021-02-19 03:16:08,684 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.32 2021-02-19 03:16:08,688 | infra | INFO | pool-2-thread-31 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.32' started 2021-02-19 03:16:08,690 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.32 2021-02-19 03:16:08,690 | infra | INFO | pool-2-thread-32 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.32' started 2021-02-19 03:16:08,690 | infra | INFO | pool-2-thread-33 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.32' started 2021-02-19 03:16:08,690 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.32 2021-02-19 03:16:08,691 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.32 2021-02-19 03:16:08,693 | infra | INFO | pool-2-thread-34 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.32' started 2021-02-19 03:16:08,693 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.33 2021-02-19 03:16:08,693 | infra | INFO | pool-2-thread-35 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.33' started 2021-02-19 03:16:08,694 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.33 2021-02-19 03:16:08,694 | infra | INFO | pool-2-thread-36 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.33' started 2021-02-19 03:16:08,694 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.33 2021-02-19 03:16:08,697 | infra | INFO | pool-2-thread-37 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.33' started 2021-02-19 03:16:08,697 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.33 2021-02-19 03:16:08,697 | infra | INFO | pool-2-thread-38 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.33' started 2021-02-19 03:16:08,697 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.33 2021-02-19 03:16:08,697 | infra | INFO | pool-2-thread-39 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.33' started 2021-02-19 03:16:08,698 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.33 2021-02-19 03:16:08,698 | infra | INFO | pool-2-thread-40 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.33' started 2021-02-19 03:16:08,698 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.33 2021-02-19 03:16:08,700 | infra | INFO | pool-2-thread-41 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.33' started 2021-02-19 03:16:08,700 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.33 2021-02-19 03:16:08,700 | infra | INFO | pool-2-thread-42 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.33' started 2021-02-19 03:16:08,700 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.34 2021-02-19 03:16:08,700 | infra | INFO | pool-2-thread-43 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.34' started 2021-02-19 03:16:08,703 | infra | INFO | pool-2-thread-44 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.34' started 2021-02-19 03:16:08,703 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.34 2021-02-19 03:16:08,706 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.34 2021-02-19 03:16:08,706 | infra | INFO | pool-2-thread-45 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.34' started 2021-02-19 03:16:08,707 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.34 2021-02-19 03:16:08,707 | infra | INFO | pool-2-thread-46 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.34' started 2021-02-19 03:16:08,710 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.34 2021-02-19 03:16:08,710 | infra | INFO | pool-2-thread-47 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.34' started 2021-02-19 03:16:08,710 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.34 2021-02-19 03:16:08,710 | infra | INFO | pool-2-thread-48 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.34' started 2021-02-19 03:16:08,710 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.34 2021-02-19 03:16:08,710 | infra | INFO | pool-2-thread-49 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.34' started 2021-02-19 03:16:08,713 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.34 2021-02-19 03:16:08,713 | infra | INFO | pool-2-thread-50 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.34' started 2021-02-19 03:16:08,713 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.35 2021-02-19 03:16:08,713 | infra | INFO | pool-2-thread-51 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.35' started 2021-02-19 03:16:08,716 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.35 2021-02-19 03:16:08,717 | infra | INFO | pool-2-thread-52 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.35' started 2021-02-19 03:16:08,719 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.35 2021-02-19 03:16:08,719 | infra | INFO | pool-2-thread-53 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.35' started 2021-02-19 03:16:08,720 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.35 2021-02-19 03:16:08,720 | infra | INFO | pool-2-thread-54 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.35' started 2021-02-19 03:16:08,720 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.35 2021-02-19 03:16:08,720 | infra | INFO | pool-2-thread-55 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.35' started 2021-02-19 03:16:08,723 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.35 2021-02-19 03:16:08,723 | infra | INFO | pool-2-thread-56 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.35' started 2021-02-19 03:16:08,723 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.35 2021-02-19 03:16:08,724 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.35 2021-02-19 03:16:08,724 | infra | INFO | pool-2-thread-58 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.35' started 2021-02-19 03:16:08,724 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.36 2021-02-19 03:16:08,723 | infra | INFO | pool-2-thread-57 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.35' started 2021-02-19 03:16:08,726 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.36 2021-02-19 03:16:08,730 | infra | INFO | pool-2-thread-59 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' started 2021-02-19 03:16:08,730 | infra | INFO | pool-2-thread-61 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' started 2021-02-19 03:16:08,726 | infra | INFO | pool-2-thread-60 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' started 2021-02-19 03:16:08,729 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.36 2021-02-19 03:16:08,733 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.36 2021-02-19 03:16:08,733 | infra | INFO | pool-2-thread-62 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' started 2021-02-19 03:16:08,733 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.36 2021-02-19 03:16:08,733 | infra | INFO | pool-2-thread-63 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' started 2021-02-19 03:16:08,736 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.36 2021-02-19 03:16:08,737 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.36 2021-02-19 03:16:08,737 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.36 2021-02-19 03:16:08,737 | infra | INFO | pool-2-thread-64 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' started 2021-02-19 03:16:08,737 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope2_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.36 2021-02-19 03:16:08,737 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.36 2021-02-19 03:16:08,739 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.36 2021-02-19 03:16:08,739 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,739 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,739 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,739 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,739 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,740 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,740 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,740 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,740 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,740 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,740 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,740 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,740 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,740 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,740 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,740 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,740 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,742 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,742 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.37 2021-02-19 03:16:08,742 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,742 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,742 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,742 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,743 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,743 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,743 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,743 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,743 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,743 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,743 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,743 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,743 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,743 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,744 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,744 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,744 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,744 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,744 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.38 2021-02-19 03:16:08,744 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope2_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,746 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,746 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,746 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,746 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,746 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,746 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,746 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,746 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,746 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,746 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,746 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,746 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,747 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,747 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,747 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,747 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,759 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,759 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,759 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,766 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39 2021-02-19 03:16:08,766 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,766 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,766 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,766 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,766 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,770 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,770 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,772 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,772 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,772 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,772 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,772 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,772 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,773 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,773 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,773 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,773 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,773 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,773 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,773 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,773 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,773 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,773 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,773 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,773 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,775 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,775 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,775 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4 2021-02-19 03:16:08,775 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,811 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,811 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,812 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,812 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,812 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,818 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,818 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,828 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,828 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,828 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,828 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,828 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,828 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,828 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,829 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,829 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,829 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,829 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,829 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,831 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,831 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,831 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.41 2021-02-19 03:16:08,831 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,831 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,832 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,842 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,844 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope2_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,844 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,844 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,844 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,844 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,845 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,845 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,845 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,845 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,845 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,845 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,845 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,846 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,846 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,846 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,846 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,846 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,848 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,848 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,848 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,848 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,848 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,848 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,848 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,848 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,848 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,848 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,849 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,849 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,849 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,849 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,849 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,851 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.42 2021-02-19 03:16:08,851 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,851 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,851 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,851 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,851 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,851 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,851 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,851 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,851 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,851 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,851 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,852 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,852 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,852 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,852 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,854 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,854 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,854 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,854 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,854 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,855 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,855 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,855 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,855 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,855 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,855 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,855 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,855 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope2_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,855 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,857 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,857 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,857 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,857 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.43 2021-02-19 03:16:08,858 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,858 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,858 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,858 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,858 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,858 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,858 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,858 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,858 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,858 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope2_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,859 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,859 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,859 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,859 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope2_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,859 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,861 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,861 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,861 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,861 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,861 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope2_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,861 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope2_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,861 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,861 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,861 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,862 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,862 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,862 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,862 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,862 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,864 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,864 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,864 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,864 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,864 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,865 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,865 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope2_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,865 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,865 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,865 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,865 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,865 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,865 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,865 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,867 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,867 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,867 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,867 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,867 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,867 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,868 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,868 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,868 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,868 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.44 2021-02-19 03:16:08,868 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.45 2021-02-19 03:16:08,868 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.45 2021-02-19 03:16:08,868 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.45 2021-02-19 03:16:08,868 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.45 2021-02-19 03:16:08,868 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.45 2021-02-19 03:16:08,869 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.45 2021-02-19 03:16:08,869 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.45 2021-02-19 03:16:08,869 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.45 2021-02-19 03:16:08,869 | infra | INFO | pool-2-thread-1 | [task_manager:add_new_task:23] Added new task: LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.45 2021-02-19 03:16:09,137 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:16:09,176 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:16:09,216 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:16:09,332 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:16:09,334 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:16:09,342 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:16:09,344 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:16:09,338 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:16:09,348 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 03:16:09,371 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:16:10,858 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:16:10,908 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:16:10,924 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:16:11,055 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:16:11,056 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:16:11,059 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:16:11,069 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:16:11,148 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:16:11,154 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:16:11,164 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 03:16:12,552 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 164.000000 2021-02-19 03:16:12,611 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 144.000000 2021-02-19 03:16:12,671 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 106.900000 2021-02-19 03:16:12,756 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 265.400000 2021-02-19 03:16:12,785 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 123.000000 2021-02-19 03:16:12,819 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 277.300000 2021-02-19 03:16:12,845 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 150.400000 2021-02-19 03:16:12,858 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 105.500000 2021-02-19 03:16:12,871 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 105.300000 2021-02-19 03:16:12,878 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 274.400000 2021-02-19 03:16:14,178 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 164.000000 2021-02-19 03:16:14,338 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 106.900000 2021-02-19 03:16:14,352 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 144.000000 2021-02-19 03:16:14,460 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 265.400000 2021-02-19 03:16:14,486 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 123.000000 2021-02-19 03:16:14,520 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 277.300000 2021-02-19 03:16:14,532 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 150.400000 2021-02-19 03:16:14,592 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 105.300000 2021-02-19 03:16:14,595 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 105.500000 2021-02-19 03:16:14,604 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 274.400000 2021-02-19 03:16:15,805 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 164.000000 2021-02-19 03:16:16,038 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 533.300000 2021-02-19 03:16:16,069 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 628.500000 2021-02-19 03:16:16,201 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1171.400000 2021-02-19 03:16:16,214 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 717.400000 2021-02-19 03:16:16,220 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 611.000000 2021-02-19 03:16:16,244 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1174.200000 2021-02-19 03:16:16,273 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 491.000000 2021-02-19 03:16:16,273 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1182.300000 2021-02-19 03:16:16,302 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 528.800000 2021-02-19 03:16:17,414 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 772.800000 2021-02-19 03:16:17,717 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 533.300000 2021-02-19 03:16:17,727 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 628.500000 2021-02-19 03:16:17,921 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1171.400000 2021-02-19 03:16:17,946 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 717.400000 2021-02-19 03:16:17,951 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 611.000000 2021-02-19 03:16:17,954 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1174.200000 2021-02-19 03:16:17,974 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1182.300000 2021-02-19 03:16:18,006 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 491.000000 2021-02-19 03:16:18,042 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 528.800000 2021-02-19 03:16:19,036 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 772.800000 2021-02-19 03:16:19,361 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 628.500000 2021-02-19 03:16:19,403 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 533.300000 2021-02-19 03:16:19,641 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1171.400000 2021-02-19 03:16:19,664 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 717.400000 2021-02-19 03:16:19,670 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 611.000000 2021-02-19 03:16:19,696 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1174.200000 2021-02-19 03:16:19,740 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1182.300000 2021-02-19 03:16:19,757 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 491.000000 2021-02-19 03:16:19,776 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 528.800000 2021-02-19 03:16:20,660 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 772.800000 2021-02-19 03:16:21,009 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 628.500000 2021-02-19 03:16:21,026 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 533.300000 2021-02-19 03:16:21,293 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 717.400000 2021-02-19 03:16:21,292 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1171.400000 2021-02-19 03:16:21,312 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 611.000000 2021-02-19 03:16:21,408 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1174.200000 2021-02-19 03:16:21,480 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 491.000000 2021-02-19 03:16:21,484 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 528.800000 2021-02-19 03:16:21,486 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1182.300000 2021-02-19 03:16:22,338 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2187.800000 2021-02-19 03:16:22,680 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1903.800000 2021-02-19 03:16:22,688 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1674.700000 2021-02-19 03:16:22,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2064.000000 2021-02-19 03:16:23,006 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1817.600000 2021-02-19 03:16:23,023 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3274.000000 2021-02-19 03:16:23,125 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3215.400000 2021-02-19 03:16:23,170 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1598.100000 2021-02-19 03:16:23,171 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1459.500000 2021-02-19 03:16:23,177 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3288.200000 2021-02-19 03:16:23,974 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2187.800000 2021-02-19 03:16:24,325 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1674.700000 2021-02-19 03:16:24,348 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1903.800000 2021-02-19 03:16:24,690 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1817.600000 2021-02-19 03:16:24,711 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2064.000000 2021-02-19 03:16:24,752 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3274.000000 2021-02-19 03:16:24,848 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3215.400000 2021-02-19 03:16:24,884 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1459.500000 2021-02-19 03:16:24,894 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1598.100000 2021-02-19 03:16:24,907 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3288.200000 2021-02-19 03:16:25,578 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3169.200000 2021-02-19 03:16:25,960 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2547.700000 2021-02-19 03:16:25,989 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2901.300000 2021-02-19 03:16:26,344 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2676.500000 2021-02-19 03:16:26,388 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2988.300000 2021-02-19 03:16:26,424 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4776.600000 2021-02-19 03:16:26,500 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4675.300000 2021-02-19 03:16:26,584 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4767.900000 2021-02-19 03:16:26,589 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2390.400000 2021-02-19 03:16:26,592 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2185.500000 2021-02-19 03:16:27,214 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3169.200000 2021-02-19 03:16:27,651 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2547.700000 2021-02-19 03:16:27,657 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2901.300000 2021-02-19 03:16:27,979 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2676.500000 2021-02-19 03:16:28,049 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2988.300000 2021-02-19 03:16:28,102 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4776.600000 2021-02-19 03:16:28,207 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4675.300000 2021-02-19 03:16:28,234 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4767.900000 2021-02-19 03:16:28,252 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2390.400000 2021-02-19 03:16:28,279 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2185.500000 2021-02-19 03:16:28,834 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3169.200000 2021-02-19 03:16:29,273 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2547.700000 2021-02-19 03:16:29,289 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2901.300000 2021-02-19 03:16:29,598 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2676.500000 2021-02-19 03:16:29,757 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2988.300000 2021-02-19 03:16:29,766 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4776.600000 2021-02-19 03:16:29,861 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4675.300000 2021-02-19 03:16:29,894 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4767.900000 2021-02-19 03:16:29,961 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2390.400000 2021-02-19 03:16:29,970 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2185.500000 2021-02-19 03:16:30,505 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3169.200000 2021-02-19 03:16:30,918 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2547.700000 2021-02-19 03:16:30,948 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2901.300000 2021-02-19 03:16:31,213 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2676.500000 2021-02-19 03:16:31,407 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2988.300000 2021-02-19 03:16:31,420 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4776.600000 2021-02-19 03:16:31,519 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4675.300000 2021-02-19 03:16:31,539 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4767.900000 2021-02-19 03:16:31,667 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2185.500000 2021-02-19 03:16:31,671 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2390.400000 2021-02-19 03:16:32,177 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3169.200000 2021-02-19 03:16:32,556 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2550.100000 2021-02-19 03:16:32,604 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2932.100000 2021-02-19 03:16:32,845 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2766.300000 2021-02-19 03:16:33,055 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4862.700000 2021-02-19 03:16:33,065 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3020.300000 2021-02-19 03:16:33,181 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4792.300000 2021-02-19 03:16:33,229 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4767.800000 2021-02-19 03:16:33,335 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2510.000000 2021-02-19 03:16:33,335 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2226.500000 2021-02-19 03:16:33,801 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3277.200000 2021-02-19 03:16:34,190 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2550.100000 2021-02-19 03:16:34,233 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2932.100000 2021-02-19 03:16:34,463 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2766.300000 2021-02-19 03:16:34,706 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4862.700000 2021-02-19 03:16:34,733 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3020.300000 2021-02-19 03:16:34,875 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4767.800000 2021-02-19 03:16:34,878 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4792.300000 2021-02-19 03:16:34,989 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2510.000000 2021-02-19 03:16:34,999 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2226.500000 2021-02-19 03:16:35,443 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3383.116602 2021-02-19 03:16:35,825 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2550.100000 2021-02-19 03:16:35,859 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2932.100000 2021-02-19 03:16:36,105 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2838.787042 2021-02-19 03:16:36,358 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3057.601378 2021-02-19 03:16:36,364 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4904.234771 2021-02-19 03:16:36,542 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4784.412838 2021-02-19 03:16:36,578 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4844.804183 2021-02-19 03:16:36,618 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2593.690866 2021-02-19 03:16:36,641 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2210.138265 2021-02-19 03:16:37,049 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3383.116602 2021-02-19 03:16:37,436 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2491.790147 2021-02-19 03:16:37,476 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2928.985894 2021-02-19 03:16:37,726 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2838.787042 2021-02-19 03:16:37,996 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4904.234771 2021-02-19 03:16:38,013 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3057.601378 2021-02-19 03:16:38,216 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4844.804183 2021-02-19 03:16:38,220 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4784.412838 2021-02-19 03:16:38,234 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2593.690866 2021-02-19 03:16:38,286 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2210.138265 2021-02-19 03:16:38,650 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3383.116602 2021-02-19 03:16:39,049 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2491.790147 2021-02-19 03:16:39,108 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2928.985894 2021-02-19 03:16:39,378 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2838.787042 2021-02-19 03:16:39,677 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4904.234771 2021-02-19 03:16:39,681 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3057.601378 2021-02-19 03:16:39,892 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4784.412838 2021-02-19 03:16:39,915 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2593.690866 2021-02-19 03:16:39,924 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4844.804183 2021-02-19 03:16:39,924 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2210.138265 2021-02-19 03:16:40,273 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3383.116602 2021-02-19 03:16:40,703 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2491.790147 2021-02-19 03:16:40,730 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2928.985894 2021-02-19 03:16:41,003 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2838.787042 2021-02-19 03:16:41,335 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4904.234771 2021-02-19 03:16:41,358 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3057.601378 2021-02-19 03:16:41,562 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2593.690866 2021-02-19 03:16:41,569 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4784.412838 2021-02-19 03:16:41,573 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2210.138265 2021-02-19 03:16:41,585 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4844.804183 2021-02-19 03:16:41,894 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3383.116602 2021-02-19 03:16:42,349 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2971.985894 2021-02-19 03:16:42,359 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2479.490147 2021-02-19 03:16:42,607 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2830.187042 2021-02-19 03:16:42,973 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4936.734771 2021-02-19 03:16:42,984 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3025.601378 2021-02-19 03:16:43,198 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4843.312838 2021-02-19 03:16:43,216 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2496.890866 2021-02-19 03:16:43,266 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4807.804183 2021-02-19 03:16:43,267 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2207.638265 2021-02-19 03:16:43,539 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3322.116602 2021-02-19 03:16:44,010 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2479.490147 2021-02-19 03:16:44,023 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2971.985894 2021-02-19 03:16:44,210 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2830.187042 2021-02-19 03:16:44,609 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4936.734771 2021-02-19 03:16:44,635 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3025.601378 2021-02-19 03:16:44,838 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4843.312838 2021-02-19 03:16:44,881 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2496.890866 2021-02-19 03:16:44,928 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4807.804183 2021-02-19 03:16:44,934 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2207.638265 2021-02-19 03:16:45,151 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3322.116602 2021-02-19 03:16:45,654 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2494.535430 2021-02-19 03:16:45,665 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2987.440379 2021-02-19 03:16:45,822 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2830.187042 2021-02-19 03:16:46,249 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5000.273245 2021-02-19 03:16:46,285 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3009.972052 2021-02-19 03:16:46,516 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4914.408024 2021-02-19 03:16:46,549 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4837.546379 2021-02-19 03:16:46,565 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2232.403837 2021-02-19 03:16:46,569 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2336.436362 2021-02-19 03:16:46,779 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3264.685766 2021-02-19 03:16:47,270 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2494.535430 2021-02-19 03:16:47,299 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2987.440379 2021-02-19 03:16:47,453 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2846.841270 2021-02-19 03:16:47,868 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5000.273245 2021-02-19 03:16:47,904 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3009.972052 2021-02-19 03:16:48,170 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4837.546379 2021-02-19 03:16:48,190 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4914.408024 2021-02-19 03:16:48,214 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2336.436362 2021-02-19 03:16:48,223 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2232.403837 2021-02-19 03:16:48,470 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3264.685766 2021-02-19 03:16:48,934 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2494.535430 2021-02-19 03:16:48,950 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2987.440379 2021-02-19 03:16:49,142 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2846.841270 2021-02-19 03:16:49,502 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5000.273245 2021-02-19 03:16:49,566 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3009.972052 2021-02-19 03:16:49,802 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4837.546379 2021-02-19 03:16:49,862 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2336.436362 2021-02-19 03:16:49,894 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4914.408024 2021-02-19 03:16:49,923 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2232.403837 2021-02-19 03:16:50,134 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3264.685766 2021-02-19 03:16:50,608 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2494.535430 2021-02-19 03:16:50,625 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2987.440379 2021-02-19 03:16:50,759 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2846.841270 2021-02-19 03:16:51,167 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5000.273245 2021-02-19 03:16:51,207 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3009.972052 2021-02-19 03:16:51,453 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4837.546379 2021-02-19 03:16:51,530 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2336.436362 2021-02-19 03:16:51,575 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4914.408024 2021-02-19 03:16:51,594 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2232.403837 2021-02-19 03:16:51,779 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3264.685766 2021-02-19 03:16:52,295 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2494.535430 2021-02-19 03:16:52,331 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3018.540379 2021-02-19 03:16:52,430 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2905.041270 2021-02-19 03:16:52,782 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4897.673245 2021-02-19 03:16:52,880 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3017.672052 2021-02-19 03:16:53,107 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4801.546379 2021-02-19 03:16:53,170 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2316.436362 2021-02-19 03:16:53,250 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2297.803837 2021-02-19 03:16:53,279 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4870.308024 2021-02-19 03:16:53,424 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3356.685766 2021-02-19 03:16:53,924 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2551.535430 2021-02-19 03:16:53,983 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3018.540379 2021-02-19 03:16:54,076 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2905.041270 2021-02-19 03:16:54,423 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4897.673245 2021-02-19 03:16:54,558 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3017.672052 2021-02-19 03:16:54,713 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4801.546379 2021-02-19 03:16:54,812 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2316.436362 2021-02-19 03:16:54,954 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2297.803837 2021-02-19 03:16:54,973 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4870.308024 2021-02-19 03:16:55,066 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3356.685766 2021-02-19 03:16:55,569 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2552.800000 2021-02-19 03:16:55,628 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3009.000000 2021-02-19 03:16:55,720 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2957.000000 2021-02-19 03:16:56,045 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4688.100000 2021-02-19 03:16:56,173 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2985.600000 2021-02-19 03:16:56,351 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4701.900000 2021-02-19 03:16:56,467 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2395.800000 2021-02-19 03:16:56,604 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2371.900000 2021-02-19 03:16:56,631 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4743.400000 2021-02-19 03:16:56,697 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3431.000000 2021-02-19 03:16:57,209 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2552.800000 2021-02-19 03:16:57,275 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3009.000000 2021-02-19 03:16:57,381 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2957.000000 2021-02-19 03:16:57,691 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4688.100000 2021-02-19 03:16:57,792 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2985.600000 2021-02-19 03:16:57,996 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4701.900000 2021-02-19 03:16:58,111 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2395.800000 2021-02-19 03:16:58,243 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2371.900000 2021-02-19 03:16:58,301 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4743.400000 2021-02-19 03:16:58,312 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3431.000000 2021-02-19 03:16:58,864 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2552.800000 2021-02-19 03:16:58,913 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3009.000000 2021-02-19 03:16:58,997 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2957.000000 2021-02-19 03:16:59,318 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4688.100000 2021-02-19 03:16:59,443 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2985.600000 2021-02-19 03:16:59,615 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4701.900000 2021-02-19 03:16:59,799 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2395.800000 2021-02-19 03:16:59,888 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2371.900000 2021-02-19 03:16:59,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4743.400000 2021-02-19 03:16:59,957 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3431.000000 2021-02-19 03:17:00,500 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2552.800000 2021-02-19 03:17:00,569 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3009.000000 2021-02-19 03:17:00,615 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2957.000000 2021-02-19 03:17:00,937 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4688.100000 2021-02-19 03:17:01,068 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2985.600000 2021-02-19 03:17:01,262 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4701.900000 2021-02-19 03:17:01,444 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2395.800000 2021-02-19 03:17:01,513 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2371.900000 2021-02-19 03:17:01,588 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4743.400000 2021-02-19 03:17:01,637 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3431.000000 2021-02-19 03:17:02,124 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2552.800000 2021-02-19 03:17:02,194 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3009.000000 2021-02-19 03:17:02,270 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2910.200000 2021-02-19 03:17:02,571 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4680.400000 2021-02-19 03:17:02,687 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2926.700000 2021-02-19 03:17:02,887 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4736.600000 2021-02-19 03:17:03,078 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2488.500000 2021-02-19 03:17:03,190 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2309.300000 2021-02-19 03:17:03,263 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4796.900000 2021-02-19 03:17:03,319 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3413.900000 2021-02-19 03:17:03,769 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2486.800000 2021-02-19 03:17:03,861 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2923.400000 2021-02-19 03:17:03,914 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2910.200000 2021-02-19 03:17:04,173 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4680.400000 2021-02-19 03:17:04,313 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2926.700000 2021-02-19 03:17:04,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4736.600000 2021-02-19 03:17:04,743 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2488.500000 2021-02-19 03:17:04,891 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2309.300000 2021-02-19 03:17:04,911 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4796.900000 2021-02-19 03:17:05,006 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3413.900000 2021-02-19 03:17:05,450 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2486.800000 2021-02-19 03:17:05,522 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.600000 2021-02-19 03:17:05,607 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2825.000000 2021-02-19 03:17:05,832 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4680.400000 2021-02-19 03:17:05,950 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2926.700000 2021-02-19 03:17:06,142 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4865.300000 2021-02-19 03:17:06,371 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2531.100000 2021-02-19 03:17:06,548 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2221.800000 2021-02-19 03:17:06,572 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4976.100000 2021-02-19 03:17:06,628 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3413.700000 2021-02-19 03:17:07,094 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2485.400000 2021-02-19 03:17:07,144 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.600000 2021-02-19 03:17:07,253 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2825.000000 2021-02-19 03:17:07,467 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4843.400000 2021-02-19 03:17:07,599 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2918.700000 2021-02-19 03:17:07,798 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4865.300000 2021-02-19 03:17:08,022 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2531.100000 2021-02-19 03:17:08,207 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2221.800000 2021-02-19 03:17:08,213 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4976.100000 2021-02-19 03:17:08,282 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3413.700000 2021-02-19 03:17:08,717 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2485.400000 2021-02-19 03:17:08,835 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.600000 2021-02-19 03:17:08,905 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2825.000000 2021-02-19 03:17:09,082 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4843.400000 2021-02-19 03:17:09,226 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2918.700000 2021-02-19 03:17:09,443 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4865.300000 2021-02-19 03:17:09,668 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2531.100000 2021-02-19 03:17:09,855 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2221.800000 2021-02-19 03:17:09,891 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4976.100000 2021-02-19 03:17:09,950 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3413.700000 2021-02-19 03:17:10,335 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2485.400000 2021-02-19 03:17:10,510 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.600000 2021-02-19 03:17:10,561 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2825.000000 2021-02-19 03:17:10,755 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4843.400000 2021-02-19 03:17:10,881 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2918.700000 2021-02-19 03:17:11,065 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4865.300000 2021-02-19 03:17:11,301 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2531.100000 2021-02-19 03:17:11,513 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2221.800000 2021-02-19 03:17:11,530 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4976.100000 2021-02-19 03:17:11,588 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3413.700000 2021-02-19 03:17:11,996 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2485.400000 2021-02-19 03:17:12,148 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.600000 2021-02-19 03:17:12,198 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2825.000000 2021-02-19 03:17:12,404 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4953.800000 2021-02-19 03:17:12,542 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2999.300000 2021-02-19 03:17:12,701 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4902.800000 2021-02-19 03:17:12,937 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2515.400000 2021-02-19 03:17:13,187 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4976.000000 2021-02-19 03:17:13,197 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2277.800000 2021-02-19 03:17:13,259 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3375.400000 2021-02-19 03:17:13,687 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2507.100000 2021-02-19 03:17:13,831 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2890.200000 2021-02-19 03:17:13,911 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2829.300000 2021-02-19 03:17:14,056 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4953.800000 2021-02-19 03:17:14,163 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2999.300000 2021-02-19 03:17:14,371 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4902.800000 2021-02-19 03:17:14,568 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2515.400000 2021-02-19 03:17:14,831 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4976.000000 2021-02-19 03:17:14,851 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2277.800000 2021-02-19 03:17:14,921 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3375.400000 2021-02-19 03:17:15,342 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2507.100000 2021-02-19 03:17:15,473 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2844.200000 2021-02-19 03:17:15,556 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2820.500000 2021-02-19 03:17:15,703 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4828.600000 2021-02-19 03:17:15,769 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2999.300000 2021-02-19 03:17:16,029 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4745.500000 2021-02-19 03:17:16,227 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2519.400000 2021-02-19 03:17:16,466 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2353.300000 2021-02-19 03:17:16,483 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4761.500000 2021-02-19 03:17:16,553 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3256.400000 2021-02-19 03:17:16,996 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2494.500000 2021-02-19 03:17:17,108 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2844.200000 2021-02-19 03:17:17,246 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2820.500000 2021-02-19 03:17:17,348 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4828.600000 2021-02-19 03:17:17,395 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3011.000000 2021-02-19 03:17:17,653 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4745.500000 2021-02-19 03:17:17,839 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2519.400000 2021-02-19 03:17:18,130 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2353.300000 2021-02-19 03:17:18,157 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4761.500000 2021-02-19 03:17:18,210 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3256.400000 2021-02-19 03:17:18,634 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2494.500000 2021-02-19 03:17:18,755 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2844.200000 2021-02-19 03:17:18,903 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2820.500000 2021-02-19 03:17:18,979 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4828.600000 2021-02-19 03:17:19,012 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3011.000000 2021-02-19 03:17:19,285 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4745.500000 2021-02-19 03:17:19,470 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2519.400000 2021-02-19 03:17:19,798 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2353.300000 2021-02-19 03:17:19,828 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4761.500000 2021-02-19 03:17:19,868 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3256.400000 2021-02-19 03:17:20,273 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2494.500000 2021-02-19 03:17:20,382 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2844.200000 2021-02-19 03:17:20,549 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2820.500000 2021-02-19 03:17:20,609 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4828.600000 2021-02-19 03:17:20,634 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3011.000000 2021-02-19 03:17:20,900 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4745.500000 2021-02-19 03:17:21,085 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2519.400000 2021-02-19 03:17:21,428 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2353.300000 2021-02-19 03:17:21,456 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4761.500000 2021-02-19 03:17:21,497 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3256.400000 2021-02-19 03:17:21,930 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2494.500000 2021-02-19 03:17:22,056 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2844.200000 2021-02-19 03:17:22,213 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2820.500000 2021-02-19 03:17:22,296 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2906.700000 2021-02-19 03:17:22,302 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4828.600000 2021-02-19 03:17:22,513 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4567.000000 2021-02-19 03:17:22,721 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2479.600000 2021-02-19 03:17:23,071 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2319.500000 2021-02-19 03:17:23,105 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4615.700000 2021-02-19 03:17:23,148 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3189.300000 2021-02-19 03:17:23,573 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2513.100000 2021-02-19 03:17:23,752 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2895.500000 2021-02-19 03:17:23,881 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2776.700000 2021-02-19 03:17:23,947 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2906.700000 2021-02-19 03:17:23,990 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4608.500000 2021-02-19 03:17:24,130 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4567.000000 2021-02-19 03:17:24,349 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2479.600000 2021-02-19 03:17:24,720 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2319.500000 2021-02-19 03:17:24,785 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4615.700000 2021-02-19 03:17:24,805 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3189.300000 2021-02-19 03:17:25,210 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2513.100000 2021-02-19 03:17:25,401 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2895.500000 2021-02-19 03:17:25,516 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2721.600000 2021-02-19 03:17:25,605 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2899.200000 2021-02-19 03:17:25,644 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4613.600000 2021-02-19 03:17:25,811 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4567.000000 2021-02-19 03:17:25,971 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2479.600000 2021-02-19 03:17:26,359 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2254.100000 2021-02-19 03:17:26,446 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3214.500000 2021-02-19 03:17:26,460 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4621.000000 2021-02-19 03:17:26,851 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2524.200000 2021-02-19 03:17:27,055 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2934.500000 2021-02-19 03:17:27,135 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2721.600000 2021-02-19 03:17:27,234 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2899.200000 2021-02-19 03:17:27,282 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4613.600000 2021-02-19 03:17:27,423 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4563.500000 2021-02-19 03:17:27,601 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2420.200000 2021-02-19 03:17:28,023 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2254.100000 2021-02-19 03:17:28,115 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4621.000000 2021-02-19 03:17:28,131 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3214.500000 2021-02-19 03:17:28,506 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2524.200000 2021-02-19 03:17:28,661 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2934.500000 2021-02-19 03:17:28,778 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2721.600000 2021-02-19 03:17:28,871 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2899.200000 2021-02-19 03:17:28,930 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4613.600000 2021-02-19 03:17:29,109 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4563.500000 2021-02-19 03:17:29,256 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2420.200000 2021-02-19 03:17:29,690 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2254.100000 2021-02-19 03:17:29,789 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4621.000000 2021-02-19 03:17:29,793 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3214.500000 2021-02-19 03:17:30,158 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2524.200000 2021-02-19 03:17:30,319 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2934.500000 2021-02-19 03:17:30,424 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2721.600000 2021-02-19 03:17:30,523 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2899.200000 2021-02-19 03:17:30,605 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4613.600000 2021-02-19 03:17:30,749 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4563.500000 2021-02-19 03:17:30,888 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2420.200000 2021-02-19 03:17:31,336 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2254.100000 2021-02-19 03:17:31,440 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4621.000000 2021-02-19 03:17:31,457 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3214.500000 2021-02-19 03:17:31,801 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2524.200000 2021-02-19 03:17:31,970 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2934.500000 2021-02-19 03:17:32,049 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2721.600000 2021-02-19 03:17:32,158 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2899.200000 2021-02-19 03:17:32,243 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4613.600000 2021-02-19 03:17:32,397 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4536.100000 2021-02-19 03:17:32,523 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2401.100000 2021-02-19 03:17:32,963 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2260.600000 2021-02-19 03:17:33,078 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4534.200000 2021-02-19 03:17:33,114 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3233.000000 2021-02-19 03:17:33,431 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2528.300000 2021-02-19 03:17:33,585 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2958.300000 2021-02-19 03:17:33,717 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2635.200000 2021-02-19 03:17:33,819 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2953.600000 2021-02-19 03:17:33,908 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4561.700000 2021-02-19 03:17:34,020 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4536.100000 2021-02-19 03:17:34,177 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2401.100000 2021-02-19 03:17:34,592 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2260.600000 2021-02-19 03:17:34,753 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4534.200000 2021-02-19 03:17:34,808 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3233.000000 2021-02-19 03:17:35,069 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2528.300000 2021-02-19 03:17:35,217 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2958.300000 2021-02-19 03:17:35,414 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2635.200000 2021-02-19 03:17:35,526 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2926.759688 2021-02-19 03:17:35,581 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4410.365202 2021-02-19 03:17:35,683 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4420.969397 2021-02-19 03:17:35,811 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2401.100000 2021-02-19 03:17:36,265 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2265.054734 2021-02-19 03:17:36,388 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4458.209109 2021-02-19 03:17:36,443 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3234.555334 2021-02-19 03:17:36,703 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2541.478785 2021-02-19 03:17:36,888 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2985.511746 2021-02-19 03:17:37,055 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2666.455813 2021-02-19 03:17:37,197 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2926.759688 2021-02-19 03:17:37,242 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4410.365202 2021-02-19 03:17:37,394 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4420.969397 2021-02-19 03:17:37,516 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2375.983420 2021-02-19 03:17:37,884 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2265.054734 2021-02-19 03:17:38,033 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4458.209109 2021-02-19 03:17:38,059 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3234.555334 2021-02-19 03:17:38,342 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2541.478785 2021-02-19 03:17:38,529 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2985.511746 2021-02-19 03:17:38,703 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2666.455813 2021-02-19 03:17:38,828 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2926.759688 2021-02-19 03:17:38,875 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4410.365202 2021-02-19 03:17:39,020 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4420.969397 2021-02-19 03:17:39,131 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2375.983420 2021-02-19 03:17:39,533 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2265.054734 2021-02-19 03:17:39,663 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4458.209109 2021-02-19 03:17:39,717 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3234.555334 2021-02-19 03:17:39,957 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2541.478785 2021-02-19 03:17:40,142 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2985.511746 2021-02-19 03:17:40,326 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2666.455813 2021-02-19 03:17:40,493 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2926.759688 2021-02-19 03:17:40,533 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4410.365202 2021-02-19 03:17:40,684 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4420.969397 2021-02-19 03:17:40,796 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2375.983420 2021-02-19 03:17:41,181 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2265.054734 2021-02-19 03:17:41,293 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4458.209109 2021-02-19 03:17:41,391 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3234.555334 2021-02-19 03:17:41,596 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2541.478785 2021-02-19 03:17:41,808 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2985.511746 2021-02-19 03:17:41,986 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2666.455813 2021-02-19 03:17:42,155 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2926.759688 2021-02-19 03:17:42,171 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4410.365202 2021-02-19 03:17:42,309 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4419.869397 2021-02-19 03:17:42,408 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2362.283420 2021-02-19 03:17:42,829 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2199.454734 2021-02-19 03:17:42,976 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4506.409109 2021-02-19 03:17:43,091 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3194.055334 2021-02-19 03:17:43,217 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2514.178785 2021-02-19 03:17:43,434 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2981.711746 2021-02-19 03:17:43,631 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2753.555813 2021-02-19 03:17:43,848 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2950.759688 2021-02-19 03:17:43,868 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4439.565202 2021-02-19 03:17:43,986 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4419.869397 2021-02-19 03:17:44,130 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2362.283420 2021-02-19 03:17:44,497 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2199.454734 2021-02-19 03:17:44,700 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4506.409109 2021-02-19 03:17:44,757 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3194.055334 2021-02-19 03:17:44,875 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2514.178785 2021-02-19 03:17:45,099 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2981.711746 2021-02-19 03:17:45,273 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2753.555813 2021-02-19 03:17:45,500 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2967.360232 2021-02-19 03:17:45,543 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4475.177533 2021-02-19 03:17:45,638 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4459.177773 2021-02-19 03:17:45,799 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2361.215298 2021-02-19 03:17:46,134 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2195.740809 2021-02-19 03:17:46,309 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4506.691229 2021-02-19 03:17:46,390 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3103.335803 2021-02-19 03:17:46,532 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2514.321386 2021-02-19 03:17:46,713 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2966.670204 2021-02-19 03:17:46,940 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2747.236604 2021-02-19 03:17:47,178 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2967.360232 2021-02-19 03:17:47,180 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4475.177533 2021-02-19 03:17:47,298 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4459.177773 2021-02-19 03:17:47,434 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2361.215298 2021-02-19 03:17:47,782 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2195.740809 2021-02-19 03:17:47,936 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4506.691229 2021-02-19 03:17:48,028 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3103.335803 2021-02-19 03:17:48,167 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2514.321386 2021-02-19 03:17:48,392 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2966.670204 2021-02-19 03:17:48,611 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2747.236604 2021-02-19 03:17:48,832 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2967.360232 2021-02-19 03:17:48,834 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4475.177533 2021-02-19 03:17:48,967 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4459.177773 2021-02-19 03:17:49,071 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2361.215298 2021-02-19 03:17:49,418 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2195.740809 2021-02-19 03:17:49,578 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4506.691229 2021-02-19 03:17:49,709 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3103.335803 2021-02-19 03:17:49,789 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2514.321386 2021-02-19 03:17:50,013 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2966.670204 2021-02-19 03:17:50,236 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2747.236604 2021-02-19 03:17:50,482 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2967.360232 2021-02-19 03:17:50,494 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4475.177533 2021-02-19 03:17:50,595 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4459.177773 2021-02-19 03:17:50,701 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2361.215298 2021-02-19 03:17:51,056 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2195.740809 2021-02-19 03:17:51,198 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4506.691229 2021-02-19 03:17:51,342 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3103.335803 2021-02-19 03:17:51,408 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2514.321386 2021-02-19 03:17:51,638 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2966.670204 2021-02-19 03:17:51,861 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2747.236604 2021-02-19 03:17:52,140 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2967.360232 2021-02-19 03:17:52,167 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4475.177533 2021-02-19 03:17:52,243 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4459.177773 2021-02-19 03:17:52,352 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2380.015298 2021-02-19 03:17:52,684 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2236.440809 2021-02-19 03:17:52,855 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4394.891229 2021-02-19 03:17:53,039 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3123.835803 2021-02-19 03:17:53,081 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2563.421386 2021-02-19 03:17:53,282 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2871.670204 2021-02-19 03:17:53,497 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2739.936604 2021-02-19 03:17:53,805 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2939.360232 2021-02-19 03:17:53,841 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4414.877533 2021-02-19 03:17:53,907 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4446.977773 2021-02-19 03:17:54,038 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2380.015298 2021-02-19 03:17:54,325 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2236.440809 2021-02-19 03:17:54,496 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4394.891229 2021-02-19 03:17:54,733 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2563.421386 2021-02-19 03:17:54,736 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3123.835803 2021-02-19 03:17:54,907 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2871.670204 2021-02-19 03:17:55,184 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2739.936604 2021-02-19 03:17:55,421 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2988.800000 2021-02-19 03:17:55,522 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4458.300000 2021-02-19 03:17:55,542 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4528.700000 2021-02-19 03:17:55,694 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2454.100000 2021-02-19 03:17:55,967 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2236.440809 2021-02-19 03:17:56,121 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4391.700000 2021-02-19 03:17:56,421 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3238.500000 2021-02-19 03:17:56,463 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2579.600000 2021-02-19 03:17:56,576 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2828.100000 2021-02-19 03:17:56,805 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2775.600000 2021-02-19 03:17:57,049 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2988.800000 2021-02-19 03:17:57,203 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4528.700000 2021-02-19 03:17:57,216 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4458.300000 2021-02-19 03:17:57,372 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2454.100000 2021-02-19 03:17:57,608 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2245.600000 2021-02-19 03:17:57,750 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4391.700000 2021-02-19 03:17:58,099 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3238.500000 2021-02-19 03:17:58,130 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2579.600000 2021-02-19 03:17:58,223 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2828.100000 2021-02-19 03:17:58,446 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2775.600000 2021-02-19 03:17:58,719 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2988.800000 2021-02-19 03:17:58,855 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4528.700000 2021-02-19 03:17:58,903 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4458.300000 2021-02-19 03:17:58,986 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2454.100000 2021-02-19 03:17:59,273 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2245.600000 2021-02-19 03:17:59,374 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4391.700000 2021-02-19 03:17:59,757 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3238.500000 2021-02-19 03:17:59,769 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2579.600000 2021-02-19 03:17:59,867 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2828.100000 2021-02-19 03:18:00,069 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2775.600000 2021-02-19 03:18:00,372 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2988.800000 2021-02-19 03:18:00,519 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4528.700000 2021-02-19 03:18:00,596 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4458.300000 2021-02-19 03:18:00,647 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2454.100000 2021-02-19 03:18:00,908 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2245.600000 2021-02-19 03:18:00,996 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4391.700000 2021-02-19 03:18:01,391 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3238.500000 2021-02-19 03:18:01,400 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2579.600000 2021-02-19 03:18:01,496 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2828.100000 2021-02-19 03:18:01,684 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2775.600000 2021-02-19 03:18:02,030 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2988.800000 2021-02-19 03:18:02,134 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4528.700000 2021-02-19 03:18:02,278 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4458.300000 2021-02-19 03:18:02,308 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2486.600000 2021-02-19 03:18:02,584 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2291.000000 2021-02-19 03:18:02,642 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4495.800000 2021-02-19 03:18:03,026 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3179.000000 2021-02-19 03:18:03,085 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2540.100000 2021-02-19 03:18:03,178 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2917.600000 2021-02-19 03:18:03,309 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2758.000000 2021-02-19 03:18:03,671 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2948.800000 2021-02-19 03:18:03,826 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4553.100000 2021-02-19 03:18:03,924 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4554.200000 2021-02-19 03:18:03,979 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2486.600000 2021-02-19 03:18:04,204 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2291.000000 2021-02-19 03:18:04,305 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4495.800000 2021-02-19 03:18:04,661 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3179.000000 2021-02-19 03:18:04,721 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2540.100000 2021-02-19 03:18:04,826 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2917.600000 2021-02-19 03:18:05,023 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2758.000000 2021-02-19 03:18:05,323 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2948.800000 2021-02-19 03:18:05,447 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4414.300000 2021-02-19 03:18:05,598 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4480.500000 2021-02-19 03:18:05,653 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2424.100000 2021-02-19 03:18:05,851 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2291.000000 2021-02-19 03:18:05,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4495.800000 2021-02-19 03:18:06,321 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3039.000000 2021-02-19 03:18:06,380 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2516.600000 2021-02-19 03:18:06,467 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2951.600000 2021-02-19 03:18:06,700 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2699.800000 2021-02-19 03:18:06,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2857.000000 2021-02-19 03:18:07,085 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4414.300000 2021-02-19 03:18:07,253 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4480.500000 2021-02-19 03:18:07,289 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2424.100000 2021-02-19 03:18:07,482 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2334.600000 2021-02-19 03:18:07,569 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4440.500000 2021-02-19 03:18:07,970 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3039.000000 2021-02-19 03:18:08,005 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2516.600000 2021-02-19 03:18:08,088 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2951.600000 2021-02-19 03:18:08,341 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2699.800000 2021-02-19 03:18:08,611 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2857.000000 2021-02-19 03:18:08,736 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4414.300000 2021-02-19 03:18:08,892 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4480.500000 2021-02-19 03:18:08,964 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2424.100000 2021-02-19 03:18:09,147 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2334.600000 2021-02-19 03:18:09,223 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4440.500000 2021-02-19 03:18:09,632 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3039.000000 2021-02-19 03:18:09,665 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2516.600000 2021-02-19 03:18:09,746 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2951.600000 2021-02-19 03:18:09,973 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2699.800000 2021-02-19 03:18:10,255 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2857.000000 2021-02-19 03:18:10,365 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4414.300000 2021-02-19 03:18:10,546 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4480.500000 2021-02-19 03:18:10,655 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2424.100000 2021-02-19 03:18:10,770 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2334.600000 2021-02-19 03:18:10,839 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4440.500000 2021-02-19 03:18:11,266 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3039.000000 2021-02-19 03:18:11,299 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2516.600000 2021-02-19 03:18:11,364 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2951.600000 2021-02-19 03:18:11,588 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2699.800000 2021-02-19 03:18:11,887 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2857.000000 2021-02-19 03:18:12,013 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4414.300000 2021-02-19 03:18:12,170 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4480.500000 2021-02-19 03:18:12,285 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2377.000000 2021-02-19 03:18:12,421 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2308.600000 2021-02-19 03:18:12,480 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4354.100000 2021-02-19 03:18:12,901 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3084.800000 2021-02-19 03:18:12,948 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2497.500000 2021-02-19 03:18:13,049 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2926.800000 2021-02-19 03:18:13,200 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2734.100000 2021-02-19 03:18:13,503 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2868.500000 2021-02-19 03:18:13,668 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4367.400000 2021-02-19 03:18:13,803 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4374.100000 2021-02-19 03:18:13,917 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2377.000000 2021-02-19 03:18:14,061 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2308.600000 2021-02-19 03:18:14,115 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4354.100000 2021-02-19 03:18:14,551 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3084.800000 2021-02-19 03:18:14,578 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2497.500000 2021-02-19 03:18:14,684 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2926.800000 2021-02-19 03:18:14,811 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2734.100000 2021-02-19 03:18:15,183 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2868.500000 2021-02-19 03:18:15,339 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4367.400000 2021-02-19 03:18:15,437 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4425.873613 2021-02-19 03:18:15,546 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2387.799100 2021-02-19 03:18:15,684 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2291.823338 2021-02-19 03:18:15,746 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4414.577661 2021-02-19 03:18:16,270 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2470.683158 2021-02-19 03:18:16,278 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3206.886707 2021-02-19 03:18:16,359 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2971.844678 2021-02-19 03:18:16,434 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2812.690055 2021-02-19 03:18:16,799 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2904.269865 2021-02-19 03:18:16,989 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4445.473763 2021-02-19 03:18:17,065 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4425.873613 2021-02-19 03:18:17,167 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2387.799100 2021-02-19 03:18:17,303 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2291.823338 2021-02-19 03:18:17,372 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4414.577661 2021-02-19 03:18:17,950 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3206.886707 2021-02-19 03:18:17,963 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2470.683158 2021-02-19 03:18:18,046 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2971.844678 2021-02-19 03:18:18,088 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2812.690055 2021-02-19 03:18:18,450 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2904.269865 2021-02-19 03:18:18,640 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4445.473763 2021-02-19 03:18:18,697 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4425.873613 2021-02-19 03:18:18,851 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2387.799100 2021-02-19 03:18:18,941 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2291.823338 2021-02-19 03:18:19,006 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4414.577661 2021-02-19 03:18:19,598 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3206.886707 2021-02-19 03:18:19,634 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2470.683158 2021-02-19 03:18:19,711 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2971.844678 2021-02-19 03:18:19,743 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2812.690055 2021-02-19 03:18:20,105 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2904.269865 2021-02-19 03:18:20,286 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4445.473763 2021-02-19 03:18:20,336 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4425.873613 2021-02-19 03:18:20,509 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2387.799100 2021-02-19 03:18:20,625 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2291.823338 2021-02-19 03:18:20,680 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4414.577661 2021-02-19 03:18:21,255 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3206.886707 2021-02-19 03:18:21,279 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2470.683158 2021-02-19 03:18:21,368 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2971.844678 2021-02-19 03:18:21,394 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2812.690055 2021-02-19 03:18:21,732 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2904.269865 2021-02-19 03:18:21,917 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4445.473763 2021-02-19 03:18:22,059 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4425.873613 2021-02-19 03:18:22,157 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2387.799100 2021-02-19 03:18:22,260 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2240.323338 2021-02-19 03:18:22,311 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4832.477661 2021-02-19 03:18:22,927 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3337.186707 2021-02-19 03:18:22,953 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2502.083158 2021-02-19 03:18:23,073 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3077.044678 2021-02-19 03:18:23,092 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2905.390055 2021-02-19 03:18:23,352 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2983.269865 2021-02-19 03:18:23,579 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4801.573763 2021-02-19 03:18:23,680 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4778.473613 2021-02-19 03:18:23,845 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2462.499100 2021-02-19 03:18:23,907 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2240.323338 2021-02-19 03:18:23,950 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4832.477661 2021-02-19 03:18:24,595 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3337.186707 2021-02-19 03:18:24,608 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2502.083158 2021-02-19 03:18:24,770 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2905.390055 2021-02-19 03:18:24,779 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3077.044678 2021-02-19 03:18:25,032 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2983.269865 2021-02-19 03:18:25,200 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4801.573763 2021-02-19 03:18:25,322 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4778.473613 2021-02-19 03:18:25,507 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2486.913107 2021-02-19 03:18:25,573 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2165.039020 2021-02-19 03:18:25,641 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5136.074137 2021-02-19 03:18:26,211 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3417.553477 2021-02-19 03:18:26,322 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2527.929765 2021-02-19 03:18:26,407 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2955.635068 2021-02-19 03:18:26,411 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3084.158879 2021-02-19 03:18:26,678 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3020.948974 2021-02-19 03:18:26,861 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5041.246073 2021-02-19 03:18:26,960 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4977.425863 2021-02-19 03:18:27,204 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2486.913107 2021-02-19 03:18:27,211 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2165.039020 2021-02-19 03:18:27,270 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5136.074137 2021-02-19 03:18:27,884 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3417.553477 2021-02-19 03:18:28,006 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2527.929765 2021-02-19 03:18:28,052 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3084.158879 2021-02-19 03:18:28,062 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2955.635068 2021-02-19 03:18:28,332 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3020.948974 2021-02-19 03:18:28,486 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5041.246073 2021-02-19 03:18:28,596 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4977.425863 2021-02-19 03:18:28,845 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2486.913107 2021-02-19 03:18:28,861 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2165.039020 2021-02-19 03:18:28,914 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5136.074137 2021-02-19 03:18:29,523 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3417.553477 2021-02-19 03:18:29,684 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2527.929765 2021-02-19 03:18:29,717 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3084.158879 2021-02-19 03:18:29,773 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2955.635068 2021-02-19 03:18:29,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3020.948974 2021-02-19 03:18:30,153 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5041.246073 2021-02-19 03:18:30,230 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4977.425863 2021-02-19 03:18:30,483 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2486.913107 2021-02-19 03:18:30,549 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5136.074137 2021-02-19 03:18:30,558 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2165.039020 2021-02-19 03:18:31,177 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3417.553477 2021-02-19 03:18:31,362 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2527.929765 2021-02-19 03:18:31,426 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2955.635068 2021-02-19 03:18:31,434 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3084.158879 2021-02-19 03:18:31,628 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3020.948974 2021-02-19 03:18:31,835 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5041.246073 2021-02-19 03:18:31,905 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4977.425863 2021-02-19 03:18:32,096 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2486.913107 2021-02-19 03:18:32,184 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5136.074137 2021-02-19 03:18:32,213 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2165.039020 2021-02-19 03:18:32,842 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3361.053477 2021-02-19 03:18:33,092 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2495.529765 2021-02-19 03:18:33,096 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2971.558879 2021-02-19 03:18:33,111 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2893.335068 2021-02-19 03:18:33,279 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3004.848974 2021-02-19 03:18:33,497 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4723.146073 2021-02-19 03:18:33,561 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4670.425863 2021-02-19 03:18:33,755 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2403.013107 2021-02-19 03:18:33,834 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4741.674137 2021-02-19 03:18:33,849 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2244.539020 2021-02-19 03:18:34,490 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3361.053477 2021-02-19 03:18:34,740 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2495.529765 2021-02-19 03:18:34,792 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2893.335068 2021-02-19 03:18:34,812 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2971.558879 2021-02-19 03:18:34,913 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3004.848974 2021-02-19 03:18:35,184 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4723.146073 2021-02-19 03:18:35,194 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4670.425863 2021-02-19 03:18:35,382 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2403.013107 2021-02-19 03:18:35,502 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2341.500000 2021-02-19 03:18:35,528 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4346.400000 2021-02-19 03:18:36,107 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3311.900000 2021-02-19 03:18:36,375 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2482.400000 2021-02-19 03:18:36,430 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2816.900000 2021-02-19 03:18:36,493 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2926.300000 2021-02-19 03:18:36,594 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2996.300000 2021-02-19 03:18:36,836 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4436.700000 2021-02-19 03:18:36,861 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4414.700000 2021-02-19 03:18:37,038 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2382.300000 2021-02-19 03:18:37,157 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2341.500000 2021-02-19 03:18:37,180 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4346.400000 2021-02-19 03:18:37,711 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3311.900000 2021-02-19 03:18:38,084 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2816.900000 2021-02-19 03:18:38,091 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2482.400000 2021-02-19 03:18:38,168 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2926.300000 2021-02-19 03:18:38,240 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2996.300000 2021-02-19 03:18:38,473 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4436.700000 2021-02-19 03:18:38,553 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4414.700000 2021-02-19 03:18:38,700 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2382.300000 2021-02-19 03:18:38,848 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2341.500000 2021-02-19 03:18:38,877 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4346.400000 2021-02-19 03:18:39,354 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3311.900000 2021-02-19 03:18:39,756 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2816.900000 2021-02-19 03:18:39,780 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2482.400000 2021-02-19 03:18:39,895 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2926.300000 2021-02-19 03:18:39,914 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2996.300000 2021-02-19 03:18:40,153 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4436.700000 2021-02-19 03:18:40,223 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4414.700000 2021-02-19 03:18:40,374 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2382.300000 2021-02-19 03:18:40,515 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2341.500000 2021-02-19 03:18:40,561 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4346.400000 2021-02-19 03:18:40,971 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3311.900000 2021-02-19 03:18:41,440 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2816.900000 2021-02-19 03:18:41,457 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2482.400000 2021-02-19 03:18:41,532 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2926.300000 2021-02-19 03:18:41,565 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2996.300000 2021-02-19 03:18:41,776 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4436.700000 2021-02-19 03:18:41,839 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4414.700000 2021-02-19 03:18:42,003 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2382.300000 2021-02-19 03:18:42,204 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4346.400000 2021-02-19 03:18:42,210 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2341.500000 2021-02-19 03:18:42,588 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3266.300000 2021-02-19 03:18:43,086 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2775.200000 2021-02-19 03:18:43,124 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2491.100000 2021-02-19 03:18:43,180 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2980.700000 2021-02-19 03:18:43,204 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2907.100000 2021-02-19 03:18:43,404 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4368.300000 2021-02-19 03:18:43,457 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4350.100000 2021-02-19 03:18:43,621 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2417.500000 2021-02-19 03:18:43,839 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4287.600000 2021-02-19 03:18:43,845 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2342.000000 2021-02-19 03:18:44,229 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3266.300000 2021-02-19 03:18:44,740 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2775.200000 2021-02-19 03:18:44,786 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2491.100000 2021-02-19 03:18:44,907 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2980.700000 2021-02-19 03:18:44,926 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2907.100000 2021-02-19 03:18:45,051 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4368.300000 2021-02-19 03:18:45,111 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4350.100000 2021-02-19 03:18:45,286 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2417.500000 2021-02-19 03:18:45,484 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4246.466440 2021-02-19 03:18:45,525 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2319.654204 2021-02-19 03:18:45,888 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3266.300000 2021-02-19 03:18:46,361 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2763.585374 2021-02-19 03:18:46,424 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2495.724693 2021-02-19 03:18:46,548 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2986.756433 2021-02-19 03:18:46,605 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2858.767680 2021-02-19 03:18:46,743 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4318.353274 2021-02-19 03:18:46,769 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4319.450395 2021-02-19 03:18:46,923 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2427.135459 2021-02-19 03:18:47,147 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2319.654204 2021-02-19 03:18:47,178 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4246.466440 2021-02-19 03:18:47,578 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3168.731930 2021-02-19 03:18:48,002 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2763.585374 2021-02-19 03:18:48,069 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2495.724693 2021-02-19 03:18:48,191 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2986.756433 2021-02-19 03:18:48,242 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2858.767680 2021-02-19 03:18:48,401 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4318.353274 2021-02-19 03:18:48,463 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4319.450395 2021-02-19 03:18:48,619 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2427.135459 2021-02-19 03:18:48,795 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2319.654204 2021-02-19 03:18:48,846 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4246.466440 2021-02-19 03:18:49,232 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3168.731930 2021-02-19 03:18:49,665 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2763.585374 2021-02-19 03:18:49,756 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2495.724693 2021-02-19 03:18:49,851 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2986.756433 2021-02-19 03:18:49,884 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2858.767680 2021-02-19 03:18:50,084 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4318.353274 2021-02-19 03:18:50,122 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4319.450395 2021-02-19 03:18:50,273 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2427.135459 2021-02-19 03:18:50,483 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2319.654204 2021-02-19 03:18:50,549 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4246.466440 2021-02-19 03:18:50,884 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3168.731930 2021-02-19 03:18:51,319 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2763.585374 2021-02-19 03:18:51,408 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2495.724693 2021-02-19 03:18:51,510 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2858.767680 2021-02-19 03:18:51,520 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2986.756433 2021-02-19 03:18:51,736 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4318.353274 2021-02-19 03:18:51,819 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4319.450395 2021-02-19 03:18:51,914 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2427.135459 2021-02-19 03:18:52,134 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2319.654204 2021-02-19 03:18:52,167 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4246.466440 2021-02-19 03:18:52,526 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3133.731930 2021-02-19 03:18:53,006 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2736.085374 2021-02-19 03:18:53,076 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2521.224693 2021-02-19 03:18:53,171 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2915.467680 2021-02-19 03:18:53,181 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2929.456433 2021-02-19 03:18:53,479 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4309.753274 2021-02-19 03:18:53,502 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4327.850395 2021-02-19 03:18:53,578 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2419.635459 2021-02-19 03:18:53,801 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2311.654204 2021-02-19 03:18:53,842 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4247.266440 2021-02-19 03:18:54,153 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3133.731930 2021-02-19 03:18:54,632 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2736.085374 2021-02-19 03:18:54,779 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2521.224693 2021-02-19 03:18:54,809 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2915.467680 2021-02-19 03:18:54,878 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2929.456433 2021-02-19 03:18:55,125 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4327.850395 2021-02-19 03:18:55,128 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4309.753274 2021-02-19 03:18:55,213 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2419.635459 2021-02-19 03:18:55,450 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2324.500000 2021-02-19 03:18:55,474 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4255.800000 2021-02-19 03:18:55,772 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3162.000000 2021-02-19 03:18:56,250 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2689.400000 2021-02-19 03:18:56,403 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2531.500000 2021-02-19 03:18:56,457 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2928.000000 2021-02-19 03:18:56,526 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2895.800000 2021-02-19 03:18:56,763 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4322.600000 2021-02-19 03:18:56,842 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4300.100000 2021-02-19 03:18:56,848 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2382.000000 2021-02-19 03:18:57,078 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2324.500000 2021-02-19 03:18:57,117 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4255.800000 2021-02-19 03:18:57,371 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3162.000000 2021-02-19 03:18:57,924 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2689.400000 2021-02-19 03:18:58,032 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2531.500000 2021-02-19 03:18:58,101 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2928.000000 2021-02-19 03:18:58,160 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2895.800000 2021-02-19 03:18:58,413 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4322.600000 2021-02-19 03:18:58,474 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4300.100000 2021-02-19 03:18:58,496 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2382.000000 2021-02-19 03:18:58,710 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2324.500000 2021-02-19 03:18:58,743 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4255.800000 2021-02-19 03:18:59,002 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3162.000000 2021-02-19 03:18:59,536 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2689.400000 2021-02-19 03:18:59,694 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2531.500000 2021-02-19 03:18:59,767 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2928.000000 2021-02-19 03:18:59,809 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2895.800000 2021-02-19 03:19:00,052 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4322.600000 2021-02-19 03:19:00,135 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4300.100000 2021-02-19 03:19:00,145 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2382.000000 2021-02-19 03:19:00,369 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4255.800000 2021-02-19 03:19:00,372 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2324.500000 2021-02-19 03:19:00,627 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3162.000000 2021-02-19 03:19:01,170 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2689.400000 2021-02-19 03:19:01,367 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2531.500000 2021-02-19 03:19:01,430 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2895.800000 2021-02-19 03:19:01,453 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2928.000000 2021-02-19 03:19:01,677 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4322.600000 2021-02-19 03:19:01,786 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4300.100000 2021-02-19 03:19:01,821 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2382.000000 2021-02-19 03:19:02,019 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4255.800000 2021-02-19 03:19:02,036 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2324.500000 2021-02-19 03:19:02,243 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3257.000000 2021-02-19 03:19:02,796 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2682.400000 2021-02-19 03:19:02,999 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2523.300000 2021-02-19 03:19:03,072 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2929.100000 2021-02-19 03:19:03,082 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2931.700000 2021-02-19 03:19:03,315 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4515.600000 2021-02-19 03:19:03,459 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4451.300000 2021-02-19 03:19:03,477 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2373.400000 2021-02-19 03:19:03,713 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2317.500000 2021-02-19 03:19:03,726 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4443.000000 2021-02-19 03:19:03,869 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3257.000000 2021-02-19 03:19:04,404 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2682.400000 2021-02-19 03:19:04,644 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2523.300000 2021-02-19 03:19:04,727 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2929.100000 2021-02-19 03:19:04,789 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2931.700000 2021-02-19 03:19:04,957 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4515.600000 2021-02-19 03:19:05,114 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4451.300000 2021-02-19 03:19:05,142 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2373.400000 2021-02-19 03:19:05,336 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2317.500000 2021-02-19 03:19:05,384 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4443.000000 2021-02-19 03:19:05,542 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3373.011353 2021-02-19 03:19:06,058 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2682.400000 2021-02-19 03:19:06,305 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2529.080124 2021-02-19 03:19:06,378 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2988.151185 2021-02-19 03:19:06,420 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2988.353076 2021-02-19 03:19:06,591 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4823.142843 2021-02-19 03:19:06,749 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4768.836541 2021-02-19 03:19:06,779 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2404.262509 2021-02-19 03:19:06,951 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2320.350505 2021-02-19 03:19:07,092 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4776.636211 2021-02-19 03:19:07,187 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3373.011353 2021-02-19 03:19:07,701 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2709.908873 2021-02-19 03:19:07,948 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2529.080124 2021-02-19 03:19:08,013 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2988.151185 2021-02-19 03:19:08,072 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2988.353076 2021-02-19 03:19:08,232 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4823.142843 2021-02-19 03:19:08,428 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4768.836541 2021-02-19 03:19:08,431 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2404.262509 2021-02-19 03:19:08,581 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2320.350505 2021-02-19 03:19:08,720 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4776.636211 2021-02-19 03:19:08,822 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3373.011353 2021-02-19 03:19:09,319 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2709.908873 2021-02-19 03:19:09,578 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2529.080124 2021-02-19 03:19:09,664 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2988.151185 2021-02-19 03:19:09,710 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2988.353076 2021-02-19 03:19:09,844 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4823.142843 2021-02-19 03:19:10,062 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4768.836541 2021-02-19 03:19:10,085 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2404.262509 2021-02-19 03:19:10,210 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2320.350505 2021-02-19 03:19:10,342 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4776.636211 2021-02-19 03:19:10,436 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3373.011353 2021-02-19 03:19:10,956 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2709.908873 2021-02-19 03:19:11,273 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2529.080124 2021-02-19 03:19:11,355 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2988.151185 2021-02-19 03:19:11,358 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2988.353076 2021-02-19 03:19:11,460 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4823.142843 2021-02-19 03:19:11,693 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4768.836541 2021-02-19 03:19:11,720 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2404.262509 2021-02-19 03:19:11,825 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2320.350505 2021-02-19 03:19:11,964 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4776.636211 2021-02-19 03:19:12,069 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3373.011353 2021-02-19 03:19:12,569 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2800.908873 2021-02-19 03:19:12,903 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2577.580124 2021-02-19 03:19:13,049 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3008.153076 2021-02-19 03:19:13,062 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3041.051185 2021-02-19 03:19:13,088 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5114.142843 2021-02-19 03:19:13,365 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5072.836541 2021-02-19 03:19:13,375 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2496.962509 2021-02-19 03:19:13,447 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2296.850505 2021-02-19 03:19:13,615 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5043.536211 2021-02-19 03:19:13,703 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3456.911353 2021-02-19 03:19:14,213 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2800.908873 2021-02-19 03:19:14,536 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2577.580124 2021-02-19 03:19:14,694 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3008.153076 2021-02-19 03:19:14,740 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5114.142843 2021-02-19 03:19:14,744 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3041.051185 2021-02-19 03:19:15,007 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5072.836541 2021-02-19 03:19:15,022 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2496.962509 2021-02-19 03:19:15,079 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2296.850505 2021-02-19 03:19:15,223 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5043.536211 2021-02-19 03:19:15,325 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3456.911353 2021-02-19 03:19:15,855 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2920.100000 2021-02-19 03:19:16,186 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2649.100000 2021-02-19 03:19:16,328 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2989.900000 2021-02-19 03:19:16,427 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3095.200000 2021-02-19 03:19:16,434 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5252.900000 2021-02-19 03:19:16,644 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5267.800000 2021-02-19 03:19:16,723 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2572.400000 2021-02-19 03:19:16,767 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2212.000000 2021-02-19 03:19:16,858 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5205.800000 2021-02-19 03:19:17,015 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3510.900000 2021-02-19 03:19:17,467 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2920.100000 2021-02-19 03:19:17,812 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2649.100000 2021-02-19 03:19:17,970 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2989.900000 2021-02-19 03:19:18,073 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3095.200000 2021-02-19 03:19:18,085 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5252.900000 2021-02-19 03:19:18,299 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5267.800000 2021-02-19 03:19:18,348 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2572.400000 2021-02-19 03:19:18,387 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2212.000000 2021-02-19 03:19:18,509 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5205.800000 2021-02-19 03:19:18,688 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3510.900000 2021-02-19 03:19:19,099 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2920.100000 2021-02-19 03:19:19,444 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2649.100000 2021-02-19 03:19:19,614 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2989.900000 2021-02-19 03:19:19,759 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5252.900000 2021-02-19 03:19:19,766 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3095.200000 2021-02-19 03:19:19,977 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5267.800000 2021-02-19 03:19:20,013 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2572.400000 2021-02-19 03:19:20,028 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2212.000000 2021-02-19 03:19:20,173 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5205.800000 2021-02-19 03:19:20,331 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3510.900000 2021-02-19 03:19:20,720 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2920.100000 2021-02-19 03:19:21,071 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2649.100000 2021-02-19 03:19:21,298 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2989.900000 2021-02-19 03:19:21,418 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5252.900000 2021-02-19 03:19:21,448 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3095.200000 2021-02-19 03:19:21,644 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5267.800000 2021-02-19 03:19:21,690 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2212.000000 2021-02-19 03:19:21,694 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2572.400000 2021-02-19 03:19:21,790 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5205.800000 2021-02-19 03:19:21,960 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3510.900000 2021-02-19 03:19:22,358 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2950.800000 2021-02-19 03:19:22,680 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2637.200000 2021-02-19 03:19:22,944 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2961.700000 2021-02-19 03:19:23,072 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4980.300000 2021-02-19 03:19:23,114 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3055.800000 2021-02-19 03:19:23,306 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5016.100000 2021-02-19 03:19:23,335 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2183.500000 2021-02-19 03:19:23,358 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2473.800000 2021-02-19 03:19:23,427 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5012.300000 2021-02-19 03:19:23,611 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3395.500000 2021-02-19 03:19:23,960 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2950.800000 2021-02-19 03:19:24,311 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2637.200000 2021-02-19 03:19:24,565 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2961.700000 2021-02-19 03:19:24,727 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4980.300000 2021-02-19 03:19:24,747 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3055.800000 2021-02-19 03:19:25,000 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5016.100000 2021-02-19 03:19:25,026 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2183.500000 2021-02-19 03:19:25,055 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2473.800000 2021-02-19 03:19:25,071 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5012.300000 2021-02-19 03:19:25,234 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3395.500000 2021-02-19 03:19:25,595 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2892.700000 2021-02-19 03:19:25,953 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2637.200000 2021-02-19 03:19:26,224 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2918.300000 2021-02-19 03:19:26,413 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3015.700000 2021-02-19 03:19:26,430 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4645.500000 2021-02-19 03:19:26,664 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4625.000000 2021-02-19 03:19:26,687 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2230.700000 2021-02-19 03:19:26,726 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2389.900000 2021-02-19 03:19:26,736 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4701.500000 2021-02-19 03:19:26,868 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3235.400000 2021-02-19 03:19:27,253 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2892.700000 2021-02-19 03:19:27,578 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2574.500000 2021-02-19 03:19:27,845 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2918.300000 2021-02-19 03:19:28,052 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3015.700000 2021-02-19 03:19:28,085 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4645.500000 2021-02-19 03:19:28,368 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2230.700000 2021-02-19 03:19:28,377 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4625.000000 2021-02-19 03:19:28,398 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2389.900000 2021-02-19 03:19:28,428 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4701.500000 2021-02-19 03:19:28,545 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3235.400000 2021-02-19 03:19:28,918 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2892.700000 2021-02-19 03:19:29,194 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2574.500000 2021-02-19 03:19:29,470 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2918.300000 2021-02-19 03:19:29,701 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3015.700000 2021-02-19 03:19:29,740 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4645.500000 2021-02-19 03:19:30,038 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2230.700000 2021-02-19 03:19:30,059 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4625.000000 2021-02-19 03:19:30,088 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2389.900000 2021-02-19 03:19:30,104 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4701.500000 2021-02-19 03:19:30,187 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3235.400000 2021-02-19 03:19:30,543 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2892.700000 2021-02-19 03:19:30,822 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2574.500000 2021-02-19 03:19:31,104 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2918.300000 2021-02-19 03:19:31,381 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3015.700000 2021-02-19 03:19:31,411 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4645.500000 2021-02-19 03:19:31,690 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2230.700000 2021-02-19 03:19:31,707 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4625.000000 2021-02-19 03:19:31,742 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2389.900000 2021-02-19 03:19:31,766 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4701.500000 2021-02-19 03:19:31,831 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3235.400000 2021-02-19 03:19:32,187 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2892.700000 2021-02-19 03:19:32,444 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2578.100000 2021-02-19 03:19:32,752 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2906.900000 2021-02-19 03:19:33,043 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3032.700000 2021-02-19 03:19:33,069 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4603.100000 2021-02-19 03:19:33,369 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2282.600000 2021-02-19 03:19:33,421 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2386.000000 2021-02-19 03:19:33,440 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4602.000000 2021-02-19 03:19:33,446 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4552.300000 2021-02-19 03:19:33,513 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3234.500000 2021-02-19 03:19:33,836 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2827.800000 2021-02-19 03:19:34,078 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2578.100000 2021-02-19 03:19:34,374 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2906.900000 2021-02-19 03:19:34,710 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3032.700000 2021-02-19 03:19:34,723 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4603.100000 2021-02-19 03:19:35,036 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2282.600000 2021-02-19 03:19:35,059 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2386.000000 2021-02-19 03:19:35,119 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4552.300000 2021-02-19 03:19:35,153 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4602.000000 2021-02-19 03:19:35,170 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3234.500000 2021-02-19 03:19:35,473 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2825.946712 2021-02-19 03:19:35,723 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2622.907575 2021-02-19 03:19:36,003 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2906.900000 2021-02-19 03:19:36,348 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2993.712592 2021-02-19 03:19:36,384 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4631.115131 2021-02-19 03:19:36,723 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2275.026124 2021-02-19 03:19:36,740 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2374.686848 2021-02-19 03:19:36,778 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4544.449310 2021-02-19 03:19:36,808 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4540.153808 2021-02-19 03:19:36,832 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3311.095003 2021-02-19 03:19:37,107 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2825.946712 2021-02-19 03:19:37,352 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2622.907575 2021-02-19 03:19:37,615 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2934.514271 2021-02-19 03:19:38,023 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4631.115131 2021-02-19 03:19:38,039 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2993.712592 2021-02-19 03:19:38,413 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2275.026124 2021-02-19 03:19:38,430 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2374.686848 2021-02-19 03:19:38,457 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4544.449310 2021-02-19 03:19:38,484 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4540.153808 2021-02-19 03:19:38,494 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3311.095003 2021-02-19 03:19:38,744 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2825.946712 2021-02-19 03:19:38,960 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2622.907575 2021-02-19 03:19:39,255 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2934.514271 2021-02-19 03:19:39,684 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2993.712592 2021-02-19 03:19:39,697 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4631.115131 2021-02-19 03:19:40,092 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2374.686848 2021-02-19 03:19:40,134 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2275.026124 2021-02-19 03:19:40,191 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3311.095003 2021-02-19 03:19:40,221 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4544.449310 2021-02-19 03:19:40,221 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4540.153808 2021-02-19 03:19:40,390 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2825.946712 2021-02-19 03:19:40,605 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2622.907575 2021-02-19 03:19:40,897 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2934.514271 2021-02-19 03:19:41,315 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2993.712592 2021-02-19 03:19:41,351 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4631.115131 2021-02-19 03:19:41,753 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2374.686848 2021-02-19 03:19:41,782 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2275.026124 2021-02-19 03:19:41,872 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4544.449310 2021-02-19 03:19:41,880 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3311.095003 2021-02-19 03:19:41,897 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4540.153808 2021-02-19 03:19:42,033 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2825.946712 2021-02-19 03:19:42,253 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2622.907575 2021-02-19 03:19:42,512 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2939.314271 2021-02-19 03:19:42,960 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2956.012592 2021-02-19 03:19:43,012 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4699.215131 2021-02-19 03:19:43,437 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2382.486848 2021-02-19 03:19:43,448 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2246.326124 2021-02-19 03:19:43,565 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4607.849310 2021-02-19 03:19:43,585 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3347.495003 2021-02-19 03:19:43,625 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4589.053808 2021-02-19 03:19:43,691 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2752.646712 2021-02-19 03:19:43,880 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2598.707575 2021-02-19 03:19:44,130 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2939.314271 2021-02-19 03:19:44,638 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2956.012592 2021-02-19 03:19:44,661 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4699.215131 2021-02-19 03:19:45,098 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2382.486848 2021-02-19 03:19:45,109 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2246.326124 2021-02-19 03:19:45,243 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4607.849310 2021-02-19 03:19:45,282 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3347.495003 2021-02-19 03:19:45,299 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4589.053808 2021-02-19 03:19:45,358 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2752.646712 2021-02-19 03:19:45,519 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2539.978594 2021-02-19 03:19:45,743 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2896.029879 2021-02-19 03:19:46,285 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2942.739722 2021-02-19 03:19:46,299 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4754.308963 2021-02-19 03:19:46,750 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2377.255007 2021-02-19 03:19:46,783 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2260.541202 2021-02-19 03:19:46,921 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4698.902661 2021-02-19 03:19:46,950 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4732.616165 2021-02-19 03:19:46,993 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3315.092778 2021-02-19 03:19:47,013 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2648.895519 2021-02-19 03:19:47,171 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2539.978594 2021-02-19 03:19:47,380 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2896.029879 2021-02-19 03:19:47,915 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2942.739722 2021-02-19 03:19:47,936 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4754.308963 2021-02-19 03:19:48,414 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2377.255007 2021-02-19 03:19:48,434 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2260.541202 2021-02-19 03:19:48,607 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4698.902661 2021-02-19 03:19:48,624 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4732.616165 2021-02-19 03:19:48,681 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2648.895519 2021-02-19 03:19:48,694 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3315.092778 2021-02-19 03:19:48,799 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2539.978594 2021-02-19 03:19:49,013 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2896.029879 2021-02-19 03:19:49,608 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2942.739722 2021-02-19 03:19:49,644 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4754.308963 2021-02-19 03:19:50,078 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2377.255007 2021-02-19 03:19:50,130 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2260.541202 2021-02-19 03:19:50,306 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4698.902661 2021-02-19 03:19:50,342 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4732.616165 2021-02-19 03:19:50,378 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3315.092778 2021-02-19 03:19:50,398 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2648.895519 2021-02-19 03:19:50,467 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2539.978594 2021-02-19 03:19:50,664 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2896.029879 2021-02-19 03:19:51,259 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2942.739722 2021-02-19 03:19:51,302 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4754.308963 2021-02-19 03:19:51,743 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2260.541202 2021-02-19 03:19:51,760 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2377.255007 2021-02-19 03:19:51,977 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4698.902661 2021-02-19 03:19:52,007 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4732.616165 2021-02-19 03:19:52,072 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3315.092778 2021-02-19 03:19:52,098 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2648.895519 2021-02-19 03:19:52,115 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2539.978594 2021-02-19 03:19:52,322 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2878.829879 2021-02-19 03:19:52,944 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2975.139722 2021-02-19 03:19:52,986 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4532.008963 2021-02-19 03:19:53,404 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2266.241202 2021-02-19 03:19:53,424 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2409.355007 2021-02-19 03:19:53,638 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4538.302661 2021-02-19 03:19:53,663 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4585.816165 2021-02-19 03:19:53,785 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2550.378594 2021-02-19 03:19:53,788 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2680.395519 2021-02-19 03:19:53,789 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3204.592778 2021-02-19 03:19:53,938 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2878.829879 2021-02-19 03:19:54,585 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2975.139722 2021-02-19 03:19:54,655 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4532.008963 2021-02-19 03:19:55,061 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2266.241202 2021-02-19 03:19:55,112 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2409.355007 2021-02-19 03:19:55,328 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4585.816165 2021-02-19 03:19:55,334 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4538.302661 2021-02-19 03:19:55,469 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2737.599042 2021-02-19 03:19:55,503 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2552.776997 2021-02-19 03:19:55,546 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3158.445687 2021-02-19 03:19:55,592 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2964.769808 2021-02-19 03:19:56,253 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2996.221086 2021-02-19 03:19:56,309 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4373.272843 2021-02-19 03:19:56,726 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2249.606869 2021-02-19 03:19:56,762 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2462.122204 2021-02-19 03:19:57,002 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4436.914696 2021-02-19 03:19:57,019 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4419.846006 2021-02-19 03:19:57,138 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2737.599042 2021-02-19 03:19:57,187 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3158.445687 2021-02-19 03:19:57,196 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2552.776997 2021-02-19 03:19:57,270 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2964.769808 2021-02-19 03:19:57,908 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2996.221086 2021-02-19 03:19:57,979 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4373.272843 2021-02-19 03:19:58,384 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2249.606869 2021-02-19 03:19:58,427 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2462.122204 2021-02-19 03:19:58,677 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4436.914696 2021-02-19 03:19:58,696 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4419.846006 2021-02-19 03:19:58,786 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2737.599042 2021-02-19 03:19:58,841 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3158.445687 2021-02-19 03:19:58,878 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2552.776997 2021-02-19 03:19:58,910 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2964.769808 2021-02-19 03:19:59,519 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2996.221086 2021-02-19 03:19:59,595 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4373.272843 2021-02-19 03:20:00,038 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2249.606869 2021-02-19 03:20:00,107 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2462.122204 2021-02-19 03:20:00,344 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4419.846006 2021-02-19 03:20:00,378 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4436.914696 2021-02-19 03:20:00,443 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2737.599042 2021-02-19 03:20:00,516 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3158.445687 2021-02-19 03:20:00,538 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2552.776997 2021-02-19 03:20:00,598 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2964.769808 2021-02-19 03:20:01,165 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2996.221086 2021-02-19 03:20:01,256 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4373.272843 2021-02-19 03:20:01,648 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2249.606869 2021-02-19 03:20:01,732 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2462.122204 2021-02-19 03:20:01,969 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4419.846006 2021-02-19 03:20:02,029 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4436.914696 2021-02-19 03:20:02,096 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2737.599042 2021-02-19 03:20:02,174 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2552.776997 2021-02-19 03:20:02,210 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3158.445687 2021-02-19 03:20:02,250 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2964.769808 2021-02-19 03:20:02,844 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2920.721086 2021-02-19 03:20:02,904 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4409.572843 2021-02-19 03:20:03,309 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2268.706869 2021-02-19 03:20:03,384 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2430.122204 2021-02-19 03:20:03,611 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4475.746006 2021-02-19 03:20:03,671 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4438.214696 2021-02-19 03:20:03,756 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2814.599042 2021-02-19 03:20:03,881 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3207.445687 2021-02-19 03:20:03,887 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2499.876997 2021-02-19 03:20:03,900 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3013.869808 2021-02-19 03:20:04,496 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2920.721086 2021-02-19 03:20:04,543 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4409.572843 2021-02-19 03:20:04,973 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2268.706869 2021-02-19 03:20:05,079 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2430.122204 2021-02-19 03:20:05,302 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4475.746006 2021-02-19 03:20:05,335 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4438.214696 2021-02-19 03:20:05,420 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2814.599042 2021-02-19 03:20:05,551 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2505.813596 2021-02-19 03:20:05,568 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3198.616471 2021-02-19 03:20:05,572 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2957.278329 2021-02-19 03:20:06,095 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2920.721086 2021-02-19 03:20:06,196 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4401.372919 2021-02-19 03:20:06,605 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2289.168220 2021-02-19 03:20:06,711 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2390.673680 2021-02-19 03:20:06,970 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4459.890241 2021-02-19 03:20:06,994 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4348.286685 2021-02-19 03:20:07,069 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2861.502755 2021-02-19 03:20:07,206 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2505.813596 2021-02-19 03:20:07,224 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3198.616471 2021-02-19 03:20:07,253 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2957.278329 2021-02-19 03:20:07,729 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2894.274712 2021-02-19 03:20:07,832 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4401.372919 2021-02-19 03:20:08,239 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2289.168220 2021-02-19 03:20:08,391 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2390.673680 2021-02-19 03:20:08,641 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4459.890241 2021-02-19 03:20:08,737 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2861.502755 2021-02-19 03:20:08,739 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4348.286685 2021-02-19 03:20:08,857 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2505.813596 2021-02-19 03:20:08,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3198.616471 2021-02-19 03:20:08,927 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2957.278329 2021-02-19 03:20:09,354 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2894.274712 2021-02-19 03:20:09,483 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4401.372919 2021-02-19 03:20:09,871 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2289.168220 2021-02-19 03:20:10,032 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2390.673680 2021-02-19 03:20:10,298 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4459.890241 2021-02-19 03:20:10,381 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2861.502755 2021-02-19 03:20:10,421 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4348.286685 2021-02-19 03:20:10,523 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3198.616471 2021-02-19 03:20:10,584 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2505.813596 2021-02-19 03:20:10,608 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2957.278329 2021-02-19 03:20:11,005 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2894.274712 2021-02-19 03:20:11,134 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4401.372919 2021-02-19 03:20:11,505 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2289.168220 2021-02-19 03:20:11,657 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2390.673680 2021-02-19 03:20:11,954 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4459.890241 2021-02-19 03:20:12,032 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2861.502755 2021-02-19 03:20:12,075 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4348.286685 2021-02-19 03:20:12,193 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3198.616471 2021-02-19 03:20:12,250 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2957.278329 2021-02-19 03:20:12,255 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2505.813596 2021-02-19 03:20:12,628 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2983.474712 2021-02-19 03:20:12,783 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4592.472919 2021-02-19 03:20:13,128 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2286.668220 2021-02-19 03:20:13,276 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2444.473680 2021-02-19 03:20:13,592 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4561.890241 2021-02-19 03:20:13,683 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2810.502755 2021-02-19 03:20:13,719 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4475.986685 2021-02-19 03:20:13,838 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3276.616471 2021-02-19 03:20:13,905 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2614.913596 2021-02-19 03:20:13,921 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2917.878329 2021-02-19 03:20:14,232 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2983.474712 2021-02-19 03:20:14,424 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4592.472919 2021-02-19 03:20:14,759 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2286.668220 2021-02-19 03:20:14,903 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2444.473680 2021-02-19 03:20:15,236 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4561.890241 2021-02-19 03:20:15,342 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2810.502755 2021-02-19 03:20:15,358 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4475.986685 2021-02-19 03:20:15,505 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3372.226709 2021-02-19 03:20:15,545 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2648.578409 2021-02-19 03:20:15,565 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2933.208956 2021-02-19 03:20:15,845 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3045.591004 2021-02-19 03:20:16,058 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4592.472919 2021-02-19 03:20:16,424 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2285.543982 2021-02-19 03:20:16,523 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2479.307397 2021-02-19 03:20:16,908 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4786.527989 2021-02-19 03:20:16,980 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4719.042423 2021-02-19 03:20:16,986 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2811.830468 2021-02-19 03:20:17,191 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3372.226709 2021-02-19 03:20:17,213 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2648.578409 2021-02-19 03:20:17,232 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2933.208956 2021-02-19 03:20:17,502 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3045.591004 2021-02-19 03:20:17,703 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4837.623431 2021-02-19 03:20:18,061 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2285.543982 2021-02-19 03:20:18,164 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2479.307397 2021-02-19 03:20:18,559 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4786.527989 2021-02-19 03:20:18,637 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4719.042423 2021-02-19 03:20:18,658 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2811.830468 2021-02-19 03:20:18,865 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2648.578409 2021-02-19 03:20:18,874 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3372.226709 2021-02-19 03:20:18,900 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2933.208956 2021-02-19 03:20:19,138 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3045.591004 2021-02-19 03:20:19,338 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4837.623431 2021-02-19 03:20:19,703 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2285.543982 2021-02-19 03:20:19,776 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2479.307397 2021-02-19 03:20:20,210 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4786.527989 2021-02-19 03:20:20,331 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2811.830468 2021-02-19 03:20:20,355 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4719.042423 2021-02-19 03:20:20,523 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2648.578409 2021-02-19 03:20:20,556 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3372.226709 2021-02-19 03:20:20,572 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2933.208956 2021-02-19 03:20:20,779 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3045.591004 2021-02-19 03:20:21,005 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4837.623431 2021-02-19 03:20:21,316 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2285.543982 2021-02-19 03:20:21,414 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2479.307397 2021-02-19 03:20:21,855 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4786.527989 2021-02-19 03:20:21,983 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2811.830468 2021-02-19 03:20:22,043 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4719.042423 2021-02-19 03:20:22,160 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2648.578409 2021-02-19 03:20:22,203 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3372.226709 2021-02-19 03:20:22,233 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2933.208956 2021-02-19 03:20:22,411 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2985.991004 2021-02-19 03:20:22,667 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4908.323431 2021-02-19 03:20:22,941 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2259.443982 2021-02-19 03:20:23,033 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2395.207397 2021-02-19 03:20:23,469 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4940.027989 2021-02-19 03:20:23,641 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2888.330468 2021-02-19 03:20:23,693 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4868.342423 2021-02-19 03:20:23,822 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2533.378409 2021-02-19 03:20:23,848 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3299.626709 2021-02-19 03:20:23,903 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3009.508956 2021-02-19 03:20:24,029 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2985.991004 2021-02-19 03:20:24,299 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4908.323431 2021-02-19 03:20:24,609 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2259.443982 2021-02-19 03:20:24,713 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2395.207397 2021-02-19 03:20:25,099 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4940.027989 2021-02-19 03:20:25,338 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4868.342423 2021-02-19 03:20:25,342 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2888.330468 2021-02-19 03:20:25,486 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2484.201921 2021-02-19 03:20:25,535 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3258.656903 2021-02-19 03:20:25,608 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3027.498239 2021-02-19 03:20:25,690 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2930.486795 2021-02-19 03:20:25,940 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4908.323431 2021-02-19 03:20:26,256 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2245.350380 2021-02-19 03:20:26,351 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2371.182993 2021-02-19 03:20:26,724 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4984.889956 2021-02-19 03:20:26,982 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4950.290356 2021-02-19 03:20:27,022 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2912.079032 2021-02-19 03:20:27,160 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2484.201921 2021-02-19 03:20:27,246 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3258.656903 2021-02-19 03:20:27,289 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3027.498239 2021-02-19 03:20:27,351 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2930.486795 2021-02-19 03:20:27,566 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4945.391397 2021-02-19 03:20:27,898 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2245.350380 2021-02-19 03:20:27,996 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2371.182993 2021-02-19 03:20:28,395 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4984.889956 2021-02-19 03:20:28,674 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4950.290356 2021-02-19 03:20:28,693 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2912.079032 2021-02-19 03:20:28,808 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2484.201921 2021-02-19 03:20:28,911 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3258.656903 2021-02-19 03:20:28,921 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3027.498239 2021-02-19 03:20:29,029 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2930.486795 2021-02-19 03:20:29,223 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4945.391397 2021-02-19 03:20:29,526 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2245.350380 2021-02-19 03:20:29,624 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2371.182993 2021-02-19 03:20:30,019 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4984.889956 2021-02-19 03:20:30,298 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4950.290356 2021-02-19 03:20:30,332 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2912.079032 2021-02-19 03:20:30,447 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2484.201921 2021-02-19 03:20:30,601 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3027.498239 2021-02-19 03:20:30,608 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3258.656903 2021-02-19 03:20:30,691 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2930.486795 2021-02-19 03:20:30,852 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4945.391397 2021-02-19 03:20:31,187 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2245.350380 2021-02-19 03:20:31,267 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2371.182993 2021-02-19 03:20:31,653 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4984.889956 2021-02-19 03:20:31,986 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4950.290356 2021-02-19 03:20:31,996 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2912.079032 2021-02-19 03:20:32,122 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2484.201921 2021-02-19 03:20:32,221 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3027.498239 2021-02-19 03:20:32,265 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3258.656903 2021-02-19 03:20:32,378 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2942.986795 2021-02-19 03:20:32,496 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4705.491397 2021-02-19 03:20:32,868 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2248.050380 2021-02-19 03:20:32,904 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2468.482993 2021-02-19 03:20:33,305 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4655.889956 2021-02-19 03:20:33,631 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4695.490356 2021-02-19 03:20:33,637 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2868.079032 2021-02-19 03:20:33,780 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2556.301921 2021-02-19 03:20:33,891 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2939.598239 2021-02-19 03:20:33,930 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3319.656903 2021-02-19 03:20:34,053 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2942.986795 2021-02-19 03:20:34,148 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4705.491397 2021-02-19 03:20:34,509 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2248.050380 2021-02-19 03:20:34,538 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2468.482993 2021-02-19 03:20:34,989 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4655.889956 2021-02-19 03:20:35,293 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4695.490356 2021-02-19 03:20:35,306 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2868.079032 2021-02-19 03:20:35,423 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2556.301921 2021-02-19 03:20:35,598 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2900.500000 2021-02-19 03:20:35,638 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3292.300000 2021-02-19 03:20:35,763 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2963.000000 2021-02-19 03:20:35,809 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4368.600000 2021-02-19 03:20:36,171 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2468.482993 2021-02-19 03:20:36,190 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2248.050380 2021-02-19 03:20:36,621 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4302.100000 2021-02-19 03:20:36,948 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4371.600000 2021-02-19 03:20:36,983 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2812.800000 2021-02-19 03:20:37,062 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2624.900000 2021-02-19 03:20:37,227 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2900.500000 2021-02-19 03:20:37,272 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3292.300000 2021-02-19 03:20:37,434 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2963.000000 2021-02-19 03:20:37,474 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4368.600000 2021-02-19 03:20:37,864 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2266.400000 2021-02-19 03:20:37,894 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2506.600000 2021-02-19 03:20:38,230 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4302.100000 2021-02-19 03:20:38,601 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4371.600000 2021-02-19 03:20:38,625 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2812.800000 2021-02-19 03:20:38,710 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2624.900000 2021-02-19 03:20:38,861 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2900.500000 2021-02-19 03:20:38,940 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3292.300000 2021-02-19 03:20:39,101 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2963.000000 2021-02-19 03:20:39,119 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4368.600000 2021-02-19 03:20:39,516 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2266.400000 2021-02-19 03:20:39,608 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2506.600000 2021-02-19 03:20:39,851 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4302.100000 2021-02-19 03:20:40,244 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4371.600000 2021-02-19 03:20:40,292 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2812.800000 2021-02-19 03:20:40,342 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2624.900000 2021-02-19 03:20:40,502 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2900.500000 2021-02-19 03:20:40,608 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3292.300000 2021-02-19 03:20:40,740 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2963.000000 2021-02-19 03:20:40,769 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4368.600000 2021-02-19 03:20:41,200 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2266.400000 2021-02-19 03:20:41,289 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2506.600000 2021-02-19 03:20:41,502 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4302.100000 2021-02-19 03:20:41,888 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4371.600000 2021-02-19 03:20:41,940 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2812.800000 2021-02-19 03:20:41,979 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2624.900000 2021-02-19 03:20:42,161 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2900.500000 2021-02-19 03:20:42,240 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3292.300000 2021-02-19 03:20:42,397 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4343.200000 2021-02-19 03:20:42,407 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3034.300000 2021-02-19 03:20:42,865 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2260.300000 2021-02-19 03:20:42,936 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2485.600000 2021-02-19 03:20:43,147 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4259.100000 2021-02-19 03:20:43,579 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4342.800000 2021-02-19 03:20:43,661 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2744.300000 2021-02-19 03:20:43,704 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2593.400000 2021-02-19 03:20:43,783 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2956.600000 2021-02-19 03:20:43,944 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3160.100000 2021-02-19 03:20:44,062 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3034.300000 2021-02-19 03:20:44,092 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4343.200000 2021-02-19 03:20:44,493 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2260.300000 2021-02-19 03:20:44,579 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2485.600000 2021-02-19 03:20:44,778 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4259.100000 2021-02-19 03:20:45,246 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4342.800000 2021-02-19 03:20:45,375 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2744.300000 2021-02-19 03:20:45,375 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2593.400000 2021-02-19 03:20:45,473 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2971.100000 2021-02-19 03:20:45,584 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3115.200000 2021-02-19 03:20:45,747 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3077.800000 2021-02-19 03:20:45,759 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4407.500000 2021-02-19 03:20:46,147 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2260.300000 2021-02-19 03:20:46,214 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2485.600000 2021-02-19 03:20:46,398 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4324.900000 2021-02-19 03:20:46,926 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4358.000000 2021-02-19 03:20:47,019 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2709.700000 2021-02-19 03:20:47,075 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2497.600000 2021-02-19 03:20:47,138 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2971.100000 2021-02-19 03:20:47,253 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3115.200000 2021-02-19 03:20:47,408 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4407.500000 2021-02-19 03:20:47,434 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3077.800000 2021-02-19 03:20:47,782 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2208.700000 2021-02-19 03:20:47,869 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2450.400000 2021-02-19 03:20:48,010 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4324.900000 2021-02-19 03:20:48,553 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4358.000000 2021-02-19 03:20:48,657 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2709.700000 2021-02-19 03:20:48,713 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2497.600000 2021-02-19 03:20:48,767 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2971.100000 2021-02-19 03:20:48,878 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3115.200000 2021-02-19 03:20:49,046 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4407.500000 2021-02-19 03:20:49,059 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3077.800000 2021-02-19 03:20:49,434 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2208.700000 2021-02-19 03:20:49,487 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2450.400000 2021-02-19 03:20:49,644 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4324.900000 2021-02-19 03:20:50,196 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4358.000000 2021-02-19 03:20:50,302 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2709.700000 2021-02-19 03:20:50,362 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2497.600000 2021-02-19 03:20:50,426 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2971.100000 2021-02-19 03:20:50,533 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3115.200000 2021-02-19 03:20:50,697 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3077.800000 2021-02-19 03:20:50,706 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4407.500000 2021-02-19 03:20:51,079 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2208.700000 2021-02-19 03:20:51,121 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2450.400000 2021-02-19 03:20:51,332 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4324.900000 2021-02-19 03:20:51,859 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4358.000000 2021-02-19 03:20:51,950 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2709.700000 2021-02-19 03:20:52,043 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2497.600000 2021-02-19 03:20:52,065 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2971.100000 2021-02-19 03:20:52,197 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3115.200000 2021-02-19 03:20:52,345 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3034.200000 2021-02-19 03:20:52,365 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4403.800000 2021-02-19 03:20:52,726 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2228.200000 2021-02-19 03:20:52,756 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2378.400000 2021-02-19 03:20:53,009 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4419.400000 2021-02-19 03:20:53,515 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4377.500000 2021-02-19 03:20:53,568 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2732.200000 2021-02-19 03:20:53,694 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2496.600000 2021-02-19 03:20:53,703 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2979.000000 2021-02-19 03:20:53,848 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3175.500000 2021-02-19 03:20:53,983 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3034.200000 2021-02-19 03:20:54,026 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4403.800000 2021-02-19 03:20:54,369 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2378.400000 2021-02-19 03:20:54,397 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2228.200000 2021-02-19 03:20:54,674 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4419.400000 2021-02-19 03:20:55,211 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4377.500000 2021-02-19 03:20:55,234 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2732.200000 2021-02-19 03:20:55,329 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2496.600000 2021-02-19 03:20:55,355 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2979.000000 2021-02-19 03:20:55,474 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3224.000000 2021-02-19 03:20:55,661 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2984.200000 2021-02-19 03:20:55,710 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4443.000000 2021-02-19 03:20:56,000 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2378.400000 2021-02-19 03:20:56,005 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2228.200000 2021-02-19 03:20:56,288 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4457.700000 2021-02-19 03:20:56,822 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4476.600000 2021-02-19 03:20:56,865 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2770.900000 2021-02-19 03:20:56,961 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2565.000000 2021-02-19 03:20:57,013 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3060.300000 2021-02-19 03:20:57,157 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3224.000000 2021-02-19 03:20:57,292 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2984.200000 2021-02-19 03:20:57,374 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4443.000000 2021-02-19 03:20:57,634 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2335.500000 2021-02-19 03:20:57,640 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2282.000000 2021-02-19 03:20:57,915 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4457.700000 2021-02-19 03:20:58,453 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4476.600000 2021-02-19 03:20:58,516 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2770.900000 2021-02-19 03:20:58,607 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2565.000000 2021-02-19 03:20:58,687 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3060.300000 2021-02-19 03:20:58,788 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3224.000000 2021-02-19 03:20:58,934 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2984.200000 2021-02-19 03:20:59,025 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4443.000000 2021-02-19 03:20:59,279 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2282.000000 2021-02-19 03:20:59,316 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2335.500000 2021-02-19 03:20:59,535 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4457.700000 2021-02-19 03:21:00,117 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4476.600000 2021-02-19 03:21:00,193 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2770.900000 2021-02-19 03:21:00,269 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2565.000000 2021-02-19 03:21:00,334 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3060.300000 2021-02-19 03:21:00,430 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3224.000000 2021-02-19 03:21:00,565 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2984.200000 2021-02-19 03:21:00,674 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4443.000000 2021-02-19 03:21:00,937 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2282.000000 2021-02-19 03:21:01,013 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2335.500000 2021-02-19 03:21:01,151 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4457.700000 2021-02-19 03:21:01,779 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4476.600000 2021-02-19 03:21:01,921 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2770.900000 2021-02-19 03:21:01,924 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2565.000000 2021-02-19 03:21:02,006 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3060.300000 2021-02-19 03:21:02,124 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3224.000000 2021-02-19 03:21:02,197 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2984.200000 2021-02-19 03:21:02,316 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4558.100000 2021-02-19 03:21:02,612 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2281.500000 2021-02-19 03:21:02,625 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2355.500000 2021-02-19 03:21:02,773 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4585.200000 2021-02-19 03:21:03,401 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4570.100000 2021-02-19 03:21:03,585 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2619.300000 2021-02-19 03:21:03,618 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2769.900000 2021-02-19 03:21:03,647 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3093.300000 2021-02-19 03:21:03,783 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3254.000000 2021-02-19 03:21:03,845 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2891.500000 2021-02-19 03:21:03,951 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4558.100000 2021-02-19 03:21:04,233 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2281.500000 2021-02-19 03:21:04,257 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2355.500000 2021-02-19 03:21:04,450 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4585.200000 2021-02-19 03:21:05,026 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4570.100000 2021-02-19 03:21:05,227 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2619.300000 2021-02-19 03:21:05,283 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2769.900000 2021-02-19 03:21:05,315 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3093.300000 2021-02-19 03:21:05,431 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3254.000000 2021-02-19 03:21:05,493 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2852.000000 2021-02-19 03:21:05,575 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4590.300000 2021-02-19 03:21:05,868 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2263.000000 2021-02-19 03:21:05,885 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2393.800000 2021-02-19 03:21:06,095 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4585.200000 2021-02-19 03:21:06,671 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4561.800000 2021-02-19 03:21:06,861 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2648.800000 2021-02-19 03:21:06,926 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2751.100000 2021-02-19 03:21:06,957 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3043.200000 2021-02-19 03:21:07,092 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3273.500000 2021-02-19 03:21:07,165 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2852.000000 2021-02-19 03:21:07,269 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4590.300000 2021-02-19 03:21:07,516 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2263.000000 2021-02-19 03:21:07,540 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2393.800000 2021-02-19 03:21:07,740 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4732.700000 ############################################################ # # Step 4: Rebalance in with Loading of docs # ############################################################ 2021-02-19 03:21:08,148 | infra | INFO | pool-1-thread-19 | [task:start_task:84] Thread 'Rebalance_task_IN=[172.23.110.69]_OUT=[]_1613733668.1' started 2021-02-19 03:21:08,148 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[172.23.110.69]_OUT=[]_1613733668.1 2021-02-19 03:21:08,154 | test | DEBUG | pool-1-thread-19 | [rest_client:add_node:1103] Adding remote node 172.23.110.69:8091 to cluster 172.23.110.64:8091 2021-02-19 03:21:08,170 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L899 2021-02-19 03:21:08,170 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 30 seconds. Reason: Let the rebalance begin! 2021-02-19 03:21:08,299 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4561.800000 2021-02-19 03:21:08,532 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2648.800000 2021-02-19 03:21:08,644 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2751.100000 2021-02-19 03:21:08,644 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3043.200000 2021-02-19 03:21:08,767 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3273.500000 2021-02-19 03:21:08,802 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2852.000000 2021-02-19 03:21:08,924 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4590.300000 2021-02-19 03:21:09,186 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2393.800000 2021-02-19 03:21:09,191 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2263.000000 2021-02-19 03:21:09,392 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4732.700000 2021-02-19 03:21:09,921 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4561.800000 2021-02-19 03:21:10,174 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2648.800000 2021-02-19 03:21:10,338 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3043.200000 2021-02-19 03:21:10,351 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2751.100000 2021-02-19 03:21:10,417 | test | DEBUG | pool-1-thread-19 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': '', 'user': 'Administrator'} 2021-02-19 03:21:10,448 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3273.500000 2021-02-19 03:21:10,457 | test | DEBUG | pool-1-thread-19 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 03:21:10,463 | test | INFO | pool-1-thread-19 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+---------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 17.4547036616 | Cluster node | | 172.23.110.65 | kv | 7.0.0-4498-enterprise | 17.437078005 | Cluster node | | 172.23.110.69 | None | | | <--- IN --- | +---------------+----------+-----------------------+---------------+--------------+ 2021-02-19 03:21:10,477 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 03:21:10,477 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 03:21:10,502 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2852.000000 2021-02-19 03:21:10,592 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4590.300000 2021-02-19 03:21:10,828 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2393.800000 2021-02-19 03:21:10,858 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2263.000000 2021-02-19 03:21:11,023 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4732.700000 2021-02-19 03:21:11,559 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4561.800000 2021-02-19 03:21:11,792 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2648.800000 2021-02-19 03:21:11,963 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3043.200000 2021-02-19 03:21:11,993 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2751.100000 2021-02-19 03:21:12,130 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2852.000000 2021-02-19 03:21:12,140 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3273.500000 2021-02-19 03:21:12,278 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4590.300000 2021-02-19 03:21:12,466 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2448.300000 2021-02-19 03:21:12,523 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2242.000000 2021-02-19 03:21:12,687 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4640.100000 2021-02-19 03:21:13,213 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4476.700000 2021-02-19 03:21:13,424 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2606.800000 2021-02-19 03:21:13,644 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2758.500000 2021-02-19 03:21:13,658 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2937.700000 2021-02-19 03:21:13,756 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2915.000000 2021-02-19 03:21:13,782 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3277.000000 2021-02-19 03:21:13,914 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4517.500000 2021-02-19 03:21:14,118 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2448.300000 2021-02-19 03:21:14,144 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2242.000000 2021-02-19 03:21:14,319 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4640.100000 2021-02-19 03:21:14,858 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4476.700000 2021-02-19 03:21:15,042 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2606.800000 2021-02-19 03:21:15,290 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2937.700000 2021-02-19 03:21:15,338 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2758.500000 2021-02-19 03:21:15,427 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3208.400000 2021-02-19 03:21:15,457 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2907.300000 2021-02-19 03:21:15,572 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4457.900000 2021-02-19 03:21:15,586 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.49 % 2021-02-19 03:21:15,586 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 0.492036384476 2021-02-19 03:21:15,740 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2430.700000 2021-02-19 03:21:15,769 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2176.600000 2021-02-19 03:21:15,980 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4467.800000 2021-02-19 03:21:16,477 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4434.700000 2021-02-19 03:21:16,694 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2517.800000 2021-02-19 03:21:16,913 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2818.800000 2021-02-19 03:21:16,993 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2708.600000 2021-02-19 03:21:17,084 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3208.400000 2021-02-19 03:21:17,111 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2907.300000 2021-02-19 03:21:17,220 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4457.900000 2021-02-19 03:21:17,434 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2430.700000 2021-02-19 03:21:17,436 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2176.600000 2021-02-19 03:21:17,604 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4467.800000 2021-02-19 03:21:18,105 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4434.700000 2021-02-19 03:21:18,323 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2517.800000 2021-02-19 03:21:18,553 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2818.800000 2021-02-19 03:21:18,622 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2708.600000 2021-02-19 03:21:18,732 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3208.400000 2021-02-19 03:21:18,756 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2907.300000 2021-02-19 03:21:18,868 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4457.900000 2021-02-19 03:21:19,091 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2176.600000 2021-02-19 03:21:19,105 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2430.700000 2021-02-19 03:21:19,233 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4467.800000 2021-02-19 03:21:19,767 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4434.700000 2021-02-19 03:21:19,960 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2517.800000 2021-02-19 03:21:20,213 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2818.800000 2021-02-19 03:21:20,275 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2708.600000 2021-02-19 03:21:20,372 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3208.400000 2021-02-19 03:21:20,394 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2907.300000 2021-02-19 03:21:20,505 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4457.900000 2021-02-19 03:21:20,654 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 1.48 % 2021-02-19 03:21:20,654 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 1.47609637552 2021-02-19 03:21:20,721 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2176.600000 2021-02-19 03:21:20,750 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2430.700000 2021-02-19 03:21:20,905 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4467.800000 2021-02-19 03:21:21,404 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4434.700000 2021-02-19 03:21:21,608 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2517.800000 2021-02-19 03:21:21,848 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2818.800000 2021-02-19 03:21:21,928 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2708.600000 2021-02-19 03:21:22,020 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3208.400000 2021-02-19 03:21:22,039 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2907.300000 2021-02-19 03:21:22,128 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4457.900000 2021-02-19 03:21:22,352 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2155.600000 2021-02-19 03:21:22,361 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2308.000000 2021-02-19 03:21:22,538 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4220.000000 2021-02-19 03:21:23,026 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4529.000000 2021-02-19 03:21:23,209 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2508.200000 2021-02-19 03:21:23,480 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2830.200000 2021-02-19 03:21:23,588 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2687.300000 2021-02-19 03:21:23,690 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3169.900000 2021-02-19 03:21:23,700 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2855.900000 2021-02-19 03:21:23,783 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4514.300000 2021-02-19 03:21:24,003 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2155.600000 2021-02-19 03:21:24,019 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2308.000000 2021-02-19 03:21:24,180 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4220.000000 2021-02-19 03:21:24,648 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4529.000000 2021-02-19 03:21:24,815 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2508.200000 2021-02-19 03:21:25,124 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2830.200000 2021-02-19 03:21:25,230 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2687.300000 2021-02-19 03:21:25,322 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3169.900000 2021-02-19 03:21:25,341 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2855.900000 2021-02-19 03:21:25,427 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4514.300000 2021-02-19 03:21:25,641 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2322.800000 2021-02-19 03:21:25,641 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2234.400000 2021-02-19 03:21:25,717 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 2.41 % 2021-02-19 03:21:25,717 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 2.41447521135 2021-02-19 03:21:25,835 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3936.600000 2021-02-19 03:21:26,250 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4798.900000 2021-02-19 03:21:26,438 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2572.700000 2021-02-19 03:21:26,746 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2979.000000 2021-02-19 03:21:26,872 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2817.400000 2021-02-19 03:21:26,980 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3305.600000 2021-02-19 03:21:26,994 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2901.800000 2021-02-19 03:21:27,056 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4732.600000 2021-02-19 03:21:27,301 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2322.800000 2021-02-19 03:21:27,309 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2234.400000 2021-02-19 03:21:27,513 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3936.600000 2021-02-19 03:21:27,926 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4798.900000 2021-02-19 03:21:28,075 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2572.700000 2021-02-19 03:21:28,380 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2979.000000 2021-02-19 03:21:28,507 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2817.400000 2021-02-19 03:21:28,621 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2901.800000 2021-02-19 03:21:28,660 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3305.600000 2021-02-19 03:21:28,743 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4732.600000 2021-02-19 03:21:28,948 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2322.800000 2021-02-19 03:21:28,967 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2234.400000 2021-02-19 03:21:29,137 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3936.600000 2021-02-19 03:21:29,551 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4798.900000 2021-02-19 03:21:29,710 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2572.700000 2021-02-19 03:21:30,010 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2979.000000 2021-02-19 03:21:30,148 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2817.400000 2021-02-19 03:21:30,290 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3305.600000 2021-02-19 03:21:30,318 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2901.800000 2021-02-19 03:21:30,421 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4732.600000 2021-02-19 03:21:30,599 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2322.800000 2021-02-19 03:21:30,628 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2234.400000 2021-02-19 03:21:30,753 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4132.400000 2021-02-19 03:21:30,776 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 3.30 % 2021-02-19 03:21:30,776 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 3.29751869998 2021-02-19 03:21:31,197 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4798.900000 2021-02-19 03:21:31,342 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2572.700000 2021-02-19 03:21:31,641 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2979.000000 2021-02-19 03:21:31,805 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2817.400000 2021-02-19 03:21:31,913 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3305.600000 2021-02-19 03:21:31,966 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2901.800000 2021-02-19 03:21:32,066 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4732.600000 2021-02-19 03:21:32,249 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2322.800000 2021-02-19 03:21:32,262 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2298.900000 2021-02-19 03:21:32,421 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3765.100000 2021-02-19 03:21:32,842 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5122.800000 2021-02-19 03:21:33,030 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2605.800000 2021-02-19 03:21:33,263 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3076.200000 2021-02-19 03:21:33,460 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2929.000000 2021-02-19 03:21:33,578 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3542.600000 2021-02-19 03:21:33,671 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3101.700000 2021-02-19 03:21:33,762 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4976.700000 2021-02-19 03:21:33,877 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2504.900000 2021-02-19 03:21:33,904 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2298.900000 2021-02-19 03:21:34,098 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3765.100000 2021-02-19 03:21:34,482 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5122.800000 2021-02-19 03:21:34,654 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2605.800000 2021-02-19 03:21:34,908 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3076.200000 2021-02-19 03:21:35,081 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2929.000000 2021-02-19 03:21:35,207 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3542.600000 2021-02-19 03:21:35,345 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3101.700000 2021-02-19 03:21:35,415 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4976.700000 2021-02-19 03:21:35,555 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2587.800000 2021-02-19 03:21:35,568 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2323.100000 2021-02-19 03:21:35,716 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3351.200000 2021-02-19 03:21:35,823 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 4.32 % 2021-02-19 03:21:35,823 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 4.31744013933 2021-02-19 03:21:36,131 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5122.800000 2021-02-19 03:21:36,311 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2632.200000 2021-02-19 03:21:36,555 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3132.700000 2021-02-19 03:21:36,723 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2912.800000 2021-02-19 03:21:36,848 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3696.500000 2021-02-19 03:21:36,969 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3247.000000 2021-02-19 03:21:37,101 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5017.600000 2021-02-19 03:21:37,213 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2323.100000 2021-02-19 03:21:37,239 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2587.800000 2021-02-19 03:21:37,377 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3351.200000 2021-02-19 03:21:37,799 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5223.000000 2021-02-19 03:21:37,940 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2632.200000 2021-02-19 03:21:38,171 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3132.700000 2021-02-19 03:21:38,207 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 4.71 % 2021-02-19 03:21:38,223 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:21:38,223 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:21:38,352 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2912.800000 2021-02-19 03:21:38,466 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3696.500000 2021-02-19 03:21:38,601 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3247.000000 2021-02-19 03:21:38,750 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5017.600000 2021-02-19 03:21:38,842 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2323.100000 2021-02-19 03:21:38,890 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2587.800000 2021-02-19 03:21:39,007 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3351.200000 2021-02-19 03:21:39,415 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5223.000000 2021-02-19 03:21:39,561 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2632.200000 2021-02-19 03:21:39,822 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3132.700000 2021-02-19 03:21:40,016 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2912.800000 2021-02-19 03:21:40,114 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3696.500000 2021-02-19 03:21:40,256 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3247.000000 2021-02-19 03:21:40,385 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5017.600000 2021-02-19 03:21:40,482 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2323.100000 2021-02-19 03:21:40,545 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2587.800000 2021-02-19 03:21:40,654 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3525.700000 2021-02-19 03:21:40,874 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 5.28 % 2021-02-19 03:21:40,875 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 5.27545838899 2021-02-19 03:21:41,055 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5223.000000 2021-02-19 03:21:41,190 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2632.200000 2021-02-19 03:21:41,480 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3132.700000 2021-02-19 03:21:41,723 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2912.800000 2021-02-19 03:21:41,755 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3696.500000 2021-02-19 03:21:41,973 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3247.000000 2021-02-19 03:21:42,045 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5017.600000 2021-02-19 03:21:42,168 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2323.100000 2021-02-19 03:21:42,253 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2587.800000 2021-02-19 03:21:42,282 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3202.300000 2021-02-19 03:21:42,694 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5133.600000 2021-02-19 03:21:42,822 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2617.400000 2021-02-19 03:21:43,157 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3207.100000 2021-02-19 03:21:43,437 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2946.900000 2021-02-19 03:21:43,486 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3660.000000 2021-02-19 03:21:43,663 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3178.400000 2021-02-19 03:21:43,710 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4857.900000 2021-02-19 03:21:43,832 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2262.100000 2021-02-19 03:21:43,888 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2568.200000 2021-02-19 03:21:43,917 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3202.300000 2021-02-19 03:21:44,309 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5133.600000 2021-02-19 03:21:44,450 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2617.400000 2021-02-19 03:21:44,801 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3207.100000 2021-02-19 03:21:45,052 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2946.900000 2021-02-19 03:21:45,122 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3660.000000 2021-02-19 03:21:45,299 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3178.400000 2021-02-19 03:21:45,342 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4857.900000 2021-02-19 03:21:45,546 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2217.400000 2021-02-19 03:21:45,594 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2939.100000 2021-02-19 03:21:45,604 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2556.400000 2021-02-19 03:21:45,934 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 6.25 % 2021-02-19 03:21:45,934 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 6.25292520589 2021-02-19 03:21:45,944 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5012.600000 2021-02-19 03:21:46,068 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2617.400000 2021-02-19 03:21:46,443 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3170.000000 2021-02-19 03:21:46,700 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3020.900000 2021-02-19 03:21:46,740 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3559.000000 2021-02-19 03:21:46,927 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3097.700000 2021-02-19 03:21:46,964 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4679.100000 2021-02-19 03:21:47,177 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2217.400000 2021-02-19 03:21:47,233 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2939.100000 2021-02-19 03:21:47,243 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2556.400000 2021-02-19 03:21:47,591 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5012.600000 2021-02-19 03:21:47,691 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2579.600000 2021-02-19 03:21:48,065 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3170.000000 2021-02-19 03:21:48,243 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 6.69 % 2021-02-19 03:21:48,256 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:21:48,257 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:21:48,371 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3020.900000 2021-02-19 03:21:48,401 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3559.000000 2021-02-19 03:21:48,595 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3097.700000 2021-02-19 03:21:48,608 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4679.100000 2021-02-19 03:21:48,819 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2217.400000 2021-02-19 03:21:48,888 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2939.100000 2021-02-19 03:21:48,918 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2556.400000 2021-02-19 03:21:49,211 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5012.600000 2021-02-19 03:21:49,328 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2579.600000 2021-02-19 03:21:49,713 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3170.000000 2021-02-19 03:21:50,023 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3020.900000 2021-02-19 03:21:50,028 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3559.000000 2021-02-19 03:21:50,223 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3097.700000 2021-02-19 03:21:50,262 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4679.100000 2021-02-19 03:21:50,459 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2217.400000 2021-02-19 03:21:50,571 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3054.700000 2021-02-19 03:21:50,592 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2556.400000 2021-02-19 03:21:50,835 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5012.600000 2021-02-19 03:21:50,980 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2579.600000 2021-02-19 03:21:51,013 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 7.18 % 2021-02-19 03:21:51,013 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 7.18486367935 2021-02-19 03:21:51,322 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3170.000000 2021-02-19 03:21:51,634 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3020.900000 2021-02-19 03:21:51,673 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3559.000000 2021-02-19 03:21:51,845 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3097.700000 2021-02-19 03:21:51,895 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4679.100000 2021-02-19 03:21:52,105 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2217.400000 2021-02-19 03:21:52,244 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3054.700000 2021-02-19 03:21:52,246 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2556.400000 2021-02-19 03:21:52,473 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4917.100000 2021-02-19 03:21:52,601 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2650.500000 2021-02-19 03:21:52,947 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3148.500000 2021-02-19 03:21:53,269 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3056.200000 2021-02-19 03:21:53,325 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3533.500000 2021-02-19 03:21:53,503 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3051.800000 2021-02-19 03:21:53,520 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4591.500000 2021-02-19 03:21:53,736 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2341.900000 2021-02-19 03:21:53,898 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2523.100000 2021-02-19 03:21:53,930 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2812.500000 2021-02-19 03:21:54,094 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4917.100000 2021-02-19 03:21:54,253 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2650.500000 2021-02-19 03:21:54,563 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3148.500000 2021-02-19 03:21:54,926 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3056.200000 2021-02-19 03:21:54,971 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3533.500000 2021-02-19 03:21:55,176 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3051.800000 2021-02-19 03:21:55,213 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4591.500000 2021-02-19 03:21:55,398 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2341.900000 2021-02-19 03:21:55,539 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2506.613580 2021-02-19 03:21:55,591 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2615.934998 2021-02-19 03:21:55,726 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5059.388917 2021-02-19 03:21:55,878 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2724.754219 2021-02-19 03:21:56,062 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.19 % 2021-02-19 03:21:56,062 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 8.18514559278 2021-02-19 03:21:56,190 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3148.500000 2021-02-19 03:21:56,589 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3087.579531 2021-02-19 03:21:56,627 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3601.261358 2021-02-19 03:21:56,846 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4706.080979 2021-02-19 03:21:56,854 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3021.929106 2021-02-19 03:21:57,043 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2415.208687 2021-02-19 03:21:57,178 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2506.613580 2021-02-19 03:21:57,239 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2615.934998 2021-02-19 03:21:57,358 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5059.388917 2021-02-19 03:21:57,520 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2724.754219 2021-02-19 03:21:57,811 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3266.895157 2021-02-19 03:21:58,223 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3087.579531 2021-02-19 03:21:58,285 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3601.261358 2021-02-19 03:21:58,325 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.58 % 2021-02-19 03:21:58,346 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:21:58,348 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:21:58,526 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4706.080979 2021-02-19 03:21:58,542 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3021.929106 2021-02-19 03:21:58,694 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2415.208687 2021-02-19 03:21:58,865 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2506.613580 2021-02-19 03:21:58,874 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2615.934998 2021-02-19 03:21:59,007 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5059.388917 2021-02-19 03:21:59,158 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2724.754219 2021-02-19 03:21:59,434 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3266.895157 2021-02-19 03:21:59,871 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3087.579531 2021-02-19 03:21:59,914 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3601.261358 2021-02-19 03:22:00,246 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3021.929106 2021-02-19 03:22:00,279 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4706.080979 2021-02-19 03:22:00,338 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2415.208687 2021-02-19 03:22:00,497 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2506.613580 2021-02-19 03:22:00,515 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2809.934998 2021-02-19 03:22:00,674 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5059.388917 2021-02-19 03:22:00,826 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2724.754219 2021-02-19 03:22:01,035 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3266.895157 2021-02-19 03:22:01,115 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.15 % 2021-02-19 03:22:01,115 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 9.14968072278 2021-02-19 03:22:01,516 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3087.579531 2021-02-19 03:22:01,562 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3601.261358 2021-02-19 03:22:01,871 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3021.929106 2021-02-19 03:22:01,904 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4706.080979 2021-02-19 03:22:02,019 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2415.208687 2021-02-19 03:22:02,173 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2506.613580 2021-02-19 03:22:02,187 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2809.934998 2021-02-19 03:22:02,311 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5230.888917 2021-02-19 03:22:02,440 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2744.954219 2021-02-19 03:22:02,650 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3282.595157 2021-02-19 03:22:03,141 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3041.879531 2021-02-19 03:22:03,174 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3644.961358 2021-02-19 03:22:03,500 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3041.529106 2021-02-19 03:22:03,542 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4782.280979 2021-02-19 03:22:03,686 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2333.608687 2021-02-19 03:22:03,844 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2566.613580 2021-02-19 03:22:03,851 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2677.334998 2021-02-19 03:22:03,963 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5230.888917 2021-02-19 03:22:04,065 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2744.954219 2021-02-19 03:22:04,283 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3282.595157 2021-02-19 03:22:04,773 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3041.879531 2021-02-19 03:22:04,802 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3644.961358 2021-02-19 03:22:05,141 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3041.529106 2021-02-19 03:22:05,213 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4782.280979 2021-02-19 03:22:05,328 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2333.608687 2021-02-19 03:22:05,487 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2600.637456 2021-02-19 03:22:05,502 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2498.997496 2021-02-19 03:22:05,640 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5261.156485 2021-02-19 03:22:05,713 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2745.146069 2021-02-19 03:22:05,894 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3176.145168 2021-02-19 03:22:06,198 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 10.00 % 2021-02-19 03:22:06,198 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 10.0 2021-02-19 03:22:06,418 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2982.631597 2021-02-19 03:22:06,470 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3663.466400 2021-02-19 03:22:06,779 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3076.923986 2021-02-19 03:22:06,875 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4690.281022 2021-02-19 03:22:06,973 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2310.656885 2021-02-19 03:22:07,114 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2600.637456 2021-02-19 03:22:07,158 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2498.997496 2021-02-19 03:22:07,279 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5261.156485 2021-02-19 03:22:07,364 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2745.146069 2021-02-19 03:22:07,556 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3176.145168 2021-02-19 03:22:08,094 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2982.631597 2021-02-19 03:22:08,115 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3663.466400 2021-02-19 03:22:08,361 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 10.37 % 2021-02-19 03:22:08,378 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:22:08,378 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:22:08,421 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3076.923986 2021-02-19 03:22:08,538 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4690.281022 2021-02-19 03:22:08,612 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2310.656885 2021-02-19 03:22:08,766 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2600.637456 2021-02-19 03:22:08,829 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2498.997496 2021-02-19 03:22:08,901 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5261.156485 2021-02-19 03:22:09,029 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2745.146069 2021-02-19 03:22:09,188 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3176.145168 2021-02-19 03:22:09,732 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2982.631597 2021-02-19 03:22:09,769 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3663.466400 2021-02-19 03:22:10,048 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3076.923986 2021-02-19 03:22:10,178 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4690.281022 2021-02-19 03:22:10,233 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2310.656885 2021-02-19 03:22:10,407 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2600.637456 2021-02-19 03:22:10,469 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2720.397496 2021-02-19 03:22:10,553 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5261.156485 2021-02-19 03:22:10,697 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2745.146069 2021-02-19 03:22:10,822 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3176.145168 2021-02-19 03:22:11,253 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 10.90 % 2021-02-19 03:22:11,255 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 10.902568387 2021-02-19 03:22:11,390 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3663.466400 2021-02-19 03:22:11,407 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2982.631597 2021-02-19 03:22:11,710 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3076.923986 2021-02-19 03:22:11,882 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4690.281022 2021-02-19 03:22:11,946 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2310.656885 2021-02-19 03:22:12,118 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2720.397496 2021-02-19 03:22:12,138 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2600.637456 2021-02-19 03:22:12,219 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5261.156485 2021-02-19 03:22:12,403 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2722.346069 2021-02-19 03:22:12,493 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3096.245168 2021-02-19 03:22:13,089 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3655.066400 2021-02-19 03:22:13,098 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2934.731597 2021-02-19 03:22:13,332 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3101.623986 2021-02-19 03:22:13,523 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4735.981022 2021-02-19 03:22:13,618 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2298.356885 2021-02-19 03:22:13,798 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2513.637456 2021-02-19 03:22:13,812 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3057.097496 2021-02-19 03:22:13,871 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5281.856485 2021-02-19 03:22:14,048 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2722.346069 2021-02-19 03:22:14,127 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3096.245168 2021-02-19 03:22:14,769 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2934.731597 2021-02-19 03:22:14,770 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3655.066400 2021-02-19 03:22:14,980 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3101.623986 2021-02-19 03:22:15,174 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4735.981022 2021-02-19 03:22:15,269 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2298.356885 2021-02-19 03:22:15,490 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2445.800000 2021-02-19 03:22:15,526 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3663.500000 2021-02-19 03:22:15,529 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5094.800000 2021-02-19 03:22:15,700 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2729.900000 2021-02-19 03:22:15,760 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3033.800000 2021-02-19 03:22:16,312 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 11.90 % 2021-02-19 03:22:16,312 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 11.8964226786 2021-02-19 03:22:16,423 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2845.500000 2021-02-19 03:22:16,434 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3536.300000 2021-02-19 03:22:16,621 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3076.100000 2021-02-19 03:22:16,852 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4776.300000 2021-02-19 03:22:16,936 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2172.100000 2021-02-19 03:22:17,137 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2445.800000 2021-02-19 03:22:17,191 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5094.800000 2021-02-19 03:22:17,219 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3663.500000 2021-02-19 03:22:17,423 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2729.900000 2021-02-19 03:22:17,424 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3033.800000 2021-02-19 03:22:18,099 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3536.300000 2021-02-19 03:22:18,118 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2845.500000 2021-02-19 03:22:18,256 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3076.100000 2021-02-19 03:22:18,394 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 12.39 % 2021-02-19 03:22:18,410 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:22:18,410 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:22:18,476 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4776.300000 2021-02-19 03:22:18,601 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2172.100000 2021-02-19 03:22:18,796 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2445.800000 2021-02-19 03:22:18,835 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5094.800000 2021-02-19 03:22:18,928 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3663.500000 2021-02-19 03:22:19,078 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2729.900000 2021-02-19 03:22:19,088 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3033.800000 2021-02-19 03:22:19,775 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3536.300000 2021-02-19 03:22:19,795 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2845.500000 2021-02-19 03:22:19,901 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3076.100000 2021-02-19 03:22:20,128 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4776.300000 2021-02-19 03:22:20,253 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2172.100000 2021-02-19 03:22:20,436 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2445.800000 2021-02-19 03:22:20,506 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5094.800000 2021-02-19 03:22:20,611 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4311.500000 2021-02-19 03:22:20,736 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2729.900000 2021-02-19 03:22:20,802 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3033.800000 2021-02-19 03:22:21,405 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3536.300000 2021-02-19 03:22:21,447 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2845.500000 2021-02-19 03:22:21,476 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 13.08 % 2021-02-19 03:22:21,477 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 13.0824648244 2021-02-19 03:22:21,539 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3076.100000 2021-02-19 03:22:21,782 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4776.300000 2021-02-19 03:22:21,950 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2243.700000 2021-02-19 03:22:22,130 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2445.800000 2021-02-19 03:22:22,191 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5094.800000 2021-02-19 03:22:22,312 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4311.500000 2021-02-19 03:22:22,380 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2653.300000 2021-02-19 03:22:22,430 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2950.300000 2021-02-19 03:22:23,105 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3322.000000 2021-02-19 03:22:23,157 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2731.300000 2021-02-19 03:22:23,181 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2948.000000 2021-02-19 03:22:23,476 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4552.800000 2021-02-19 03:22:23,595 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2107.200000 2021-02-19 03:22:23,798 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2427.300000 2021-02-19 03:22:23,881 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4686.900000 2021-02-19 03:22:23,970 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4520.900000 2021-02-19 03:22:24,078 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2653.300000 2021-02-19 03:22:24,098 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2950.300000 2021-02-19 03:22:24,789 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3322.000000 2021-02-19 03:22:24,799 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2731.300000 2021-02-19 03:22:24,821 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2948.000000 2021-02-19 03:22:25,157 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4552.800000 2021-02-19 03:22:25,257 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2107.200000 2021-02-19 03:22:25,443 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2427.300000 2021-02-19 03:22:25,551 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4468.100000 2021-02-19 03:22:25,670 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4557.300000 2021-02-19 03:22:25,730 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2529.700000 2021-02-19 03:22:25,733 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2928.200000 2021-02-19 03:22:26,437 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3186.800000 2021-02-19 03:22:26,451 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2669.800000 2021-02-19 03:22:26,510 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2841.400000 2021-02-19 03:22:26,538 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 14.25 % 2021-02-19 03:22:26,538 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 14.2489566281 2021-02-19 03:22:26,811 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4382.300000 2021-02-19 03:22:26,875 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1991.300000 2021-02-19 03:22:27,084 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2413.000000 2021-02-19 03:22:27,194 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4468.100000 2021-02-19 03:22:27,299 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4557.300000 2021-02-19 03:22:27,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2529.700000 2021-02-19 03:22:27,380 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2928.200000 2021-02-19 03:22:28,098 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3186.800000 2021-02-19 03:22:28,178 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2841.400000 2021-02-19 03:22:28,180 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2669.800000 2021-02-19 03:22:28,427 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 14.57 % 2021-02-19 03:22:28,441 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:22:28,441 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:22:28,464 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4382.300000 2021-02-19 03:22:28,532 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1991.300000 2021-02-19 03:22:28,749 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2413.000000 2021-02-19 03:22:28,839 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4468.100000 2021-02-19 03:22:28,931 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4557.300000 2021-02-19 03:22:29,000 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2928.200000 2021-02-19 03:22:29,033 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2529.700000 2021-02-19 03:22:29,802 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2841.400000 2021-02-19 03:22:29,811 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2669.800000 2021-02-19 03:22:29,815 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3186.800000 2021-02-19 03:22:30,092 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4382.300000 2021-02-19 03:22:30,168 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1991.300000 2021-02-19 03:22:30,405 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2413.000000 2021-02-19 03:22:30,493 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4468.100000 2021-02-19 03:22:30,585 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4547.800000 2021-02-19 03:22:30,637 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2928.200000 2021-02-19 03:22:30,701 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2529.700000 2021-02-19 03:22:31,453 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2841.400000 2021-02-19 03:22:31,469 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3186.800000 2021-02-19 03:22:31,474 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2669.800000 2021-02-19 03:22:31,598 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 15.26 % 2021-02-19 03:22:31,598 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 15.262412224 2021-02-19 03:22:31,752 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4382.300000 2021-02-19 03:22:31,815 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2112.600000 2021-02-19 03:22:32,072 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2413.000000 2021-02-19 03:22:32,150 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4468.100000 2021-02-19 03:22:32,239 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4547.800000 2021-02-19 03:22:32,312 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2976.100000 2021-02-19 03:22:32,338 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2514.500000 2021-02-19 03:22:33,079 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2868.700000 2021-02-19 03:22:33,154 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3233.300000 2021-02-19 03:22:33,161 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2732.200000 2021-02-19 03:22:33,391 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4383.900000 2021-02-19 03:22:33,447 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2000.400000 2021-02-19 03:22:33,727 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2390.500000 2021-02-19 03:22:33,819 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4461.300000 2021-02-19 03:22:33,915 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4583.700000 2021-02-19 03:22:33,960 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2976.100000 2021-02-19 03:22:34,013 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2514.500000 2021-02-19 03:22:34,713 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2868.700000 2021-02-19 03:22:34,844 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2732.200000 2021-02-19 03:22:34,921 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3233.300000 2021-02-19 03:22:35,048 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4383.900000 2021-02-19 03:22:35,096 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2000.400000 2021-02-19 03:22:35,427 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2390.500000 2021-02-19 03:22:35,483 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4506.500000 2021-02-19 03:22:35,545 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4630.600000 2021-02-19 03:22:35,592 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2978.300000 2021-02-19 03:22:35,644 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2541.500000 2021-02-19 03:22:36,342 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2898.900000 2021-02-19 03:22:36,467 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2801.000000 2021-02-19 03:22:36,578 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3278.200000 2021-02-19 03:22:36,696 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4416.700000 2021-02-19 03:22:36,709 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 16.37 % 2021-02-19 03:22:36,709 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 16.3735431994 2021-02-19 03:22:36,743 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1944.700000 2021-02-19 03:22:37,109 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2364.000000 2021-02-19 03:22:37,142 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4506.500000 2021-02-19 03:22:37,194 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4630.600000 2021-02-19 03:22:37,322 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2978.300000 2021-02-19 03:22:37,342 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2541.500000 2021-02-19 03:22:37,987 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2898.900000 2021-02-19 03:22:38,132 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2801.000000 2021-02-19 03:22:38,221 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3278.200000 2021-02-19 03:22:38,326 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4416.700000 2021-02-19 03:22:38,375 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1944.700000 2021-02-19 03:22:38,457 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 16.76 % 2021-02-19 03:22:38,486 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:22:38,486 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:22:38,750 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2364.000000 2021-02-19 03:22:38,783 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4506.500000 2021-02-19 03:22:38,854 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4630.600000 2021-02-19 03:22:38,960 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2978.300000 2021-02-19 03:22:38,980 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2541.500000 2021-02-19 03:22:39,641 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2898.900000 2021-02-19 03:22:39,792 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2801.000000 2021-02-19 03:22:39,875 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3278.200000 2021-02-19 03:22:39,956 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4416.700000 2021-02-19 03:22:39,989 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2093.100000 2021-02-19 03:22:40,375 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2364.000000 2021-02-19 03:22:40,434 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4506.500000 2021-02-19 03:22:40,536 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4691.000000 2021-02-19 03:22:40,595 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2978.300000 2021-02-19 03:22:40,625 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2541.500000 2021-02-19 03:22:41,278 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2898.900000 2021-02-19 03:22:41,484 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2801.000000 2021-02-19 03:22:41,517 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3278.200000 2021-02-19 03:22:41,615 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4416.700000 2021-02-19 03:22:41,654 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2093.100000 2021-02-19 03:22:41,790 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 17.41 % 2021-02-19 03:22:41,792 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 17.4064345099 2021-02-19 03:22:42,068 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2364.000000 2021-02-19 03:22:42,089 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4506.500000 2021-02-19 03:22:42,184 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4691.000000 2021-02-19 03:22:42,282 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2531.900000 2021-02-19 03:22:42,292 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2978.300000 2021-02-19 03:22:42,920 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2906.900000 2021-02-19 03:22:43,168 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2804.800000 2021-02-19 03:22:43,184 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3284.200000 2021-02-19 03:22:43,285 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4675.800000 2021-02-19 03:22:43,308 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2047.300000 2021-02-19 03:22:43,736 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2358.500000 2021-02-19 03:22:43,766 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4736.400000 2021-02-19 03:22:43,838 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4803.100000 2021-02-19 03:22:43,946 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2955.600000 2021-02-19 03:22:43,950 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2531.900000 2021-02-19 03:22:44,561 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2906.900000 2021-02-19 03:22:44,857 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2804.800000 2021-02-19 03:22:44,881 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3284.200000 2021-02-19 03:22:44,930 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4675.800000 2021-02-19 03:22:44,996 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2047.300000 2021-02-19 03:22:45,388 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2358.500000 2021-02-19 03:22:45,453 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4926.900000 2021-02-19 03:22:45,490 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4896.700000 2021-02-19 03:22:45,605 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2942.000000 2021-02-19 03:22:45,638 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2517.300000 2021-02-19 03:22:46,184 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2906.900000 2021-02-19 03:22:46,483 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2802.200000 2021-02-19 03:22:46,575 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3314.000000 2021-02-19 03:22:46,684 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1977.100000 2021-02-19 03:22:46,686 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4919.100000 2021-02-19 03:22:46,872 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 18.24 % 2021-02-19 03:22:46,874 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 18.2372927409 2021-02-19 03:22:47,039 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2359.000000 2021-02-19 03:22:47,128 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4926.900000 2021-02-19 03:22:47,148 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4896.700000 2021-02-19 03:22:47,275 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2942.000000 2021-02-19 03:22:47,293 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2517.300000 2021-02-19 03:22:47,795 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2928.600000 2021-02-19 03:22:48,115 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2802.200000 2021-02-19 03:22:48,226 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3314.000000 2021-02-19 03:22:48,381 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4919.100000 2021-02-19 03:22:48,401 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1977.100000 2021-02-19 03:22:48,509 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 18.54 % 2021-02-19 03:22:48,523 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:22:48,523 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:22:48,688 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2359.000000 2021-02-19 03:22:48,835 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4926.900000 2021-02-19 03:22:48,871 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4896.700000 2021-02-19 03:22:48,953 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2942.000000 2021-02-19 03:22:48,953 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2517.300000 2021-02-19 03:22:49,427 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2928.600000 2021-02-19 03:22:49,766 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2802.200000 2021-02-19 03:22:49,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3314.000000 2021-02-19 03:22:50,032 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4919.100000 2021-02-19 03:22:50,069 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2099.500000 2021-02-19 03:22:50,372 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2359.000000 2021-02-19 03:22:50,503 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4926.900000 2021-02-19 03:22:50,561 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4894.200000 2021-02-19 03:22:50,621 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2942.000000 2021-02-19 03:22:50,644 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2517.300000 2021-02-19 03:22:51,095 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2928.600000 2021-02-19 03:22:51,417 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2802.200000 2021-02-19 03:22:51,540 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3314.000000 2021-02-19 03:22:51,706 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4919.100000 2021-02-19 03:22:51,734 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2099.500000 2021-02-19 03:22:51,940 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 19.16 % 2021-02-19 03:22:51,940 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 19.162586966 2021-02-19 03:22:52,023 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2359.000000 2021-02-19 03:22:52,193 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4926.900000 2021-02-19 03:22:52,263 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4894.200000 2021-02-19 03:22:52,305 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2557.500000 2021-02-19 03:22:52,315 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2924.000000 2021-02-19 03:22:52,755 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2907.600000 2021-02-19 03:22:53,081 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2800.100000 2021-02-19 03:22:53,217 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3257.500000 2021-02-19 03:22:53,388 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2045.500000 2021-02-19 03:22:53,398 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4690.600000 2021-02-19 03:22:53,668 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2421.000000 2021-02-19 03:22:53,891 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4746.600000 2021-02-19 03:22:53,971 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2557.500000 2021-02-19 03:22:53,999 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4811.700000 2021-02-19 03:22:54,003 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2924.000000 2021-02-19 03:22:54,388 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2907.600000 2021-02-19 03:22:54,711 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2800.100000 2021-02-19 03:22:54,867 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3257.500000 2021-02-19 03:22:55,042 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4690.600000 2021-02-19 03:22:55,046 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2045.500000 2021-02-19 03:22:55,293 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2421.000000 2021-02-19 03:22:55,565 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4522.300000 2021-02-19 03:22:55,661 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2912.000000 2021-02-19 03:22:55,665 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4704.200000 2021-02-19 03:22:55,677 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2617.200000 2021-02-19 03:22:56,023 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2839.000000 2021-02-19 03:22:56,352 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2800.100000 2021-02-19 03:22:56,506 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3219.000000 2021-02-19 03:22:56,677 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1949.200000 2021-02-19 03:22:56,704 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4424.600000 2021-02-19 03:22:56,913 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2455.500000 2021-02-19 03:22:57,061 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 20.00 % 2021-02-19 03:22:57,061 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 20.0 2021-02-19 03:22:57,242 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4522.300000 2021-02-19 03:22:57,331 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2912.000000 2021-02-19 03:22:57,346 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4704.200000 2021-02-19 03:22:57,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2617.200000 2021-02-19 03:22:57,681 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2839.000000 2021-02-19 03:22:57,987 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2785.900000 2021-02-19 03:22:58,184 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3219.000000 2021-02-19 03:22:58,345 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1949.200000 2021-02-19 03:22:58,349 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4424.600000 2021-02-19 03:22:58,551 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 20.19 % 2021-02-19 03:22:58,565 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2455.500000 2021-02-19 03:22:58,573 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:22:58,573 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:22:58,898 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4522.300000 2021-02-19 03:22:59,025 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4704.200000 2021-02-19 03:22:59,046 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2912.000000 2021-02-19 03:22:59,078 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2617.200000 2021-02-19 03:22:59,332 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2839.000000 2021-02-19 03:22:59,641 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2785.900000 2021-02-19 03:22:59,812 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3219.000000 2021-02-19 03:23:00,009 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2078.500000 2021-02-19 03:23:00,022 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4424.600000 2021-02-19 03:23:00,223 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2455.500000 2021-02-19 03:23:00,565 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4522.300000 2021-02-19 03:23:00,726 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4638.400000 2021-02-19 03:23:00,734 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2912.000000 2021-02-19 03:23:00,747 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2617.200000 2021-02-19 03:23:00,964 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2839.000000 2021-02-19 03:23:01,278 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2785.900000 2021-02-19 03:23:01,461 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3219.000000 2021-02-19 03:23:01,684 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2078.500000 2021-02-19 03:23:01,686 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4424.600000 2021-02-19 03:23:01,852 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2455.500000 2021-02-19 03:23:02,124 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 20.93 % 2021-02-19 03:23:02,124 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 20.9319130297 2021-02-19 03:23:02,234 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4522.300000 2021-02-19 03:23:02,398 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2910.100000 2021-02-19 03:23:02,394 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4550.700000 2021-02-19 03:23:02,421 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2614.600000 2021-02-19 03:23:02,614 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2776.000000 2021-02-19 03:23:02,921 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2740.500000 2021-02-19 03:23:03,088 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3284.000000 2021-02-19 03:23:03,344 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2019.800000 2021-02-19 03:23:03,354 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4412.600000 2021-02-19 03:23:03,461 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2427.500000 2021-02-19 03:23:03,884 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4444.700000 2021-02-19 03:23:04,082 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2910.100000 2021-02-19 03:23:04,082 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2614.600000 2021-02-19 03:23:04,137 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4550.700000 2021-02-19 03:23:04,276 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2776.000000 2021-02-19 03:23:04,575 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2740.500000 2021-02-19 03:23:04,721 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3284.000000 2021-02-19 03:23:05,009 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4412.600000 2021-02-19 03:23:05,023 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2019.800000 2021-02-19 03:23:05,096 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2427.500000 2021-02-19 03:23:05,549 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4425.488006 2021-02-19 03:23:05,732 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2900.876862 2021-02-19 03:23:05,746 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2576.858821 2021-02-19 03:23:05,799 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4503.453223 2021-02-19 03:23:05,943 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2821.277111 2021-02-19 03:23:06,216 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2740.500000 2021-02-19 03:23:06,378 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3284.000000 2021-02-19 03:23:06,635 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4441.385307 2021-02-19 03:23:06,788 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2425.891804 2021-02-19 03:23:06,782 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2057.827536 2021-02-19 03:23:07,181 | test | DEBUG | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 21.92 % 2021-02-19 03:23:07,181 | test | INFO | pool-1-thread-19 | [task:check:330] Rebalance - status: running, progress: 21.9192123315 2021-02-19 03:23:07,191 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4425.488006 2021-02-19 03:23:07,381 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2900.876862 2021-02-19 03:23:07,424 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2576.858821 2021-02-19 03:23:07,460 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4503.453223 2021-02-19 03:23:07,562 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2821.277111 2021-02-19 03:23:07,845 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2646.152674 2021-02-19 03:23:08,015 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3322.667416 2021-02-19 03:23:08,265 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4441.385307 2021-02-19 03:23:08,477 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2425.891804 2021-02-19 03:23:08,506 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2057.827536 2021-02-19 03:23:08,575 | test | INFO | MainThread | [rest_client:rebalance_reached:108] Rebalance reached >20.1857347513% in 90.381000042 seconds 2021-02-19 03:23:08,605 | test | DEBUG | MainThread | [rest_client:diag_eval:1363] /diag/eval status on 172.23.110.64:8091: 1 content: true command: ns_orchestrator:needs_rebalance() 2021-02-19 03:23:08,605 | test | INFO | MainThread | [Magma:abort_rebalance:912] Abort rebalance 2021-02-19 03:23:08,845 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4425.488006 2021-02-19 03:23:09,049 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2900.876862 2021-02-19 03:23:09,061 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2576.858821 2021-02-19 03:23:09,096 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L914 2021-02-19 03:23:09,098 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 60 seconds. Reason: Sleep after error introduction 2021-02-19 03:23:09,115 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4503.453223 2021-02-19 03:23:09,196 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2821.277111 2021-02-19 03:23:09,436 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2714.652674 2021-02-19 03:23:09,638 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3322.667416 2021-02-19 03:23:09,884 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4441.385307 2021-02-19 03:23:10,091 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2425.891804 2021-02-19 03:23:10,109 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2057.827536 2021-02-19 03:23:10,486 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4425.488006 2021-02-19 03:23:10,673 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2900.876862 2021-02-19 03:23:10,750 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4539.053223 2021-02-19 03:23:10,707 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2576.858821 2021-02-19 03:23:10,861 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2821.277111 2021-02-19 03:23:11,045 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2714.652674 2021-02-19 03:23:11,296 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3322.667416 2021-02-19 03:23:11,522 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4441.385307 2021-02-19 03:23:11,710 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2425.891804 2021-02-19 03:23:11,736 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2232.527536 2021-02-19 03:23:12,101 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4425.488006 2021-02-19 03:23:12,233 | test | ERROR | pool-1-thread-19 | [rest_client:_rebalance_status_and_progress:1494] {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 03:23:12,381 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1446.276862 2021-02-19 03:23:12,384 | test | ERROR | pool-1-thread-19 | [task:call:242] Expecting , delimiter: line 1 column 57221 (char 57220) 2021-02-19 03:23:12,700 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1363.152674 2021-02-19 03:23:12,832 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1445.777111 2021-02-19 03:23:13,082 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3061.053223 2021-02-19 03:23:13,128 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1282.358821 2021-02-19 03:23:13,144 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1665.167416 2021-02-19 03:23:13,164 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2229.385307 2021-02-19 03:23:13,352 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1216.391804 2021-02-19 03:23:13,430 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1512.627536 2021-02-19 03:23:13,901 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2223.988006 2021-02-19 03:23:13,987 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1446.276862 2021-02-19 03:23:14,302 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1363.152674 2021-02-19 03:23:14,446 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1445.777111 2021-02-19 03:23:14,710 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3061.053223 2021-02-19 03:23:14,736 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1282.358821 2021-02-19 03:23:14,755 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1665.167416 2021-02-19 03:23:14,775 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2229.385307 2021-02-19 03:23:14,986 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1216.391804 2021-02-19 03:23:15,032 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1512.627536 2021-02-19 03:23:15,490 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1373.386693 2021-02-19 03:23:15,575 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 867.433717 2021-02-19 03:23:15,924 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 752.842171 2021-02-19 03:23:16,042 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 818.909455 2021-02-19 03:23:16,322 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3061.053223 2021-02-19 03:23:16,352 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 718.859430 2021-02-19 03:23:16,368 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 951.075538 2021-02-19 03:23:16,378 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1352.176088 2021-02-19 03:23:16,581 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 732.366183 2021-02-19 03:23:16,638 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1227.429865 2021-02-19 03:23:17,141 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1373.386693 2021-02-19 03:23:17,196 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 867.433717 2021-02-19 03:23:17,519 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 752.842171 2021-02-19 03:23:17,680 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 818.909455 2021-02-19 03:23:17,956 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 718.859430 2021-02-19 03:23:17,970 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2526.279390 2021-02-19 03:23:17,986 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 951.075538 2021-02-19 03:23:18,019 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1352.176088 2021-02-19 03:23:18,239 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 732.366183 2021-02-19 03:23:18,259 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1227.429865 2021-02-19 03:23:18,740 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1373.386693 2021-02-19 03:23:18,805 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 867.433717 2021-02-19 03:23:19,115 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 752.842171 2021-02-19 03:23:19,266 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 818.909455 2021-02-19 03:23:19,596 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 951.075538 2021-02-19 03:23:19,608 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 718.859430 2021-02-19 03:23:19,660 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1352.176088 2021-02-19 03:23:19,664 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1193.179390 2021-02-19 03:23:19,842 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 732.366183 2021-02-19 03:23:19,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 577.129865 2021-02-19 03:23:20,341 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1373.386693 2021-02-19 03:23:20,401 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 867.433717 2021-02-19 03:23:20,710 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 702.442171 2021-02-19 03:23:20,848 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 818.909455 2021-02-19 03:23:21,198 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 951.075538 2021-02-19 03:23:21,213 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 718.859430 2021-02-19 03:23:21,267 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1352.176088 2021-02-19 03:23:21,279 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1193.179390 2021-02-19 03:23:21,440 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 732.366183 2021-02-19 03:23:21,509 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 577.129865 2021-02-19 03:23:21,937 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1373.386693 2021-02-19 03:23:21,986 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 867.433717 2021-02-19 03:23:22,288 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 702.442171 2021-02-19 03:23:22,417 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 818.909455 2021-02-19 03:23:22,812 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 951.075538 2021-02-19 03:23:23,242 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 718.859430 2021-02-19 03:23:23,249 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 732.366183 2021-02-19 03:23:23,249 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 618.329865 2021-02-19 03:23:23,250 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1352.176088 2021-02-19 03:23:23,253 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1383.679390 2021-02-19 03:23:23,801 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1373.386693 2021-02-19 03:23:23,825 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 867.433717 2021-02-19 03:23:23,897 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 702.442171 2021-02-19 03:23:24,019 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 818.909455 2021-02-19 03:23:24,392 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 951.075538 2021-02-19 03:23:24,835 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 718.859430 2021-02-19 03:23:24,849 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 618.329865 2021-02-19 03:23:24,861 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1352.176088 2021-02-19 03:23:24,877 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 732.366183 2021-02-19 03:23:24,888 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1383.679390 2021-02-19 03:23:25,391 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1373.386693 2021-02-19 03:23:25,408 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:23:25,500 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 21.200000 2021-02-19 03:23:25,618 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:23:25,970 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.100000 2021-02-19 03:23:26,450 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:23:26,473 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 641.800000 2021-02-19 03:23:26,519 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1509.100000 2021-02-19 03:23:26,519 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:23:26,536 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2.000000 2021-02-19 03:23:26,983 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2.000000 2021-02-19 03:23:27,000 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:23:27,125 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 21.200000 2021-02-19 03:23:27,226 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:23:27,555 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.100000 2021-02-19 03:23:28,055 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:23:28,108 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 641.800000 2021-02-19 03:23:28,148 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1509.100000 2021-02-19 03:23:28,167 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:23:28,196 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2.000000 2021-02-19 03:23:28,611 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2.000000 2021-02-19 03:23:28,615 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:23:28,713 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 21.200000 2021-02-19 03:23:28,826 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:23:29,157 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.100000 2021-02-19 03:23:29,665 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:23:29,743 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1671.800000 2021-02-19 03:23:29,818 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2.000000 2021-02-19 03:23:29,819 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3567.600000 2021-02-19 03:23:29,822 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:23:30,227 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:23:30,230 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2.000000 2021-02-19 03:23:30,334 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 21.200000 2021-02-19 03:23:30,436 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:23:30,770 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.100000 2021-02-19 03:23:31,279 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:23:31,391 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1671.800000 2021-02-19 03:23:31,443 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:23:31,496 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2.000000 2021-02-19 03:23:31,513 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3567.600000 2021-02-19 03:23:31,834 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:23:31,864 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2.000000 2021-02-19 03:23:31,938 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 144.900000 2021-02-19 03:23:32,023 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:23:32,423 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 481.600000 2021-02-19 03:23:32,864 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 03:23:33,144 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2976.600000 2021-02-19 03:23:33,144 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5843.400000 2021-02-19 03:23:33,147 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 161.000000 2021-02-19 03:23:33,220 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 876.000000 2021-02-19 03:23:33,483 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 11.900000 2021-02-19 03:23:33,484 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 810.800000 2021-02-19 03:23:33,581 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1539.800000 2021-02-19 03:23:33,640 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.700000 2021-02-19 03:23:34,017 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 481.600000 2021-02-19 03:23:34,466 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 03:23:34,773 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 161.000000 2021-02-19 03:23:34,815 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5843.400000 2021-02-19 03:23:34,822 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2976.600000 2021-02-19 03:23:34,869 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 876.000000 2021-02-19 03:23:35,108 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 11.900000 2021-02-19 03:23:35,125 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 810.800000 2021-02-19 03:23:35,190 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1539.800000 2021-02-19 03:23:35,368 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.700000 2021-02-19 03:23:35,641 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1477.800000 2021-02-19 03:23:36,071 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 177.100000 2021-02-19 03:23:36,424 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 957.500000 2021-02-19 03:23:36,522 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6990.400000 2021-02-19 03:23:36,555 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2099.000000 2021-02-19 03:23:36,555 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3652.900000 2021-02-19 03:23:36,721 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 424.200000 2021-02-19 03:23:36,790 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2298.900000 2021-02-19 03:23:36,809 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3188.200000 2021-02-19 03:23:36,982 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 294.100000 2021-02-19 03:23:37,252 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1477.800000 2021-02-19 03:23:37,667 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 177.100000 2021-02-19 03:23:38,048 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 957.500000 2021-02-19 03:23:38,186 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6990.400000 2021-02-19 03:23:38,186 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2099.000000 2021-02-19 03:23:38,217 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3652.900000 2021-02-19 03:23:38,365 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 424.200000 2021-02-19 03:23:38,434 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2298.900000 2021-02-19 03:23:38,463 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3188.200000 2021-02-19 03:23:38,586 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 294.100000 2021-02-19 03:23:38,862 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1477.800000 2021-02-19 03:23:39,292 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 177.100000 2021-02-19 03:23:39,742 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 957.500000 2021-02-19 03:23:39,861 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6332.572985 2021-02-19 03:23:39,865 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2099.000000 2021-02-19 03:23:39,890 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3341.432813 2021-02-19 03:23:40,035 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 424.200000 2021-02-19 03:23:40,063 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2298.900000 2021-02-19 03:23:40,198 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 294.100000 2021-02-19 03:23:40,204 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3231.263027 2021-02-19 03:23:40,509 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1477.800000 2021-02-19 03:23:40,921 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 177.100000 2021-02-19 03:23:41,365 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 957.500000 2021-02-19 03:23:41,505 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2099.000000 2021-02-19 03:23:41,530 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6332.572985 2021-02-19 03:23:41,536 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3341.432813 2021-02-19 03:23:41,720 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2298.900000 2021-02-19 03:23:41,753 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 424.200000 2021-02-19 03:23:41,805 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 294.100000 2021-02-19 03:23:41,858 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3231.263027 2021-02-19 03:23:42,131 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1477.800000 2021-02-19 03:23:42,525 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1214.900000 2021-02-19 03:23:43,013 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2887.500000 2021-02-19 03:23:43,211 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2753.632813 2021-02-19 03:23:43,220 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2391.100000 2021-02-19 03:23:43,269 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5365.772985 2021-02-19 03:23:43,338 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3650.800000 2021-02-19 03:23:43,434 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1869.900000 2021-02-19 03:23:43,453 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1603.900000 2021-02-19 03:23:43,496 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3038.263027 2021-02-19 03:23:43,765 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2718.800000 2021-02-19 03:23:44,128 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1214.900000 2021-02-19 03:23:44,598 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2887.500000 2021-02-19 03:23:44,875 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2753.632813 2021-02-19 03:23:44,934 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2391.100000 2021-02-19 03:23:44,964 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5365.772985 2021-02-19 03:23:44,990 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3650.800000 2021-02-19 03:23:45,108 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1869.900000 2021-02-19 03:23:45,135 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1603.900000 2021-02-19 03:23:45,157 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3038.263027 2021-02-19 03:23:45,357 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2718.800000 2021-02-19 03:23:45,736 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2237.720611 2021-02-19 03:23:46,213 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2887.500000 2021-02-19 03:23:46,542 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2354.648349 2021-02-19 03:23:46,591 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2307.872405 2021-02-19 03:23:46,671 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4581.570687 2021-02-19 03:23:46,681 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4236.232021 2021-02-19 03:23:46,759 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2934.770547 2021-02-19 03:23:46,805 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2738.514787 2021-02-19 03:23:46,812 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2588.681301 2021-02-19 03:23:46,999 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3417.974073 2021-02-19 03:23:47,335 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2237.720611 2021-02-19 03:23:47,799 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4124.969428 2021-02-19 03:23:48,220 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2307.872405 2021-02-19 03:23:48,220 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2354.648349 2021-02-19 03:23:48,316 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4581.570687 2021-02-19 03:23:48,312 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4236.232021 2021-02-19 03:23:48,371 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2934.770547 2021-02-19 03:23:48,427 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2738.514787 2021-02-19 03:23:48,444 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2588.681301 2021-02-19 03:23:48,625 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3417.974073 2021-02-19 03:23:48,954 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2237.720611 2021-02-19 03:23:49,447 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4124.969428 2021-02-19 03:23:49,901 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2307.872405 2021-02-19 03:23:49,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2279.067606 2021-02-19 03:23:49,983 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4236.232021 2021-02-19 03:23:50,026 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2934.770547 2021-02-19 03:23:50,028 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4425.493501 2021-02-19 03:23:50,088 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2582.654041 2021-02-19 03:23:50,091 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2738.514787 2021-02-19 03:23:50,259 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3417.974073 2021-02-19 03:23:50,582 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2237.720611 2021-02-19 03:23:51,063 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4124.969428 2021-02-19 03:23:51,565 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2307.872405 2021-02-19 03:23:51,589 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2279.067606 2021-02-19 03:23:51,651 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4236.232021 2021-02-19 03:23:51,690 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2934.770547 2021-02-19 03:23:51,719 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2738.514787 2021-02-19 03:23:51,727 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4425.493501 2021-02-19 03:23:51,759 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2582.654041 2021-02-19 03:23:51,885 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3417.974073 2021-02-19 03:23:52,194 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2237.720611 2021-02-19 03:23:52,690 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4107.969428 2021-02-19 03:23:53,200 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2312.672405 2021-02-19 03:23:53,249 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2279.467606 2021-02-19 03:23:53,286 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4173.732021 2021-02-19 03:23:53,375 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2841.514787 2021-02-19 03:23:53,404 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2982.170547 2021-02-19 03:23:53,417 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2666.254041 2021-02-19 03:23:53,434 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4393.593501 2021-02-19 03:23:53,561 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3371.474073 2021-02-19 03:23:53,803 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2456.820611 2021-02-19 03:23:54,336 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4107.969428 2021-02-19 03:23:54,927 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2279.467606 2021-02-19 03:23:54,940 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2312.672405 2021-02-19 03:23:54,993 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4173.732021 2021-02-19 03:23:55,032 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2982.170547 2021-02-19 03:23:55,098 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2841.514787 2021-02-19 03:23:55,131 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2666.254041 2021-02-19 03:23:55,135 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4393.593501 2021-02-19 03:23:55,180 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3371.474073 2021-02-19 03:23:55,437 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2456.820611 2021-02-19 03:23:55,980 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4149.367831 2021-02-19 03:23:56,581 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2352.163137 2021-02-19 03:23:56,605 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2275.833263 2021-02-19 03:23:56,647 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4179.473146 2021-02-19 03:23:56,667 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3002.747973 2021-02-19 03:23:56,734 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2814.560955 2021-02-19 03:23:56,835 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2683.733225 2021-02-19 03:23:56,862 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3339.897508 2021-02-19 03:23:56,871 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4381.587292 2021-02-19 03:23:57,023 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2535.650335 2021-02-19 03:23:57,612 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4149.367831 2021-02-19 03:23:58,233 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2352.163137 2021-02-19 03:23:58,278 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2275.833263 2021-02-19 03:23:58,312 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4179.473146 2021-02-19 03:23:58,322 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3002.747973 2021-02-19 03:23:58,414 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2814.560955 2021-02-19 03:23:58,503 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3339.897508 2021-02-19 03:23:58,505 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4381.587292 2021-02-19 03:23:58,561 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2683.733225 2021-02-19 03:23:58,658 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2535.650335 2021-02-19 03:23:59,230 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4149.367831 2021-02-19 03:23:59,875 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2352.163137 2021-02-19 03:23:59,954 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2299.681193 2021-02-19 03:23:59,967 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3002.747973 2021-02-19 03:23:59,996 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4179.473146 2021-02-19 03:24:00,059 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2814.560955 2021-02-19 03:24:00,150 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4306.491492 2021-02-19 03:24:00,178 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3339.897508 2021-02-19 03:24:00,226 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2683.733225 2021-02-19 03:24:00,279 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2535.650335 2021-02-19 03:24:00,848 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4149.367831 2021-02-19 03:24:01,516 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2352.163137 2021-02-19 03:24:01,622 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3002.747973 2021-02-19 03:24:01,638 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2299.681193 2021-02-19 03:24:01,648 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4179.473146 2021-02-19 03:24:01,733 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2814.560955 2021-02-19 03:24:01,839 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3339.897508 2021-02-19 03:24:01,878 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4306.491492 2021-02-19 03:24:01,921 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2700.797458 2021-02-19 03:24:01,946 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2535.650335 2021-02-19 03:24:02,493 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4156.367831 2021-02-19 03:24:03,184 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2351.963137 2021-02-19 03:24:03,293 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2951.747973 2021-02-19 03:24:03,308 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4169.573146 2021-02-19 03:24:03,361 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2293.281193 2021-02-19 03:24:03,378 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2785.360955 2021-02-19 03:24:03,450 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3285.097508 2021-02-19 03:24:03,539 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4257.791492 2021-02-19 03:24:03,621 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2470.150335 2021-02-19 03:24:03,651 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2662.797458 2021-02-19 03:24:04,094 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4156.367831 2021-02-19 03:24:04,805 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2351.963137 2021-02-19 03:24:04,904 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2951.747973 2021-02-19 03:24:04,994 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4169.573146 2021-02-19 03:24:05,059 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2785.360955 2021-02-19 03:24:05,107 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3285.097508 2021-02-19 03:24:05,115 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2293.281193 2021-02-19 03:24:05,197 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4257.791492 2021-02-19 03:24:05,239 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2470.150335 2021-02-19 03:24:05,299 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2662.797458 2021-02-19 03:24:05,694 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4185.958017 2021-02-19 03:24:06,417 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2343.730788 2021-02-19 03:24:06,578 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2867.934426 2021-02-19 03:24:06,638 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4187.560296 2021-02-19 03:24:06,700 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2788.738225 2021-02-19 03:24:06,763 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3209.364734 2021-02-19 03:24:06,805 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2290.498361 2021-02-19 03:24:06,864 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4247.430148 2021-02-19 03:24:06,882 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2372.627749 2021-02-19 03:24:06,915 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2633.823830 2021-02-19 03:24:07,312 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4185.958017 2021-02-19 03:24:08,020 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2343.730788 2021-02-19 03:24:08,207 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2867.934426 2021-02-19 03:24:08,269 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4187.560296 2021-02-19 03:24:08,351 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2788.738225 2021-02-19 03:24:08,414 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3209.364734 2021-02-19 03:24:08,463 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2290.498361 2021-02-19 03:24:08,552 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4247.430148 2021-02-19 03:24:08,555 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2372.627749 2021-02-19 03:24:08,585 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2633.823830 2021-02-19 03:24:08,937 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4185.958017 2021-02-19 03:24:09,121 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.69:8091 2021-02-19 03:24:09,121 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 03:24:09,144 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.69:8091 is running 2021-02-19 03:24:09,144 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.0. 2021-02-19 03:24:09,144 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.0. 2021-02-19 03:24:09,144 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.0. 2021-02-19 03:24:09,144 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.0. 2021-02-19 03:24:09,144 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.0. 2021-02-19 03:24:09,144 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.0. 2021-02-19 03:24:09,144 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.0. 2021-02-19 03:24:09,144 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.0. 2021-02-19 03:24:09,144 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.0. 2021-02-19 03:24:09,144 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.0. 2021-02-19 03:24:09,186 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.64:8091 2021-02-19 03:24:09,187 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 03:24:09,214 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.64:8091 is running 2021-02-19 03:24:09,216 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.0. 2021-02-19 03:24:09,216 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.0. 2021-02-19 03:24:09,216 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.0. 2021-02-19 03:24:09,217 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.0. 2021-02-19 03:24:09,217 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.0. 2021-02-19 03:24:09,219 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.0. 2021-02-19 03:24:09,219 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.0. 2021-02-19 03:24:09,219 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.0. 2021-02-19 03:24:09,219 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.0. 2021-02-19 03:24:09,219 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.0. 2021-02-19 03:24:09,266 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.65:8091 2021-02-19 03:24:09,266 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 03:24:09,303 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.65:8091 is running 2021-02-19 03:24:09,303 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.0. 2021-02-19 03:24:09,305 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.0. 2021-02-19 03:24:09,305 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.0. 2021-02-19 03:24:09,305 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.0. 2021-02-19 03:24:09,305 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.0. 2021-02-19 03:24:09,305 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.0. 2021-02-19 03:24:09,305 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.0. 2021-02-19 03:24:09,305 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.0. 2021-02-19 03:24:09,305 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.0. 2021-02-19 03:24:09,305 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.0. 2021-02-19 03:24:09,305 | test | INFO | MainThread | [Magma:abort_rebalance:927] Restarting Rebalance after killing at 20 2021-02-19 03:24:09,371 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[]_OUT=[]_1613733849.31 2021-02-19 03:24:09,374 | infra | INFO | pool-1-thread-20 | [task:start_task:84] Thread 'Rebalance_task_IN=[]_OUT=[]_1613733849.31' started 2021-02-19 03:24:09,403 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L932 2021-02-19 03:24:09,403 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 120 seconds. Reason: Let the rebalance begin after abort 2021-02-19 03:24:09,427 | test | DEBUG | pool-1-thread-20 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': '', 'user': 'Administrator'} 2021-02-19 03:24:09,470 | test | DEBUG | pool-1-thread-20 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 03:24:09,477 | test | INFO | pool-1-thread-20 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+---------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 15.631102058 | Cluster node | | 172.23.110.69 | kv | 7.0.0-4498-enterprise | 4.54659528191 | Cluster node | | 172.23.110.65 | kv | 7.0.0-4498-enterprise | 15.7128633731 | Cluster node | +---------------+----------+-----------------------+---------------+--------------+ 2021-02-19 03:24:09,526 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 03:24:09,528 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 03:24:09,628 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2343.730788 2021-02-19 03:24:09,825 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2867.934426 2021-02-19 03:24:09,927 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4187.560296 2021-02-19 03:24:10,033 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2788.738225 2021-02-19 03:24:10,114 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3209.364734 2021-02-19 03:24:10,151 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2282.198361 2021-02-19 03:24:10,201 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2372.627749 2021-02-19 03:24:10,223 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4247.430148 2021-02-19 03:24:10,267 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2633.823830 2021-02-19 03:24:10,549 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4185.958017 2021-02-19 03:24:11,295 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2343.730788 2021-02-19 03:24:11,436 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2867.934426 2021-02-19 03:24:11,539 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4187.560296 2021-02-19 03:24:11,680 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2788.738225 2021-02-19 03:24:11,782 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2282.198361 2021-02-19 03:24:11,792 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3209.364734 2021-02-19 03:24:11,865 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4306.930148 2021-02-19 03:24:11,891 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2372.627749 2021-02-19 03:24:11,927 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2633.523830 2021-02-19 03:24:12,174 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4185.958017 2021-02-19 03:24:12,966 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2341.030788 2021-02-19 03:24:13,148 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2800.434426 2021-02-19 03:24:13,221 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4244.660296 2021-02-19 03:24:13,369 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2792.438225 2021-02-19 03:24:13,499 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2327.898361 2021-02-19 03:24:13,523 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3224.364734 2021-02-19 03:24:13,608 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4366.230148 2021-02-19 03:24:13,618 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2393.327749 2021-02-19 03:24:13,625 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2648.323830 2021-02-19 03:24:13,851 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4294.458017 2021-02-19 03:24:14,628 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 20.84 % 2021-02-19 03:24:14,628 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 20.8352078082 2021-02-19 03:24:14,645 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2341.030788 2021-02-19 03:24:14,816 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2800.434426 2021-02-19 03:24:14,884 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4244.660296 2021-02-19 03:24:15,036 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2792.438225 2021-02-19 03:24:15,223 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2327.898361 2021-02-19 03:24:15,246 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3224.364734 2021-02-19 03:24:15,289 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2393.327749 2021-02-19 03:24:15,313 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2648.323830 2021-02-19 03:24:15,328 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4366.230148 2021-02-19 03:24:15,513 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4402.580379 2021-02-19 03:24:16,352 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2341.030788 2021-02-19 03:24:16,505 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2828.636795 2021-02-19 03:24:16,592 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4307.157364 2021-02-19 03:24:16,713 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2762.138792 2021-02-19 03:24:16,924 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2356.925312 2021-02-19 03:24:16,951 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3284.527509 2021-02-19 03:24:17,043 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2434.766900 2021-02-19 03:24:17,065 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2633.436695 2021-02-19 03:24:17,072 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4419.483175 2021-02-19 03:24:17,168 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4402.580379 2021-02-19 03:24:18,065 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2347.730404 2021-02-19 03:24:18,217 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2828.636795 2021-02-19 03:24:18,286 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4307.157364 2021-02-19 03:24:18,387 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2762.138792 2021-02-19 03:24:18,671 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2356.925312 2021-02-19 03:24:18,690 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3284.527509 2021-02-19 03:24:18,747 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2434.766900 2021-02-19 03:24:18,776 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2633.436695 2021-02-19 03:24:18,803 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4419.483175 2021-02-19 03:24:18,872 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4402.580379 2021-02-19 03:24:19,680 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 22.14 % 2021-02-19 03:24:19,681 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 22.1365569049 2021-02-19 03:24:19,795 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2347.730404 2021-02-19 03:24:19,930 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2828.636795 2021-02-19 03:24:19,984 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4307.157364 2021-02-19 03:24:20,079 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2762.138792 2021-02-19 03:24:20,437 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3284.527509 2021-02-19 03:24:20,476 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2370.825312 2021-02-19 03:24:20,523 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2631.836695 2021-02-19 03:24:20,545 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2434.766900 2021-02-19 03:24:20,598 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4474.983175 2021-02-19 03:24:20,640 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4402.580379 2021-02-19 03:24:21,492 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2347.730404 2021-02-19 03:24:21,615 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2828.636795 2021-02-19 03:24:21,683 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4307.157364 2021-02-19 03:24:21,778 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2762.138792 2021-02-19 03:24:22,141 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3284.527509 2021-02-19 03:24:22,177 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2370.825312 2021-02-19 03:24:22,213 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2631.836695 2021-02-19 03:24:22,263 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2434.766900 2021-02-19 03:24:22,299 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4606.180379 2021-02-19 03:24:22,312 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4474.983175 2021-02-19 03:24:23,155 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2378.730404 2021-02-19 03:24:23,244 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2860.136795 2021-02-19 03:24:23,335 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4533.857364 2021-02-19 03:24:23,401 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2846.138792 2021-02-19 03:24:23,809 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3380.927509 2021-02-19 03:24:23,865 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2335.325312 2021-02-19 03:24:23,914 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2396.236695 2021-02-19 03:24:23,927 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2472.866900 2021-02-19 03:24:23,960 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4606.180379 2021-02-19 03:24:23,986 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4601.683175 2021-02-19 03:24:24,746 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 23.43 % 2021-02-19 03:24:24,746 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 23.4294294567 2021-02-19 03:24:24,819 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2378.730404 2021-02-19 03:24:24,918 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2860.136795 2021-02-19 03:24:25,010 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4533.857364 2021-02-19 03:24:25,046 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2846.138792 2021-02-19 03:24:25,469 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3380.927509 2021-02-19 03:24:25,549 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2310.140086 2021-02-19 03:24:25,598 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2125.418966 2021-02-19 03:24:25,605 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4878.622493 2021-02-19 03:24:25,664 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2490.655726 2021-02-19 03:24:25,674 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4800.585893 2021-02-19 03:24:26,466 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2391.666066 2021-02-19 03:24:26,559 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2842.205991 2021-02-19 03:24:26,674 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4844.196984 2021-02-19 03:24:26,707 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2971.649334 2021-02-19 03:24:27,144 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3503.865404 2021-02-19 03:24:27,207 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2310.140086 2021-02-19 03:24:27,278 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2125.418966 2021-02-19 03:24:27,282 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4878.622493 2021-02-19 03:24:27,385 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4800.585893 2021-02-19 03:24:27,395 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2490.655726 2021-02-19 03:24:28,131 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2391.666066 2021-02-19 03:24:28,244 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2842.205991 2021-02-19 03:24:28,345 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4844.196984 2021-02-19 03:24:28,381 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2971.649334 2021-02-19 03:24:28,819 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3503.865404 2021-02-19 03:24:28,881 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2310.140086 2021-02-19 03:24:28,979 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4878.622493 2021-02-19 03:24:29,005 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2125.418966 2021-02-19 03:24:29,055 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2490.655726 2021-02-19 03:24:29,092 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4800.585893 2021-02-19 03:24:29,798 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2391.666066 2021-02-19 03:24:29,825 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 24.72 % 2021-02-19 03:24:29,825 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 24.724185573 2021-02-19 03:24:29,897 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2842.205991 2021-02-19 03:24:29,990 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4844.196984 2021-02-19 03:24:30,079 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2971.649334 2021-02-19 03:24:30,494 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3503.865404 2021-02-19 03:24:30,568 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2269.540086 2021-02-19 03:24:30,667 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4878.622493 2021-02-19 03:24:30,697 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2215.418966 2021-02-19 03:24:30,719 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2490.655726 2021-02-19 03:24:30,809 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4915.985893 2021-02-19 03:24:31,463 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2391.666066 2021-02-19 03:24:31,571 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2842.205991 2021-02-19 03:24:31,693 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4844.196984 2021-02-19 03:24:31,742 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2971.649334 2021-02-19 03:24:32,158 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3503.865404 2021-02-19 03:24:32,236 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2269.540086 2021-02-19 03:24:32,351 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4856.422493 2021-02-19 03:24:32,354 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2085.418966 2021-02-19 03:24:32,410 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2473.355726 2021-02-19 03:24:32,474 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4903.185893 2021-02-19 03:24:33,125 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2360.666066 2021-02-19 03:24:33,243 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2955.705991 2021-02-19 03:24:33,334 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4842.196984 2021-02-19 03:24:33,411 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3013.049334 2021-02-19 03:24:33,813 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3474.265404 2021-02-19 03:24:33,913 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2263.540086 2021-02-19 03:24:34,078 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4856.422493 2021-02-19 03:24:34,079 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2085.418966 2021-02-19 03:24:34,095 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2473.355726 2021-02-19 03:24:34,121 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4903.185893 2021-02-19 03:24:34,786 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2360.666066 2021-02-19 03:24:34,917 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2955.705991 2021-02-19 03:24:34,959 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 26.03 % 2021-02-19 03:24:34,959 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 26.0318095146 2021-02-19 03:24:35,017 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4842.196984 2021-02-19 03:24:35,059 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3013.049334 2021-02-19 03:24:35,430 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3474.265404 2021-02-19 03:24:35,582 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2270.300000 2021-02-19 03:24:35,737 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1930.700000 2021-02-19 03:24:35,753 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4668.400000 2021-02-19 03:24:35,813 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2475.400000 2021-02-19 03:24:35,834 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4746.900000 2021-02-19 03:24:36,424 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2360.666066 2021-02-19 03:24:36,542 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3017.900000 2021-02-19 03:24:36,681 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4649.500000 2021-02-19 03:24:36,690 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3003.800000 2021-02-19 03:24:37,033 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3341.300000 2021-02-19 03:24:37,240 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2270.300000 2021-02-19 03:24:37,423 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1930.700000 2021-02-19 03:24:37,427 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4668.400000 2021-02-19 03:24:37,520 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2475.400000 2021-02-19 03:24:37,522 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4746.900000 2021-02-19 03:24:38,055 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2315.400000 2021-02-19 03:24:38,203 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3017.900000 2021-02-19 03:24:38,342 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4649.500000 2021-02-19 03:24:38,367 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3003.800000 2021-02-19 03:24:38,651 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3341.300000 2021-02-19 03:24:38,888 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2270.300000 2021-02-19 03:24:39,072 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1930.700000 2021-02-19 03:24:39,082 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4668.400000 2021-02-19 03:24:39,186 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2475.400000 2021-02-19 03:24:39,203 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4746.900000 2021-02-19 03:24:39,674 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2315.400000 2021-02-19 03:24:39,849 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3017.900000 2021-02-19 03:24:39,986 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4649.500000 2021-02-19 03:24:39,992 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3003.800000 2021-02-19 03:24:40,033 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 27.12 % 2021-02-19 03:24:40,033 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 27.1222599945 2021-02-19 03:24:40,280 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3341.300000 2021-02-19 03:24:40,575 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2293.900000 2021-02-19 03:24:40,743 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2066.300000 2021-02-19 03:24:40,772 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4668.400000 2021-02-19 03:24:40,838 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2475.400000 2021-02-19 03:24:40,884 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4676.000000 2021-02-19 03:24:41,286 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2315.400000 2021-02-19 03:24:41,480 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3017.900000 2021-02-19 03:24:41,684 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3003.800000 2021-02-19 03:24:41,707 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4649.500000 2021-02-19 03:24:41,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3341.300000 2021-02-19 03:24:42,260 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2293.900000 2021-02-19 03:24:42,400 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2003.400000 2021-02-19 03:24:42,430 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4638.500000 2021-02-19 03:24:42,470 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2474.900000 2021-02-19 03:24:42,516 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4684.900000 2021-02-19 03:24:42,918 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2319.300000 2021-02-19 03:24:43,138 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2908.400000 2021-02-19 03:24:43,325 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2964.500000 2021-02-19 03:24:43,398 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4646.800000 2021-02-19 03:24:43,543 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3309.300000 2021-02-19 03:24:43,938 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2290.100000 2021-02-19 03:24:44,069 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2003.400000 2021-02-19 03:24:44,111 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4638.500000 2021-02-19 03:24:44,174 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2474.900000 2021-02-19 03:24:44,210 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4684.900000 2021-02-19 03:24:44,549 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2319.300000 2021-02-19 03:24:44,790 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2908.400000 2021-02-19 03:24:44,996 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2964.500000 2021-02-19 03:24:45,048 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4646.800000 2021-02-19 03:24:45,091 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 28.24 % 2021-02-19 03:24:45,092 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 28.2408851642 2021-02-19 03:24:45,187 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3309.300000 2021-02-19 03:24:45,608 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2256.700000 2021-02-19 03:24:45,714 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1958.900000 2021-02-19 03:24:45,831 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4749.600000 2021-02-19 03:24:45,845 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4834.100000 2021-02-19 03:24:45,849 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2497.600000 2021-02-19 03:24:46,180 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2331.500000 2021-02-19 03:24:46,437 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2873.100000 2021-02-19 03:24:46,713 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2964.600000 2021-02-19 03:24:46,739 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4821.100000 2021-02-19 03:24:46,844 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3406.800000 2021-02-19 03:24:47,296 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2256.700000 2021-02-19 03:24:47,405 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1958.900000 2021-02-19 03:24:47,503 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2497.600000 2021-02-19 03:24:47,520 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4749.600000 2021-02-19 03:24:47,526 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4834.100000 2021-02-19 03:24:47,801 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2331.500000 2021-02-19 03:24:48,071 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2873.100000 2021-02-19 03:24:48,361 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2964.600000 2021-02-19 03:24:48,378 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4821.100000 2021-02-19 03:24:48,480 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3406.800000 2021-02-19 03:24:49,003 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2256.700000 2021-02-19 03:24:49,104 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1958.900000 2021-02-19 03:24:49,183 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4834.100000 2021-02-19 03:24:49,187 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2497.600000 2021-02-19 03:24:49,211 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4749.600000 2021-02-19 03:24:49,437 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2331.500000 2021-02-19 03:24:49,706 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2873.100000 2021-02-19 03:24:50,023 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4821.100000 2021-02-19 03:24:50,035 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2964.600000 2021-02-19 03:24:50,140 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3406.800000 2021-02-19 03:24:50,157 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 29.35 % 2021-02-19 03:24:50,157 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 29.348878547 2021-02-19 03:24:50,641 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2220.100000 2021-02-19 03:24:50,802 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2055.600000 2021-02-19 03:24:50,858 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4928.200000 2021-02-19 03:24:50,865 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2497.600000 2021-02-19 03:24:50,894 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4749.600000 2021-02-19 03:24:51,085 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2331.500000 2021-02-19 03:24:51,358 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2873.100000 2021-02-19 03:24:51,684 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4821.100000 2021-02-19 03:24:51,697 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2964.600000 2021-02-19 03:24:51,829 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3406.800000 2021-02-19 03:24:52,293 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2180.300000 2021-02-19 03:24:52,502 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1966.400000 2021-02-19 03:24:52,549 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2544.600000 2021-02-19 03:24:52,565 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4804.600000 2021-02-19 03:24:52,578 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4966.800000 2021-02-19 03:24:52,740 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2334.700000 2021-02-19 03:24:52,997 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2985.100000 2021-02-19 03:24:53,349 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2977.500000 2021-02-19 03:24:53,371 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4947.200000 2021-02-19 03:24:53,470 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3384.700000 2021-02-19 03:24:53,927 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2180.300000 2021-02-19 03:24:54,144 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1966.400000 2021-02-19 03:24:54,234 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2544.600000 2021-02-19 03:24:54,246 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4966.800000 2021-02-19 03:24:54,256 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4804.600000 2021-02-19 03:24:54,381 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2334.700000 2021-02-19 03:24:54,628 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2985.100000 2021-02-19 03:24:54,979 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2977.500000 2021-02-19 03:24:55,052 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4947.200000 2021-02-19 03:24:55,108 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3384.700000 2021-02-19 03:24:55,223 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 30.15 % 2021-02-19 03:24:55,223 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 30.1466340297 2021-02-19 03:24:55,558 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2188.800000 2021-02-19 03:24:55,864 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1915.100000 2021-02-19 03:24:55,894 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2501.000000 2021-02-19 03:24:55,894 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4755.500000 2021-02-19 03:24:55,944 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4902.000000 2021-02-19 03:24:56,036 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2359.200000 2021-02-19 03:24:56,257 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2985.100000 2021-02-19 03:24:56,609 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2941.100000 2021-02-19 03:24:56,726 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4938.600000 2021-02-19 03:24:56,750 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3252.200000 2021-02-19 03:24:57,201 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2188.800000 2021-02-19 03:24:57,588 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1915.100000 2021-02-19 03:24:57,595 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4755.500000 2021-02-19 03:24:57,608 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4902.000000 2021-02-19 03:24:57,614 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2501.000000 2021-02-19 03:24:57,756 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2359.200000 2021-02-19 03:24:57,894 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3062.000000 2021-02-19 03:24:58,273 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2941.100000 2021-02-19 03:24:58,423 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4938.600000 2021-02-19 03:24:58,479 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3252.200000 2021-02-19 03:24:58,852 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2188.800000 2021-02-19 03:24:59,273 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1915.100000 2021-02-19 03:24:59,279 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4755.500000 2021-02-19 03:24:59,293 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2501.000000 2021-02-19 03:24:59,308 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4902.000000 2021-02-19 03:24:59,387 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2359.200000 2021-02-19 03:24:59,552 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3062.000000 2021-02-19 03:24:59,904 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2941.100000 2021-02-19 03:25:00,094 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4938.600000 2021-02-19 03:25:00,163 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3252.200000 2021-02-19 03:25:00,276 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 31.09 % 2021-02-19 03:25:00,276 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 31.0882903978 2021-02-19 03:25:00,486 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2191.700000 2021-02-19 03:25:00,980 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2151.000000 2021-02-19 03:25:00,980 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2501.000000 2021-02-19 03:25:01,005 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4861.600000 2021-02-19 03:25:01,017 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4755.500000 2021-02-19 03:25:01,092 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2359.200000 2021-02-19 03:25:01,239 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3062.000000 2021-02-19 03:25:01,530 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2941.100000 2021-02-19 03:25:01,749 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4938.600000 2021-02-19 03:25:01,789 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3252.200000 2021-02-19 03:25:02,164 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2191.700000 2021-02-19 03:25:02,658 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2433.100000 2021-02-19 03:25:02,680 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2258.300000 2021-02-19 03:25:02,726 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4811.800000 2021-02-19 03:25:02,762 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4677.000000 2021-02-19 03:25:02,769 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2244.300000 2021-02-19 03:25:02,898 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2983.500000 2021-02-19 03:25:03,223 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2884.100000 2021-02-19 03:25:03,394 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4773.600000 2021-02-19 03:25:03,444 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3191.900000 2021-02-19 03:25:03,835 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2192.400000 2021-02-19 03:25:04,321 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2433.100000 2021-02-19 03:25:04,365 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2258.300000 2021-02-19 03:25:04,456 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4811.800000 2021-02-19 03:25:04,483 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2244.300000 2021-02-19 03:25:04,484 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4677.000000 2021-02-19 03:25:04,592 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2983.500000 2021-02-19 03:25:04,855 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2884.100000 2021-02-19 03:25:05,049 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4773.600000 2021-02-19 03:25:05,098 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3191.900000 2021-02-19 03:25:05,357 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 31.93 % 2021-02-19 03:25:05,358 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 31.9289429293 2021-02-19 03:25:05,476 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2192.400000 2021-02-19 03:25:05,984 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2452.700000 2021-02-19 03:25:06,117 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2493.300000 2021-02-19 03:25:06,170 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4540.100000 2021-02-19 03:25:06,219 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4739.300000 2021-02-19 03:25:06,232 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2083.800000 2021-02-19 03:25:06,279 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2983.500000 2021-02-19 03:25:06,494 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2858.500000 2021-02-19 03:25:06,707 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4576.900000 2021-02-19 03:25:06,750 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3186.300000 2021-02-19 03:25:07,117 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2171.500000 2021-02-19 03:25:07,653 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2452.700000 2021-02-19 03:25:07,798 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2493.300000 2021-02-19 03:25:07,828 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4540.100000 2021-02-19 03:25:07,874 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4739.300000 2021-02-19 03:25:07,911 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2083.800000 2021-02-19 03:25:07,930 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2910.000000 2021-02-19 03:25:08,121 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2858.500000 2021-02-19 03:25:08,354 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4576.900000 2021-02-19 03:25:08,426 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3186.300000 2021-02-19 03:25:08,782 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2171.500000 2021-02-19 03:25:09,326 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2452.700000 2021-02-19 03:25:09,523 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2493.300000 2021-02-19 03:25:09,546 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4540.100000 2021-02-19 03:25:09,566 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4592.024141 2021-02-19 03:25:09,592 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2172.529017 2021-02-19 03:25:09,611 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2910.000000 2021-02-19 03:25:09,767 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2858.500000 2021-02-19 03:25:09,996 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4576.900000 2021-02-19 03:25:10,061 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3186.300000 2021-02-19 03:25:10,388 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2153.423181 2021-02-19 03:25:10,437 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 32.72 % 2021-02-19 03:25:10,437 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 32.7207386603 2021-02-19 03:25:10,992 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2452.700000 2021-02-19 03:25:11,250 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2623.893765 2021-02-19 03:25:11,286 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4540.100000 2021-02-19 03:25:11,290 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4592.024141 2021-02-19 03:25:11,315 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2172.529017 2021-02-19 03:25:11,332 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2910.000000 2021-02-19 03:25:11,434 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2858.500000 2021-02-19 03:25:11,614 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4576.900000 2021-02-19 03:25:11,721 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3186.300000 2021-02-19 03:25:12,016 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2153.423181 2021-02-19 03:25:12,632 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2522.000000 2021-02-19 03:25:12,923 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2654.493765 2021-02-19 03:25:12,974 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4361.000000 2021-02-19 03:25:13,010 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4488.824141 2021-02-19 03:25:13,052 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2109.629017 2021-02-19 03:25:13,058 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2884.500000 2021-02-19 03:25:13,141 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2822.000000 2021-02-19 03:25:13,262 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4419.000000 2021-02-19 03:25:13,371 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3250.700000 2021-02-19 03:25:13,709 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2197.623181 2021-02-19 03:25:14,237 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2522.000000 2021-02-19 03:25:14,575 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2654.493765 2021-02-19 03:25:14,638 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4361.000000 2021-02-19 03:25:14,696 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4488.824141 2021-02-19 03:25:14,719 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2109.629017 2021-02-19 03:25:14,746 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2884.500000 2021-02-19 03:25:14,783 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2822.000000 2021-02-19 03:25:14,915 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4419.000000 2021-02-19 03:25:15,052 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3250.700000 2021-02-19 03:25:15,358 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2197.623181 2021-02-19 03:25:15,502 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 33.52 % 2021-02-19 03:25:15,502 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 33.5190639748 2021-02-19 03:25:15,894 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2554.800000 2021-02-19 03:25:16,265 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2678.093765 2021-02-19 03:25:16,296 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4361.000000 2021-02-19 03:25:16,365 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4488.824141 2021-02-19 03:25:16,391 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2109.629017 2021-02-19 03:25:16,428 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2884.500000 2021-02-19 03:25:16,463 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2822.000000 2021-02-19 03:25:16,552 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4450.600000 2021-02-19 03:25:16,668 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3349.800000 2021-02-19 03:25:17,013 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2215.423181 2021-02-19 03:25:17,539 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2554.800000 2021-02-19 03:25:17,948 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2678.093765 2021-02-19 03:25:17,950 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4383.800000 2021-02-19 03:25:18,013 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4493.324141 2021-02-19 03:25:18,099 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2880.700000 2021-02-19 03:25:18,104 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2042.329017 2021-02-19 03:25:18,117 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2814.000000 2021-02-19 03:25:18,221 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4450.600000 2021-02-19 03:25:18,296 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3349.800000 2021-02-19 03:25:18,676 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2215.423181 2021-02-19 03:25:19,181 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2554.800000 2021-02-19 03:25:19,637 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2722.241553 2021-02-19 03:25:19,671 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4383.800000 2021-02-19 03:25:19,724 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4615.873899 2021-02-19 03:25:19,772 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2880.700000 2021-02-19 03:25:19,809 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2814.000000 2021-02-19 03:25:19,809 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2142.851401 2021-02-19 03:25:19,855 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4450.600000 2021-02-19 03:25:19,936 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3349.800000 2021-02-19 03:25:20,344 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2215.423181 2021-02-19 03:25:20,565 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 34.27 % 2021-02-19 03:25:20,566 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 34.2652549938 2021-02-19 03:25:20,846 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2554.800000 2021-02-19 03:25:21,292 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2722.241553 2021-02-19 03:25:21,332 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4383.800000 2021-02-19 03:25:21,420 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4615.873899 2021-02-19 03:25:21,490 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2814.000000 2021-02-19 03:25:21,517 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2880.700000 2021-02-19 03:25:21,522 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2142.851401 2021-02-19 03:25:21,532 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4450.600000 2021-02-19 03:25:21,625 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3349.800000 2021-02-19 03:25:21,990 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2252.806725 2021-02-19 03:25:22,474 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2517.800000 2021-02-19 03:25:22,990 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4596.000000 2021-02-19 03:25:23,006 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2757.441553 2021-02-19 03:25:23,099 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4719.773899 2021-02-19 03:25:23,181 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2816.000000 2021-02-19 03:25:23,184 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4650.800000 2021-02-19 03:25:23,221 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2862.700000 2021-02-19 03:25:23,229 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2077.951401 2021-02-19 03:25:23,267 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3414.300000 2021-02-19 03:25:23,631 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2240.806725 2021-02-19 03:25:24,121 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2517.800000 2021-02-19 03:25:24,670 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4596.000000 2021-02-19 03:25:24,690 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2757.441553 2021-02-19 03:25:24,779 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4719.773899 2021-02-19 03:25:24,865 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4650.800000 2021-02-19 03:25:24,890 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2816.000000 2021-02-19 03:25:24,917 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2862.700000 2021-02-19 03:25:24,931 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2077.951401 2021-02-19 03:25:24,950 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3414.300000 2021-02-19 03:25:25,329 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2240.806725 2021-02-19 03:25:25,642 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 35.04 % 2021-02-19 03:25:25,642 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 35.0440426319 2021-02-19 03:25:25,750 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2487.000000 2021-02-19 03:25:26,313 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4596.000000 2021-02-19 03:25:26,341 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2757.441553 2021-02-19 03:25:26,448 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4719.773899 2021-02-19 03:25:26,569 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2817.400000 2021-02-19 03:25:26,573 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4669.800000 2021-02-19 03:25:26,581 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2808.500000 2021-02-19 03:25:26,624 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3393.200000 2021-02-19 03:25:26,634 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2041.651401 2021-02-19 03:25:26,990 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2266.706725 2021-02-19 03:25:27,413 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2487.000000 2021-02-19 03:25:27,953 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4662.100000 2021-02-19 03:25:28,030 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2745.541553 2021-02-19 03:25:28,124 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4719.773899 2021-02-19 03:25:28,233 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2817.400000 2021-02-19 03:25:28,289 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4669.800000 2021-02-19 03:25:28,302 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3393.200000 2021-02-19 03:25:28,302 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2808.500000 2021-02-19 03:25:28,313 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2041.651401 2021-02-19 03:25:28,642 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2266.706725 2021-02-19 03:25:29,065 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2487.000000 2021-02-19 03:25:29,601 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4662.100000 2021-02-19 03:25:29,701 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2721.900000 2021-02-19 03:25:29,801 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4660.800000 2021-02-19 03:25:29,905 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2817.400000 2021-02-19 03:25:29,977 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3393.200000 2021-02-19 03:25:29,999 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2808.500000 2021-02-19 03:25:30,015 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4669.800000 2021-02-19 03:25:30,033 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2119.200000 2021-02-19 03:25:30,269 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2266.706725 2021-02-19 03:25:30,683 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2487.000000 2021-02-19 03:25:30,713 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 35.83 % 2021-02-19 03:25:30,713 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 35.8325354242 2021-02-19 03:25:31,243 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4662.100000 2021-02-19 03:25:31,361 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2721.900000 2021-02-19 03:25:31,431 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4660.800000 2021-02-19 03:25:31,589 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2817.400000 2021-02-19 03:25:31,654 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3393.200000 2021-02-19 03:25:31,723 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2808.500000 2021-02-19 03:25:31,744 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2119.200000 2021-02-19 03:25:31,747 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4669.800000 2021-02-19 03:25:31,890 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2273.700000 2021-02-19 03:25:32,288 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2472.200000 2021-02-19 03:25:32,921 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4590.000000 2021-02-19 03:25:33,003 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2718.200000 2021-02-19 03:25:33,081 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4612.900000 2021-02-19 03:25:33,239 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2916.300000 2021-02-19 03:25:33,312 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3344.100000 2021-02-19 03:25:33,424 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4561.600000 2021-02-19 03:25:33,433 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2913.000000 2021-02-19 03:25:33,443 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2063.300000 2021-02-19 03:25:33,562 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2325.400000 2021-02-19 03:25:33,911 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2472.200000 2021-02-19 03:25:34,563 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4590.000000 2021-02-19 03:25:34,681 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2718.200000 2021-02-19 03:25:34,796 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4612.900000 2021-02-19 03:25:34,959 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2916.300000 2021-02-19 03:25:34,989 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3344.100000 2021-02-19 03:25:35,111 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4561.600000 2021-02-19 03:25:35,111 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2913.000000 2021-02-19 03:25:35,151 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2063.300000 2021-02-19 03:25:35,209 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2325.400000 2021-02-19 03:25:35,585 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2463.100000 2021-02-19 03:25:35,766 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 36.61 % 2021-02-19 03:25:35,766 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 36.6080328643 2021-02-19 03:25:36,250 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4603.900000 2021-02-19 03:25:36,335 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2718.200000 2021-02-19 03:25:36,440 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4673.300000 2021-02-19 03:25:36,686 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2966.800000 2021-02-19 03:25:36,714 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3364.900000 2021-02-19 03:25:36,776 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2966.900000 2021-02-19 03:25:36,823 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1996.600000 2021-02-19 03:25:36,852 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4591.600000 2021-02-19 03:25:36,878 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2365.300000 2021-02-19 03:25:37,229 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2463.100000 2021-02-19 03:25:37,881 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4603.900000 2021-02-19 03:25:38,005 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2715.600000 2021-02-19 03:25:38,091 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4673.300000 2021-02-19 03:25:38,335 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2966.800000 2021-02-19 03:25:38,371 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3364.900000 2021-02-19 03:25:38,430 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2966.900000 2021-02-19 03:25:38,502 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1996.600000 2021-02-19 03:25:38,540 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4591.600000 2021-02-19 03:25:38,578 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2365.300000 2021-02-19 03:25:38,858 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2463.100000 2021-02-19 03:25:39,513 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4603.900000 2021-02-19 03:25:39,655 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2730.300000 2021-02-19 03:25:39,732 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4738.400000 2021-02-19 03:25:40,036 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2966.800000 2021-02-19 03:25:40,045 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3364.900000 2021-02-19 03:25:40,115 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2966.900000 2021-02-19 03:25:40,210 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2093.500000 2021-02-19 03:25:40,213 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4591.600000 2021-02-19 03:25:40,229 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2378.300000 2021-02-19 03:25:40,523 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2463.100000 2021-02-19 03:25:40,836 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 37.34 % 2021-02-19 03:25:40,836 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 37.3412284563 2021-02-19 03:25:41,237 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4603.900000 2021-02-19 03:25:41,305 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2730.300000 2021-02-19 03:25:41,377 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4738.400000 2021-02-19 03:25:41,726 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3364.900000 2021-02-19 03:25:41,736 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2966.800000 2021-02-19 03:25:41,778 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2966.900000 2021-02-19 03:25:41,937 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2093.500000 2021-02-19 03:25:41,950 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4591.600000 2021-02-19 03:25:41,996 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2378.300000 2021-02-19 03:25:42,191 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2463.100000 2021-02-19 03:25:42,887 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4633.400000 2021-02-19 03:25:42,980 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2712.100000 2021-02-19 03:25:43,046 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4764.600000 2021-02-19 03:25:43,417 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2881.900000 2021-02-19 03:25:43,427 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3372.600000 2021-02-19 03:25:43,447 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2924.900000 2021-02-19 03:25:43,585 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2028.700000 2021-02-19 03:25:43,618 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4660.500000 2021-02-19 03:25:43,634 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2333.800000 2021-02-19 03:25:43,874 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2462.600000 2021-02-19 03:25:44,561 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4633.400000 2021-02-19 03:25:44,667 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2712.100000 2021-02-19 03:25:44,736 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4764.600000 2021-02-19 03:25:45,081 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2881.900000 2021-02-19 03:25:45,092 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3372.600000 2021-02-19 03:25:45,163 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2924.900000 2021-02-19 03:25:45,276 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2028.700000 2021-02-19 03:25:45,279 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4660.500000 2021-02-19 03:25:45,345 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2333.800000 2021-02-19 03:25:45,497 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2462.600000 2021-02-19 03:25:45,969 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 38.07 % 2021-02-19 03:25:45,969 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 38.0743731609 2021-02-19 03:25:46,203 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4565.684631 2021-02-19 03:25:46,311 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2712.100000 2021-02-19 03:25:46,403 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4764.600000 2021-02-19 03:25:46,747 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2901.548902 2021-02-19 03:25:46,793 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3313.125948 2021-02-19 03:25:46,819 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2929.157685 2021-02-19 03:25:46,936 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4629.903194 2021-02-19 03:25:47,003 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1922.505788 2021-02-19 03:25:47,007 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2251.659281 2021-02-19 03:25:47,183 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2464.928343 2021-02-19 03:25:47,859 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4565.684631 2021-02-19 03:25:47,967 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2691.444711 2021-02-19 03:25:48,088 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4674.385828 2021-02-19 03:25:48,398 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2901.548902 2021-02-19 03:25:48,496 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3313.125948 2021-02-19 03:25:48,556 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2929.157685 2021-02-19 03:25:48,696 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4629.903194 2021-02-19 03:25:48,723 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1922.505788 2021-02-19 03:25:48,723 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2251.659281 2021-02-19 03:25:48,855 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2464.928343 2021-02-19 03:25:49,542 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4565.684631 2021-02-19 03:25:49,602 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2691.444711 2021-02-19 03:25:49,763 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4546.885828 2021-02-19 03:25:50,040 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2901.548902 2021-02-19 03:25:50,217 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3313.125948 2021-02-19 03:25:50,226 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2929.157685 2021-02-19 03:25:50,342 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4629.903194 2021-02-19 03:25:50,431 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2251.659281 2021-02-19 03:25:50,448 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1922.505788 2021-02-19 03:25:50,506 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2464.928343 2021-02-19 03:25:51,026 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 38.78 % 2021-02-19 03:25:51,028 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 38.7781859259 2021-02-19 03:25:51,174 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4565.684631 2021-02-19 03:25:51,269 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2691.444711 2021-02-19 03:25:51,450 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4546.885828 2021-02-19 03:25:51,720 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2901.548902 2021-02-19 03:25:51,897 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2929.157685 2021-02-19 03:25:51,913 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3313.125948 2021-02-19 03:25:52,069 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4629.903194 2021-02-19 03:25:52,115 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2175.759281 2021-02-19 03:25:52,148 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2464.928343 2021-02-19 03:25:52,188 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1984.305788 2021-02-19 03:25:52,842 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4400.084631 2021-02-19 03:25:52,936 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2736.144711 2021-02-19 03:25:53,115 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4445.285828 2021-02-19 03:25:53,384 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2921.148902 2021-02-19 03:25:53,545 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2944.157685 2021-02-19 03:25:53,579 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3236.025948 2021-02-19 03:25:53,736 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4475.703194 2021-02-19 03:25:53,776 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2155.459281 2021-02-19 03:25:53,811 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2456.028343 2021-02-19 03:25:53,892 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1939.505788 2021-02-19 03:25:54,492 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4400.084631 2021-02-19 03:25:54,572 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2736.144711 2021-02-19 03:25:54,786 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4445.285828 2021-02-19 03:25:55,025 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2921.148902 2021-02-19 03:25:55,242 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2944.157685 2021-02-19 03:25:55,256 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3236.025948 2021-02-19 03:25:55,398 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4475.703194 2021-02-19 03:25:55,444 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2155.459281 2021-02-19 03:25:55,463 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2456.028343 2021-02-19 03:25:55,562 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1939.505788 2021-02-19 03:25:56,124 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4235.486172 2021-02-19 03:25:56,128 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 39.66 % 2021-02-19 03:25:56,128 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 39.657964436 2021-02-19 03:25:56,253 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2816.115230 2021-02-19 03:25:56,434 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4445.285828 2021-02-19 03:25:56,671 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2884.978758 2021-02-19 03:25:56,894 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3229.060120 2021-02-19 03:25:56,927 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2917.689379 2021-02-19 03:25:57,043 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4288.823046 2021-02-19 03:25:57,094 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2447.153908 2021-02-19 03:25:57,095 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2161.853507 2021-02-19 03:25:57,265 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1912.540281 2021-02-19 03:25:57,759 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4235.486172 2021-02-19 03:25:57,891 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2816.115230 2021-02-19 03:25:58,065 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4385.694990 2021-02-19 03:25:58,346 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2884.978758 2021-02-19 03:25:58,526 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3229.060120 2021-02-19 03:25:58,548 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2917.689379 2021-02-19 03:25:58,710 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4288.823046 2021-02-19 03:25:58,779 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2447.153908 2021-02-19 03:25:58,803 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2161.853507 2021-02-19 03:25:58,957 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1912.540281 2021-02-19 03:25:59,434 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4235.486172 2021-02-19 03:25:59,614 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2816.115230 2021-02-19 03:25:59,714 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4362.594990 2021-02-19 03:26:00,045 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2884.978758 2021-02-19 03:26:00,213 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2917.689379 2021-02-19 03:26:00,217 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3229.060120 2021-02-19 03:26:00,377 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4288.823046 2021-02-19 03:26:00,500 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2200.453507 2021-02-19 03:26:00,500 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2447.153908 2021-02-19 03:26:00,594 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2012.240281 2021-02-19 03:26:01,098 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4235.486172 2021-02-19 03:26:01,220 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 40.19 % 2021-02-19 03:26:01,220 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 40.192238779 2021-02-19 03:26:01,286 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2821.515230 2021-02-19 03:26:01,358 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4362.594990 2021-02-19 03:26:01,676 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2884.978758 2021-02-19 03:26:01,871 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3229.060120 2021-02-19 03:26:01,910 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2917.689379 2021-02-19 03:26:02,061 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4288.823046 2021-02-19 03:26:02,160 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2200.453507 2021-02-19 03:26:02,183 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2447.153908 2021-02-19 03:26:02,240 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2012.240281 2021-02-19 03:26:02,710 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4271.686172 2021-02-19 03:26:02,907 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2742.015230 2021-02-19 03:26:02,999 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4374.094990 2021-02-19 03:26:03,332 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2917.378758 2021-02-19 03:26:03,533 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3275.260120 2021-02-19 03:26:03,542 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2858.689379 2021-02-19 03:26:03,694 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4296.123046 2021-02-19 03:26:03,802 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2195.353507 2021-02-19 03:26:03,832 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2477.653908 2021-02-19 03:26:03,918 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1945.340281 2021-02-19 03:26:04,345 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4271.686172 2021-02-19 03:26:04,552 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2742.015230 2021-02-19 03:26:04,617 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4374.094990 2021-02-19 03:26:04,979 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2917.378758 2021-02-19 03:26:05,197 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3275.260120 2021-02-19 03:26:05,207 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2858.689379 2021-02-19 03:26:05,322 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4296.123046 2021-02-19 03:26:05,443 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2195.353507 2021-02-19 03:26:05,519 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2477.653908 2021-02-19 03:26:05,585 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1930.000000 2021-02-19 03:26:05,996 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4507.000000 2021-02-19 03:26:06,209 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2656.500000 2021-02-19 03:26:06,259 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4492.400000 2021-02-19 03:26:06,318 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 40.86 % 2021-02-19 03:26:06,318 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 40.8634676654 2021-02-19 03:26:06,604 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2963.400000 2021-02-19 03:26:06,852 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3346.100000 2021-02-19 03:26:06,859 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.500000 2021-02-19 03:26:06,982 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4254.200000 2021-02-19 03:26:07,062 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2218.600000 2021-02-19 03:26:07,158 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2479.600000 2021-02-19 03:26:07,227 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1930.000000 2021-02-19 03:26:07,638 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4507.000000 2021-02-19 03:26:07,844 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2656.500000 2021-02-19 03:26:07,904 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4492.400000 2021-02-19 03:26:08,243 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2963.400000 2021-02-19 03:26:08,490 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3346.100000 2021-02-19 03:26:08,540 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.500000 2021-02-19 03:26:08,644 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4254.200000 2021-02-19 03:26:08,710 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2218.600000 2021-02-19 03:26:08,845 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2479.600000 2021-02-19 03:26:08,881 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1930.000000 2021-02-19 03:26:09,257 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4507.000000 2021-02-19 03:26:09,473 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 41.24 % 2021-02-19 03:26:09,474 | test | INFO | MainThread | [Magma:abort_rebalance:933] Rebalance % = 41.244680469 2021-02-19 03:26:09,496 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 41.27 % 2021-02-19 03:26:09,512 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2656.500000 2021-02-19 03:26:09,513 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:26:09,513 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:26:09,566 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4492.400000 2021-02-19 03:26:09,859 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2963.400000 2021-02-19 03:26:10,183 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3346.100000 2021-02-19 03:26:10,250 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.500000 2021-02-19 03:26:10,288 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4254.200000 2021-02-19 03:26:10,388 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2218.600000 2021-02-19 03:26:10,506 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2479.600000 2021-02-19 03:26:10,549 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2226.449690 2021-02-19 03:26:10,901 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4507.000000 2021-02-19 03:26:11,144 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2675.580527 2021-02-19 03:26:11,200 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4731.638007 2021-02-19 03:26:11,401 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 41.51 % 2021-02-19 03:26:11,401 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 41.5118559369 2021-02-19 03:26:11,486 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2963.400000 2021-02-19 03:26:11,812 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3346.100000 2021-02-19 03:26:11,950 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.500000 2021-02-19 03:26:12,019 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4254.200000 2021-02-19 03:26:12,052 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2252.614839 2021-02-19 03:26:12,168 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2479.600000 2021-02-19 03:26:12,200 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2226.449690 2021-02-19 03:26:12,529 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4901.900000 2021-02-19 03:26:12,789 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2796.480527 2021-02-19 03:26:12,835 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5008.038007 2021-02-19 03:26:13,115 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2965.900000 2021-02-19 03:26:13,467 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3520.800000 2021-02-19 03:26:13,592 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3099.500000 2021-02-19 03:26:13,678 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3358.700000 2021-02-19 03:26:13,732 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2313.214839 2021-02-19 03:26:13,838 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2498.400000 2021-02-19 03:26:13,855 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2375.249690 2021-02-19 03:26:14,155 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4901.900000 2021-02-19 03:26:14,434 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2796.480527 2021-02-19 03:26:14,466 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5008.038007 2021-02-19 03:26:14,710 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2965.900000 2021-02-19 03:26:15,104 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3520.800000 2021-02-19 03:26:15,269 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3099.500000 2021-02-19 03:26:15,348 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3358.700000 2021-02-19 03:26:15,410 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2313.214839 2021-02-19 03:26:15,519 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2498.400000 2021-02-19 03:26:15,540 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2375.249690 2021-02-19 03:26:15,811 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5092.600000 2021-02-19 03:26:16,071 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2893.580527 2021-02-19 03:26:16,118 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5157.138007 2021-02-19 03:26:16,345 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2965.900000 2021-02-19 03:26:16,459 | test | DEBUG | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 42.20 % 2021-02-19 03:26:16,460 | test | INFO | pool-1-thread-20 | [task:check:330] Rebalance - status: running, progress: 42.2026606465 2021-02-19 03:26:16,750 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3649.300000 2021-02-19 03:26:16,917 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3196.800000 2021-02-19 03:26:17,019 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2363.500000 2021-02-19 03:26:17,066 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2347.314839 2021-02-19 03:26:17,200 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2570.200000 2021-02-19 03:26:17,214 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2520.349690 2021-02-19 03:26:17,447 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5092.600000 2021-02-19 03:26:17,710 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2893.580527 2021-02-19 03:26:17,769 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5157.138007 2021-02-19 03:26:17,992 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2946.100000 2021-02-19 03:26:18,414 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3649.300000 2021-02-19 03:26:18,601 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3196.800000 2021-02-19 03:26:18,670 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2363.500000 2021-02-19 03:26:18,766 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2347.314839 2021-02-19 03:26:18,868 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2520.349690 2021-02-19 03:26:18,882 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2570.200000 2021-02-19 03:26:19,079 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5092.600000 2021-02-19 03:26:19,404 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2893.580527 2021-02-19 03:26:19,410 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5157.138007 2021-02-19 03:26:19,513 | test | INFO | MainThread | [rest_client:rebalance_reached:108] Rebalance reached >41.2707476168% in 10.0380001068 seconds 2021-02-19 03:26:19,551 | test | DEBUG | MainThread | [rest_client:diag_eval:1363] /diag/eval status on 172.23.110.64:8091: 1 content: true command: ns_orchestrator:needs_rebalance() 2021-02-19 03:26:19,551 | test | INFO | MainThread | [Magma:abort_rebalance:912] Abort rebalance 2021-02-19 03:26:19,650 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2946.100000 2021-02-19 03:26:20,015 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L914 2021-02-19 03:26:20,015 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 60 seconds. Reason: Sleep after error introduction 2021-02-19 03:26:20,019 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3649.300000 2021-02-19 03:26:20,214 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3196.800000 2021-02-19 03:26:20,279 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2363.500000 2021-02-19 03:26:20,374 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2344.481194 2021-02-19 03:26:20,489 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2529.162648 2021-02-19 03:26:20,506 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2570.200000 2021-02-19 03:26:20,694 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5092.600000 2021-02-19 03:26:21,022 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5161.968756 2021-02-19 03:26:21,036 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2925.363970 2021-02-19 03:26:21,240 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2946.100000 2021-02-19 03:26:21,535 | test | ERROR | pool-1-thread-20 | [rest_client:_rebalance_status_and_progress:1494] {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 03:26:21,565 | test | ERROR | pool-1-thread-20 | [task:call:242] Expecting , delimiter: line 1 column 49415 (char 49414) 2021-02-19 03:26:21,607 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3649.300000 2021-02-19 03:26:21,822 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3196.800000 2021-02-19 03:26:21,907 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2456.830663 2021-02-19 03:26:22,020 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2344.481194 2021-02-19 03:26:22,141 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2570.200000 2021-02-19 03:26:22,151 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2529.162648 2021-02-19 03:26:22,309 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2519.100000 2021-02-19 03:26:22,661 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3406.868756 2021-02-19 03:26:22,717 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1943.463970 2021-02-19 03:26:22,884 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1465.600000 2021-02-19 03:26:23,227 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1829.400000 2021-02-19 03:26:23,446 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1591.800000 2021-02-19 03:26:23,506 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1167.730663 2021-02-19 03:26:23,714 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1556.381194 2021-02-19 03:26:23,865 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1300.700000 2021-02-19 03:26:23,875 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1680.362648 2021-02-19 03:26:23,930 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2519.100000 2021-02-19 03:26:24,308 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3406.868756 2021-02-19 03:26:24,358 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1943.463970 2021-02-19 03:26:24,500 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1465.600000 2021-02-19 03:26:24,813 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1829.400000 2021-02-19 03:26:25,048 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1591.800000 2021-02-19 03:26:25,114 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1167.730663 2021-02-19 03:26:25,322 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1556.381194 2021-02-19 03:26:25,479 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1300.700000 2021-02-19 03:26:25,496 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1680.362648 2021-02-19 03:26:25,530 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2519.100000 2021-02-19 03:26:25,928 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2859.368756 2021-02-19 03:26:25,959 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1619.563970 2021-02-19 03:26:26,098 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1031.600000 2021-02-19 03:26:26,411 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1179.700000 2021-02-19 03:26:26,667 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1035.600000 2021-02-19 03:26:26,713 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 695.730663 2021-02-19 03:26:26,946 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1300.381194 2021-02-19 03:26:27,101 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 894.600000 2021-02-19 03:26:27,148 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1792.600000 2021-02-19 03:26:27,165 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1395.062648 2021-02-19 03:26:27,584 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2859.368756 2021-02-19 03:26:27,614 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1619.563970 2021-02-19 03:26:27,737 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1031.600000 2021-02-19 03:26:28,013 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1179.700000 2021-02-19 03:26:28,295 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1035.600000 2021-02-19 03:26:28,361 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 695.730663 2021-02-19 03:26:28,530 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1300.381194 2021-02-19 03:26:28,706 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 894.600000 2021-02-19 03:26:28,746 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1792.600000 2021-02-19 03:26:28,773 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1395.062648 2021-02-19 03:26:29,188 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2859.368756 2021-02-19 03:26:29,213 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1619.563970 2021-02-19 03:26:29,329 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1031.600000 2021-02-19 03:26:29,588 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1179.700000 2021-02-19 03:26:29,894 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1035.600000 2021-02-19 03:26:29,963 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 632.100000 2021-02-19 03:26:30,131 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 714.800000 2021-02-19 03:26:30,305 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 894.600000 2021-02-19 03:26:30,364 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1792.600000 2021-02-19 03:26:30,381 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 766.100000 2021-02-19 03:26:30,832 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 853.900000 2021-02-19 03:26:30,845 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1558.900000 2021-02-19 03:26:30,977 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1031.600000 2021-02-19 03:26:31,174 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1179.700000 2021-02-19 03:26:31,490 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1035.600000 2021-02-19 03:26:31,589 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 632.100000 2021-02-19 03:26:31,769 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 714.800000 2021-02-19 03:26:31,950 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 894.600000 2021-02-19 03:26:32,015 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1792.600000 2021-02-19 03:26:32,028 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 766.100000 2021-02-19 03:26:32,509 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 869.250000 2021-02-19 03:26:32,515 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1658.400000 2021-02-19 03:26:32,569 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1031.600000 2021-02-19 03:26:32,775 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1179.700000 2021-02-19 03:26:33,096 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1035.600000 2021-02-19 03:26:33,216 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 632.100000 2021-02-19 03:26:33,384 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 762.300000 2021-02-19 03:26:33,578 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 894.750000 2021-02-19 03:26:33,634 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 766.250000 2021-02-19 03:26:33,657 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1792.600000 2021-02-19 03:26:34,119 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 869.250000 2021-02-19 03:26:34,145 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1658.400000 2021-02-19 03:26:34,187 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1031.600000 2021-02-19 03:26:34,364 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1179.700000 2021-02-19 03:26:34,687 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1035.600000 2021-02-19 03:26:34,809 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 632.100000 2021-02-19 03:26:34,973 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 762.300000 2021-02-19 03:26:35,209 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 894.750000 2021-02-19 03:26:35,279 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 766.250000 2021-02-19 03:26:35,328 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1792.600000 2021-02-19 03:26:35,707 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 678.250000 2021-02-19 03:26:35,769 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1415.500000 2021-02-19 03:26:35,779 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:26:35,960 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:26:36,266 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:26:36,398 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 632.100000 2021-02-19 03:26:36,559 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 677.100000 2021-02-19 03:26:36,836 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.150000 2021-02-19 03:26:36,871 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 563.550000 2021-02-19 03:26:36,974 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:26:37,302 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 678.250000 2021-02-19 03:26:37,368 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1415.500000 2021-02-19 03:26:37,378 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:26:37,566 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:26:37,848 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:26:37,993 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 29.900000 2021-02-19 03:26:38,164 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 677.100000 2021-02-19 03:26:38,427 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.150000 2021-02-19 03:26:38,464 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 563.550000 2021-02-19 03:26:38,565 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:26:38,930 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 678.250000 2021-02-19 03:26:38,983 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:26:38,986 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1415.500000 2021-02-19 03:26:39,168 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:26:39,450 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:26:39,585 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 10.600000 2021-02-19 03:26:39,756 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1518.500000 2021-02-19 03:26:40,029 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.150000 2021-02-19 03:26:40,076 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1315.450000 2021-02-19 03:26:40,154 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:26:40,546 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1635.250000 2021-02-19 03:26:40,640 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:26:40,655 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3137.000000 2021-02-19 03:26:40,765 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:26:41,043 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:26:41,211 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 10.600000 2021-02-19 03:26:41,371 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1518.500000 2021-02-19 03:26:41,641 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.150000 2021-02-19 03:26:41,697 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1315.450000 2021-02-19 03:26:41,779 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:26:42,167 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1635.250000 2021-02-19 03:26:42,311 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5617.800000 2021-02-19 03:26:42,315 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.800000 2021-02-19 03:26:42,365 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 147.000000 2021-02-19 03:26:42,661 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8.300000 2021-02-19 03:26:42,815 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 959.100000 2021-02-19 03:26:43,002 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2727.400000 2021-02-19 03:26:43,259 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 8.800000 2021-02-19 03:26:43,325 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2592.600000 2021-02-19 03:26:43,378 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 9.300000 2021-02-19 03:26:43,786 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3097.000000 2021-02-19 03:26:43,946 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.800000 2021-02-19 03:26:43,996 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 147.000000 2021-02-19 03:26:44,003 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5617.800000 2021-02-19 03:26:44,269 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8.300000 2021-02-19 03:26:44,431 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 959.100000 2021-02-19 03:26:44,622 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2727.400000 2021-02-19 03:26:44,904 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 8.800000 2021-02-19 03:26:44,957 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2592.600000 2021-02-19 03:26:45,023 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 9.300000 2021-02-19 03:26:45,431 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3097.000000 2021-02-19 03:26:45,559 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.800000 2021-02-19 03:26:45,637 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 764.700000 2021-02-19 03:26:45,641 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7069.500000 2021-02-19 03:26:45,865 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 148.900000 2021-02-19 03:26:46,046 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2669.000000 2021-02-19 03:26:46,234 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3421.300000 2021-02-19 03:26:46,503 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 14.800000 2021-02-19 03:26:46,605 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3402.700000 2021-02-19 03:26:46,664 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 713.100000 2021-02-19 03:26:47,072 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3948.200000 2021-02-19 03:26:47,243 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 226.600000 2021-02-19 03:26:47,305 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7069.500000 2021-02-19 03:26:47,329 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 764.700000 2021-02-19 03:26:47,496 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 148.900000 2021-02-19 03:26:47,654 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2669.000000 2021-02-19 03:26:47,880 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3421.300000 2021-02-19 03:26:48,144 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 14.800000 2021-02-19 03:26:48,230 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3402.700000 2021-02-19 03:26:48,301 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 713.100000 2021-02-19 03:26:48,713 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3948.200000 2021-02-19 03:26:48,917 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 226.600000 2021-02-19 03:26:48,963 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7069.500000 2021-02-19 03:26:48,986 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 764.700000 2021-02-19 03:26:49,151 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 148.900000 2021-02-19 03:26:49,292 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2669.000000 2021-02-19 03:26:49,497 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3421.300000 2021-02-19 03:26:49,776 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 14.800000 2021-02-19 03:26:49,874 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3404.400000 2021-02-19 03:26:49,904 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 713.100000 2021-02-19 03:26:50,357 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3948.200000 2021-02-19 03:26:50,532 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 226.600000 2021-02-19 03:26:50,641 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 764.700000 2021-02-19 03:26:50,648 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6840.300000 2021-02-19 03:26:50,802 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 148.900000 2021-02-19 03:26:50,957 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3105.400000 2021-02-19 03:26:51,144 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3267.800000 2021-02-19 03:26:51,404 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 14.800000 2021-02-19 03:26:51,558 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3404.400000 2021-02-19 03:26:51,588 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 713.100000 2021-02-19 03:26:51,969 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3751.000000 2021-02-19 03:26:52,223 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 226.600000 2021-02-19 03:26:52,283 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2284.200000 2021-02-19 03:26:52,345 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5886.300000 2021-02-19 03:26:52,459 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1338.400000 2021-02-19 03:26:52,573 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4360.300000 2021-02-19 03:26:52,757 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2824.600000 2021-02-19 03:26:53,029 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 865.900000 2021-02-19 03:26:53,180 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2997.500000 2021-02-19 03:26:53,191 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3009.000000 2021-02-19 03:26:53,578 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3139.200000 2021-02-19 03:26:53,812 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1451.900000 2021-02-19 03:26:53,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2284.200000 2021-02-19 03:26:54,006 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5886.300000 2021-02-19 03:26:54,111 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1338.400000 2021-02-19 03:26:54,200 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4360.300000 2021-02-19 03:26:54,369 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2824.600000 2021-02-19 03:26:54,661 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 865.900000 2021-02-19 03:26:54,805 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2997.500000 2021-02-19 03:26:54,839 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3009.000000 2021-02-19 03:26:55,209 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3139.200000 2021-02-19 03:26:55,408 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1451.900000 2021-02-19 03:26:55,562 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2284.200000 2021-02-19 03:26:55,644 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5029.800000 2021-02-19 03:26:55,714 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2638.400000 2021-02-19 03:26:55,802 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4726.400000 2021-02-19 03:26:56,006 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2469.300000 2021-02-19 03:26:56,275 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2062.300000 2021-02-19 03:26:56,434 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2997.500000 2021-02-19 03:26:56,466 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4546.700000 2021-02-19 03:26:56,819 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2674.800000 2021-02-19 03:26:57,007 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2677.600000 2021-02-19 03:26:57,197 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3315.500000 2021-02-19 03:26:57,262 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5029.800000 2021-02-19 03:26:57,339 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2638.400000 2021-02-19 03:26:57,457 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4726.400000 2021-02-19 03:26:57,630 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2469.300000 2021-02-19 03:26:57,948 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2062.300000 2021-02-19 03:26:58,107 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2661.700000 2021-02-19 03:26:58,117 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4546.700000 2021-02-19 03:26:58,453 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2674.800000 2021-02-19 03:26:58,631 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2677.600000 2021-02-19 03:26:58,839 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3315.500000 2021-02-19 03:26:58,930 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5029.800000 2021-02-19 03:26:58,980 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2638.400000 2021-02-19 03:26:59,062 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4726.400000 2021-02-19 03:26:59,250 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2469.300000 2021-02-19 03:26:59,556 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2062.300000 2021-02-19 03:26:59,713 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4546.700000 2021-02-19 03:26:59,756 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2532.200000 2021-02-19 03:27:00,062 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2575.700000 2021-02-19 03:27:00,253 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2677.600000 2021-02-19 03:27:00,480 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3315.500000 2021-02-19 03:27:00,569 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4653.600000 2021-02-19 03:27:00,614 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2638.400000 2021-02-19 03:27:00,727 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4630.500000 2021-02-19 03:27:00,914 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2367.900000 2021-02-19 03:27:01,158 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2062.300000 2021-02-19 03:27:01,344 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4546.700000 2021-02-19 03:27:01,391 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2532.200000 2021-02-19 03:27:01,674 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2575.700000 2021-02-19 03:27:01,867 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2677.600000 2021-02-19 03:27:02,088 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3315.500000 2021-02-19 03:27:02,216 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2638.400000 2021-02-19 03:27:02,226 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4653.600000 2021-02-19 03:27:02,380 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4528.400000 2021-02-19 03:27:02,539 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2328.300000 2021-02-19 03:27:02,828 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2464.000000 2021-02-19 03:27:02,984 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4519.500000 2021-02-19 03:27:02,996 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2463.200000 2021-02-19 03:27:03,285 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2582.000000 2021-02-19 03:27:03,484 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2887.800000 2021-02-19 03:27:03,693 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3252.100000 2021-02-19 03:27:03,842 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4581.700000 2021-02-19 03:27:03,869 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2828.600000 2021-02-19 03:27:04,053 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4528.400000 2021-02-19 03:27:04,184 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2328.300000 2021-02-19 03:27:04,440 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2464.000000 2021-02-19 03:27:04,680 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4519.500000 2021-02-19 03:27:04,680 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2463.200000 2021-02-19 03:27:04,913 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2582.000000 2021-02-19 03:27:05,132 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2887.800000 2021-02-19 03:27:05,296 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3252.100000 2021-02-19 03:27:05,469 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4581.700000 2021-02-19 03:27:05,496 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2828.600000 2021-02-19 03:27:05,710 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4602.400000 2021-02-19 03:27:05,811 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2314.000000 2021-02-19 03:27:06,042 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2507.700000 2021-02-19 03:27:06,285 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2421.900000 2021-02-19 03:27:06,334 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4550.000000 2021-02-19 03:27:06,529 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2642.300000 2021-02-19 03:27:06,766 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2821.700000 2021-02-19 03:27:06,881 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3201.700000 2021-02-19 03:27:07,127 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4593.700000 2021-02-19 03:27:07,145 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2823.900000 2021-02-19 03:27:07,405 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4602.400000 2021-02-19 03:27:07,417 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2314.000000 2021-02-19 03:27:07,687 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2507.700000 2021-02-19 03:27:07,956 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4550.000000 2021-02-19 03:27:07,959 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2421.900000 2021-02-19 03:27:08,122 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2642.300000 2021-02-19 03:27:08,377 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2821.700000 2021-02-19 03:27:08,497 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3201.700000 2021-02-19 03:27:08,783 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4593.700000 2021-02-19 03:27:08,831 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2823.900000 2021-02-19 03:27:09,040 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2314.000000 2021-02-19 03:27:09,071 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4602.400000 2021-02-19 03:27:09,321 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2507.700000 2021-02-19 03:27:09,594 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4550.000000 2021-02-19 03:27:09,638 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2421.900000 2021-02-19 03:27:09,752 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2642.865067 2021-02-19 03:27:10,000 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2821.700000 2021-02-19 03:27:10,121 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3201.700000 2021-02-19 03:27:10,405 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4612.636732 2021-02-19 03:27:10,430 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2823.900000 2021-02-19 03:27:10,657 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2268.036382 2021-02-19 03:27:10,700 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4597.626937 2021-02-19 03:27:10,917 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2507.700000 2021-02-19 03:27:11,207 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4550.000000 2021-02-19 03:27:11,298 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2377.009645 2021-02-19 03:27:11,413 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2642.865067 2021-02-19 03:27:11,638 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2821.700000 2021-02-19 03:27:11,759 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3201.700000 2021-02-19 03:27:12,029 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4612.636732 2021-02-19 03:27:12,051 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2823.900000 2021-02-19 03:27:12,289 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2238.936382 2021-02-19 03:27:12,359 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4538.426937 2021-02-19 03:27:12,506 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2484.600000 2021-02-19 03:27:12,815 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4443.000000 2021-02-19 03:27:12,917 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2386.109645 2021-02-19 03:27:13,036 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2663.965067 2021-02-19 03:27:13,239 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2844.700000 2021-02-19 03:27:13,365 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3250.000000 2021-02-19 03:27:13,654 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2904.900000 2021-02-19 03:27:13,724 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4540.936732 2021-02-19 03:27:13,927 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2238.936382 2021-02-19 03:27:14,052 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4538.426937 2021-02-19 03:27:14,118 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2484.600000 2021-02-19 03:27:14,433 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4443.000000 2021-02-19 03:27:14,535 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2386.109645 2021-02-19 03:27:14,676 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2663.965067 2021-02-19 03:27:14,835 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2844.700000 2021-02-19 03:27:14,951 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3250.000000 2021-02-19 03:27:15,273 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2904.900000 2021-02-19 03:27:15,331 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4540.936732 2021-02-19 03:27:15,595 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2238.936382 2021-02-19 03:27:15,690 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4442.326937 2021-02-19 03:27:15,714 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2489.500000 2021-02-19 03:27:16,048 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4336.500000 2021-02-19 03:27:16,155 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2373.109645 2021-02-19 03:27:16,358 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2638.065067 2021-02-19 03:27:16,466 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2962.000000 2021-02-19 03:27:16,562 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3331.600000 2021-02-19 03:27:16,907 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2920.000000 2021-02-19 03:27:16,941 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4512.936732 2021-02-19 03:27:17,219 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2227.536382 2021-02-19 03:27:17,328 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4442.326937 2021-02-19 03:27:17,381 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2489.500000 2021-02-19 03:27:17,658 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4336.500000 2021-02-19 03:27:17,769 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2373.109645 2021-02-19 03:27:17,963 | infra | INFO | pool-2-thread-56 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.35' completed 2021-02-19 03:27:17,963 | infra | INFO | pool-2-thread-56 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' started 2021-02-19 03:27:18,017 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2638.065067 2021-02-19 03:27:18,089 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2962.000000 2021-02-19 03:27:18,157 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3331.600000 2021-02-19 03:27:18,315 | infra | INFO | pool-2-thread-28 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.32' completed 2021-02-19 03:27:18,315 | infra | INFO | pool-2-thread-28 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' started 2021-02-19 03:27:18,523 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2920.000000 2021-02-19 03:27:18,555 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4512.936732 2021-02-19 03:27:18,855 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2227.536382 2021-02-19 03:27:18,927 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4442.326937 2021-02-19 03:27:19,002 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2489.500000 2021-02-19 03:27:19,154 | infra | INFO | pool-2-thread-35 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.33' completed 2021-02-19 03:27:19,155 | infra | INFO | pool-2-thread-35 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope2_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' started 2021-02-19 03:27:19,303 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4336.500000 2021-02-19 03:27:19,384 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2373.109645 2021-02-19 03:27:19,657 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2646.839320 2021-02-19 03:27:19,687 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2962.000000 2021-02-19 03:27:19,770 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3331.600000 2021-02-19 03:27:20,036 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.69:8091 2021-02-19 03:27:20,036 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 03:27:20,069 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.69:8091 is running 2021-02-19 03:27:20,069 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.0. 2021-02-19 03:27:20,071 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.0. 2021-02-19 03:27:20,071 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.0. 2021-02-19 03:27:20,071 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.0. 2021-02-19 03:27:20,071 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.0. 2021-02-19 03:27:20,071 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.0. 2021-02-19 03:27:20,071 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.0. 2021-02-19 03:27:20,071 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.0. 2021-02-19 03:27:20,072 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.0. 2021-02-19 03:27:20,072 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.0. 2021-02-19 03:27:20,108 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.64:8091 2021-02-19 03:27:20,108 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 03:27:20,128 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.64:8091 is running 2021-02-19 03:27:20,128 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.0. 2021-02-19 03:27:20,128 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.0. 2021-02-19 03:27:20,128 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.0. 2021-02-19 03:27:20,128 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.0. 2021-02-19 03:27:20,130 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.0. 2021-02-19 03:27:20,130 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.0. 2021-02-19 03:27:20,130 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.0. 2021-02-19 03:27:20,130 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.0. 2021-02-19 03:27:20,130 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.0. 2021-02-19 03:27:20,130 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.0. 2021-02-19 03:27:20,131 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2920.000000 2021-02-19 03:27:20,157 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.65:8091 2021-02-19 03:27:20,157 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 03:27:20,188 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4481.547574 2021-02-19 03:27:20,190 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.65:8091 is running 2021-02-19 03:27:20,190 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.0. 2021-02-19 03:27:20,190 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.0. 2021-02-19 03:27:20,190 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.0. 2021-02-19 03:27:20,190 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.0. 2021-02-19 03:27:20,190 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.0. 2021-02-19 03:27:20,190 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.0. 2021-02-19 03:27:20,191 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.0. 2021-02-19 03:27:20,191 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.0. 2021-02-19 03:27:20,191 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.0. 2021-02-19 03:27:20,191 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.0. 2021-02-19 03:27:20,191 | test | INFO | MainThread | [Magma:abort_rebalance:927] Restarting Rebalance after killing at 40 2021-02-19 03:27:20,253 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[]_OUT=[]_1613734040.19 2021-02-19 03:27:20,253 | infra | INFO | pool-1-thread-21 | [task:start_task:84] Thread 'Rebalance_task_IN=[]_OUT=[]_1613734040.19' started 2021-02-19 03:27:20,276 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L932 2021-02-19 03:27:20,278 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 120 seconds. Reason: Let the rebalance begin after abort 2021-02-19 03:27:20,325 | test | DEBUG | pool-1-thread-21 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': '', 'user': 'Administrator'} 2021-02-19 03:27:20,377 | test | DEBUG | pool-1-thread-21 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 03:27:20,384 | test | INFO | pool-1-thread-21 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+---------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 15.356194597 | Cluster node | | 172.23.110.69 | kv | 7.0.0-4498-enterprise | 6.98918722584 | Cluster node | | 172.23.110.65 | kv | 7.0.0-4498-enterprise | 16.6961428331 | Cluster node | +---------------+----------+-----------------------+---------------+--------------+ 2021-02-19 03:27:20,418 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 03:27:20,420 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 03:27:20,483 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2245.472586 2021-02-19 03:27:20,551 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4426.064932 2021-02-19 03:27:20,598 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2489.500000 2021-02-19 03:27:20,921 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4336.500000 2021-02-19 03:27:21,015 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2410.308954 2021-02-19 03:27:21,273 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2646.839320 2021-02-19 03:27:21,351 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2962.000000 2021-02-19 03:27:21,467 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3331.600000 2021-02-19 03:27:21,779 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2920.000000 2021-02-19 03:27:21,835 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4481.547574 2021-02-19 03:27:22,144 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2245.472586 2021-02-19 03:27:22,187 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4426.064932 2021-02-19 03:27:22,211 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2489.500000 2021-02-19 03:27:22,572 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4403.500000 2021-02-19 03:27:22,677 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2432.708954 2021-02-19 03:27:22,905 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2676.839320 2021-02-19 03:27:22,987 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3003.700000 2021-02-19 03:27:23,099 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3383.100000 2021-02-19 03:27:23,404 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2912.000000 2021-02-19 03:27:23,453 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4270.247574 2021-02-19 03:27:23,780 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2237.972586 2021-02-19 03:27:23,832 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4477.764932 2021-02-19 03:27:23,842 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2446.100000 2021-02-19 03:27:24,198 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4403.500000 2021-02-19 03:27:24,309 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2432.708954 2021-02-19 03:27:24,542 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2676.839320 2021-02-19 03:27:24,641 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3003.700000 2021-02-19 03:27:24,726 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3383.100000 2021-02-19 03:27:25,069 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2912.000000 2021-02-19 03:27:25,119 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4270.247574 2021-02-19 03:27:25,427 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2237.972586 2021-02-19 03:27:25,467 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 40.56 % 2021-02-19 03:27:25,467 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 40.5633999747 2021-02-19 03:27:25,490 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4477.764932 2021-02-19 03:27:25,529 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2446.100000 2021-02-19 03:27:25,835 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4636.500000 2021-02-19 03:27:25,953 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2541.008954 2021-02-19 03:27:26,174 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2771.139320 2021-02-19 03:27:26,292 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3035.500000 2021-02-19 03:27:26,391 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3383.100000 2021-02-19 03:27:26,801 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2937.100000 2021-02-19 03:27:26,851 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3602.347574 2021-02-19 03:27:27,118 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2220.972586 2021-02-19 03:27:27,184 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4482.964932 2021-02-19 03:27:27,204 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2449.000000 2021-02-19 03:27:27,476 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4636.500000 2021-02-19 03:27:27,595 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2541.008954 2021-02-19 03:27:27,848 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2771.139320 2021-02-19 03:27:27,983 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3035.500000 2021-02-19 03:27:28,065 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3516.800000 2021-02-19 03:27:28,431 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2937.100000 2021-02-19 03:27:28,477 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3602.347574 2021-02-19 03:27:28,788 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2220.972586 2021-02-19 03:27:28,845 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4482.964932 2021-02-19 03:27:28,864 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2449.000000 2021-02-19 03:27:29,128 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4636.500000 2021-02-19 03:27:29,255 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2541.008954 2021-02-19 03:27:29,509 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2771.139320 2021-02-19 03:27:29,645 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3035.500000 2021-02-19 03:27:29,730 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3516.800000 2021-02-19 03:27:30,084 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2937.100000 2021-02-19 03:27:30,138 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2277.115042 2021-02-19 03:27:30,503 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2245.015392 2021-02-19 03:27:30,513 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4379.886607 2021-02-19 03:27:30,528 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2449.000000 2021-02-19 03:27:30,546 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 41.44 % 2021-02-19 03:27:30,546 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 41.4374204701 2021-02-19 03:27:30,783 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4636.500000 2021-02-19 03:27:30,901 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2686.318391 2021-02-19 03:27:31,187 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3015.738381 2021-02-19 03:27:31,289 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3035.500000 2021-02-19 03:27:31,378 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3516.800000 2021-02-19 03:27:31,756 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2937.100000 2021-02-19 03:27:31,801 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2277.115042 2021-02-19 03:27:32,243 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2245.015392 2021-02-19 03:27:32,250 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4379.886607 2021-02-19 03:27:32,257 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2449.000000 2021-02-19 03:27:32,428 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5532.900000 2021-02-19 03:27:32,525 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2831.118391 2021-02-19 03:27:32,799 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3278.638381 2021-02-19 03:27:32,927 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3540.400000 2021-02-19 03:27:33,019 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4047.700000 2021-02-19 03:27:33,397 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3292.000000 2021-02-19 03:27:33,414 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1005.715042 2021-02-19 03:27:33,822 | infra | INFO | pool-2-thread-55 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.35' completed 2021-02-19 03:27:33,822 | infra | INFO | pool-2-thread-55 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' started 2021-02-19 03:27:33,869 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2349.315392 2021-02-19 03:27:33,888 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3181.186607 2021-02-19 03:27:33,917 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2773.300000 2021-02-19 03:27:34,121 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5532.900000 2021-02-19 03:27:34,167 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2831.118391 2021-02-19 03:27:34,427 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3278.638381 2021-02-19 03:27:34,556 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3540.400000 2021-02-19 03:27:34,644 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4047.700000 2021-02-19 03:27:35,030 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3292.000000 2021-02-19 03:27:35,043 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1005.715042 2021-02-19 03:27:35,121 | infra | INFO | pool-2-thread-43 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.34' completed 2021-02-19 03:27:35,121 | infra | INFO | pool-2-thread-43 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' started 2021-02-19 03:27:35,503 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2349.315392 2021-02-19 03:27:35,529 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3181.186607 2021-02-19 03:27:35,562 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2773.300000 2021-02-19 03:27:35,605 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 42.38 % 2021-02-19 03:27:35,605 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 42.3810211525 2021-02-19 03:27:35,786 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6370.892560 2021-02-19 03:27:35,835 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2936.324363 2021-02-19 03:27:36,086 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3542.734316 2021-02-19 03:27:36,200 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4127.941346 2021-02-19 03:27:36,269 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4538.204274 2021-02-19 03:27:36,658 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 169.915042 2021-02-19 03:27:36,671 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3701.348916 2021-02-19 03:27:36,934 | infra | INFO | pool-2-thread-17 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.26' completed 2021-02-19 03:27:36,936 | infra | INFO | pool-2-thread-17 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:27:37,128 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2459.911178 2021-02-19 03:27:37,157 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1625.232257 2021-02-19 03:27:37,197 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3027.040068 2021-02-19 03:27:37,444 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6370.892560 2021-02-19 03:27:37,473 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2936.324363 2021-02-19 03:27:37,691 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3542.734316 2021-02-19 03:27:37,867 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4127.941346 2021-02-19 03:27:37,943 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4538.204274 2021-02-19 03:27:38,275 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 169.915042 2021-02-19 03:27:38,282 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3701.348916 2021-02-19 03:27:38,799 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2459.911178 2021-02-19 03:27:38,805 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1625.232257 2021-02-19 03:27:38,846 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3027.040068 2021-02-19 03:27:39,107 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6370.892560 2021-02-19 03:27:39,118 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2936.324363 2021-02-19 03:27:39,301 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3542.734316 2021-02-19 03:27:39,529 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4127.941346 2021-02-19 03:27:39,608 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4538.204274 2021-02-19 03:27:39,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:27:39,948 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3701.348916 2021-02-19 03:27:40,440 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2541.521198 2021-02-19 03:27:40,448 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1505.899378 2021-02-19 03:27:40,473 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3027.040068 2021-02-19 03:27:40,681 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 43.24 % 2021-02-19 03:27:40,681 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 43.2405666279 2021-02-19 03:27:40,759 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3038.338589 2021-02-19 03:27:40,769 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6370.892560 2021-02-19 03:27:40,914 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3684.028201 2021-02-19 03:27:41,154 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4127.941346 2021-02-19 03:27:41,257 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4538.204274 2021-02-19 03:27:41,562 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:27:41,578 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3701.348916 2021-02-19 03:27:42,055 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2541.521198 2021-02-19 03:27:42,092 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1505.899378 2021-02-19 03:27:42,115 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3027.040068 2021-02-19 03:27:42,374 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3154.538589 2021-02-19 03:27:42,394 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5096.592560 2021-02-19 03:27:42,529 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3801.328201 2021-02-19 03:27:42,779 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4338.641346 2021-02-19 03:27:42,905 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4568.704274 2021-02-19 03:27:43,190 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:27:43,223 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4027.548916 2021-02-19 03:27:43,677 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2603.721198 2021-02-19 03:27:43,720 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 963.399378 2021-02-19 03:27:43,767 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3071.140068 2021-02-19 03:27:44,009 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3154.538589 2021-02-19 03:27:44,028 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5096.592560 2021-02-19 03:27:44,161 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3801.328201 2021-02-19 03:27:44,392 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4338.641346 2021-02-19 03:27:44,536 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4568.704274 2021-02-19 03:27:44,805 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:27:44,851 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4027.548916 2021-02-19 03:27:45,339 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2603.721198 2021-02-19 03:27:45,369 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 963.399378 2021-02-19 03:27:45,438 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3071.140068 2021-02-19 03:27:45,642 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3318.239455 2021-02-19 03:27:45,644 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2836.369150 2021-02-19 03:27:45,730 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 44.10 % 2021-02-19 03:27:45,730 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 44.1047649642 2021-02-19 03:27:45,818 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3950.330033 2021-02-19 03:27:46,017 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4501.670592 2021-02-19 03:27:46,165 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4546.767207 2021-02-19 03:27:46,434 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:27:46,466 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4423.565906 2021-02-19 03:27:46,969 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2691.143276 2021-02-19 03:27:46,989 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 860.173883 2021-02-19 03:27:47,062 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3205.033994 2021-02-19 03:27:47,253 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3318.239455 2021-02-19 03:27:47,272 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2836.369150 2021-02-19 03:27:47,446 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3950.330033 2021-02-19 03:27:47,630 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4501.670592 2021-02-19 03:27:47,783 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4546.767207 2021-02-19 03:27:48,121 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:27:48,173 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4423.565906 2021-02-19 03:27:48,608 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2691.143276 2021-02-19 03:27:48,621 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 860.173883 2021-02-19 03:27:48,700 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3205.033994 2021-02-19 03:27:48,875 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3318.239455 2021-02-19 03:27:48,901 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2836.369150 2021-02-19 03:27:49,071 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3950.330033 2021-02-19 03:27:49,265 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4501.670592 2021-02-19 03:27:49,384 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4546.767207 2021-02-19 03:27:49,762 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:27:49,805 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4423.565906 2021-02-19 03:27:50,234 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2802.417863 2021-02-19 03:27:50,250 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 965.720156 2021-02-19 03:27:50,315 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3205.033994 2021-02-19 03:27:50,502 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3478.506839 2021-02-19 03:27:50,536 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2836.369150 2021-02-19 03:27:50,693 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4099.297767 2021-02-19 03:27:50,775 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 44.94 % 2021-02-19 03:27:50,775 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 44.9393418082 2021-02-19 03:27:50,872 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4501.670592 2021-02-19 03:27:50,990 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4546.767207 2021-02-19 03:27:51,374 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:27:51,437 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4423.565906 2021-02-19 03:27:51,871 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2802.417863 2021-02-19 03:27:51,890 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 965.720156 2021-02-19 03:27:51,953 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3205.033994 2021-02-19 03:27:52,125 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3478.506839 2021-02-19 03:27:52,150 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2836.369150 2021-02-19 03:27:52,344 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4237.297767 2021-02-19 03:27:52,482 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4679.570592 2021-02-19 03:27:52,598 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4700.467207 2021-02-19 03:27:52,980 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:27:53,036 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4580.965906 2021-02-19 03:27:53,523 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1216.020156 2021-02-19 03:27:53,549 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2851.117863 2021-02-19 03:27:53,622 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3392.033994 2021-02-19 03:27:53,802 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3643.406839 2021-02-19 03:27:53,838 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 976.269150 2021-02-19 03:27:53,970 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4237.297767 2021-02-19 03:27:54,147 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4679.570592 2021-02-19 03:27:54,252 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4700.467207 2021-02-19 03:27:54,608 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:27:54,647 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4580.965906 2021-02-19 03:27:55,187 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1216.020156 2021-02-19 03:27:55,198 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2851.117863 2021-02-19 03:27:55,285 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3392.033994 2021-02-19 03:27:55,434 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3643.406839 2021-02-19 03:27:55,492 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 976.269150 2021-02-19 03:27:55,614 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4237.297767 2021-02-19 03:27:55,757 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4779.907296 2021-02-19 03:27:55,822 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 45.77 % 2021-02-19 03:27:55,823 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 45.7742595361 2021-02-19 03:27:55,861 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4842.387806 2021-02-19 03:27:56,224 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:27:56,255 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4594.852324 2021-02-19 03:27:56,825 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1395.310295 2021-02-19 03:27:56,848 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2848.033133 2021-02-19 03:27:56,914 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3532.109195 2021-02-19 03:27:57,075 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3728.877711 2021-02-19 03:27:57,137 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:27:57,240 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4283.985207 2021-02-19 03:27:57,375 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4779.907296 2021-02-19 03:27:57,467 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4842.387806 2021-02-19 03:27:57,845 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:27:57,861 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4594.852324 2021-02-19 03:27:58,451 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1395.310295 2021-02-19 03:27:58,522 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2848.033133 2021-02-19 03:27:58,585 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3532.109195 2021-02-19 03:27:58,701 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3728.877711 2021-02-19 03:27:58,759 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:27:58,868 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4283.985207 2021-02-19 03:27:58,987 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4779.907296 2021-02-19 03:27:59,089 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4842.387806 2021-02-19 03:27:59,470 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:27:59,484 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4594.852324 2021-02-19 03:28:00,084 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1413.410295 2021-02-19 03:28:00,135 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2818.133133 2021-02-19 03:28:00,206 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3532.109195 2021-02-19 03:28:00,323 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3749.877711 2021-02-19 03:28:00,388 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:00,509 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4342.785207 2021-02-19 03:28:00,619 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4779.907296 2021-02-19 03:28:00,719 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4842.387806 2021-02-19 03:28:00,874 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 46.68 % 2021-02-19 03:28:00,874 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 46.6809576764 2021-02-19 03:28:01,079 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:01,094 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4594.852324 2021-02-19 03:28:01,720 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1413.410295 2021-02-19 03:28:01,801 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2818.133133 2021-02-19 03:28:01,828 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3532.109195 2021-02-19 03:28:01,999 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3749.877711 2021-02-19 03:28:02,013 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:02,187 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4342.785207 2021-02-19 03:28:02,230 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4779.907296 2021-02-19 03:28:02,355 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4861.887806 2021-02-19 03:28:02,709 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4586.852324 2021-02-19 03:28:02,714 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:03,400 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1148.610295 2021-02-19 03:28:03,461 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2780.533133 2021-02-19 03:28:03,480 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3462.509195 2021-02-19 03:28:03,641 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:03,664 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3735.777711 2021-02-19 03:28:03,816 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4352.285207 2021-02-19 03:28:03,857 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4830.407296 2021-02-19 03:28:03,974 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4861.887806 2021-02-19 03:28:04,345 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4586.852324 2021-02-19 03:28:04,355 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:05,039 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1148.610295 2021-02-19 03:28:05,098 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3462.509195 2021-02-19 03:28:05,118 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2780.533133 2021-02-19 03:28:05,276 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:05,289 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3735.777711 2021-02-19 03:28:05,479 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4352.285207 2021-02-19 03:28:05,519 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4830.407296 2021-02-19 03:28:05,625 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4861.887806 2021-02-19 03:28:05,924 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 47.59 % 2021-02-19 03:28:05,924 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 47.5916372255 2021-02-19 03:28:05,982 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4626.266523 2021-02-19 03:28:06,003 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:06,664 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 905.466373 2021-02-19 03:28:06,716 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3363.231767 2021-02-19 03:28:06,756 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2768.007879 2021-02-19 03:28:06,898 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:06,921 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3743.774743 2021-02-19 03:28:07,115 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4339.458324 2021-02-19 03:28:07,150 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4917.652735 2021-02-19 03:28:07,266 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4841.259624 2021-02-19 03:28:07,598 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4626.266523 2021-02-19 03:28:07,628 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:08,302 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 905.466373 2021-02-19 03:28:08,345 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3363.231767 2021-02-19 03:28:08,385 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2768.007879 2021-02-19 03:28:08,535 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:08,551 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3743.774743 2021-02-19 03:28:08,740 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4339.458324 2021-02-19 03:28:08,772 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4917.652735 2021-02-19 03:28:08,911 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4841.259624 2021-02-19 03:28:09,207 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4626.266523 2021-02-19 03:28:09,239 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:09,954 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 826.966373 2021-02-19 03:28:09,993 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3363.231767 2021-02-19 03:28:10,029 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2776.107879 2021-02-19 03:28:10,194 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:10,213 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3703.174743 2021-02-19 03:28:10,414 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4917.652735 2021-02-19 03:28:10,424 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4278.458324 2021-02-19 03:28:10,530 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4841.259624 2021-02-19 03:28:10,848 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4626.266523 2021-02-19 03:28:10,862 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:10,964 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 48.41 % 2021-02-19 03:28:10,964 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 48.4115545743 2021-02-19 03:28:11,605 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 826.966373 2021-02-19 03:28:11,674 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3363.231767 2021-02-19 03:28:11,678 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2776.107879 2021-02-19 03:28:11,822 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:11,839 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3703.174743 2021-02-19 03:28:12,038 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4917.652735 2021-02-19 03:28:12,065 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4278.458324 2021-02-19 03:28:12,180 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4841.259624 2021-02-19 03:28:12,494 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:12,499 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4695.566523 2021-02-19 03:28:13,230 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 789.866373 2021-02-19 03:28:13,306 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3425.931767 2021-02-19 03:28:13,346 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2825.007879 2021-02-19 03:28:13,467 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:13,477 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3702.574743 2021-02-19 03:28:13,680 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4248.958324 2021-02-19 03:28:13,707 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4828.152735 2021-02-19 03:28:13,844 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4871.759624 2021-02-19 03:28:14,118 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:14,125 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4695.566523 2021-02-19 03:28:14,881 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 789.866373 2021-02-19 03:28:14,953 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3425.931767 2021-02-19 03:28:14,980 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2825.007879 2021-02-19 03:28:15,134 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:15,140 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3702.574743 2021-02-19 03:28:15,357 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4828.152735 2021-02-19 03:28:15,371 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4248.958324 2021-02-19 03:28:15,493 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4871.759624 2021-02-19 03:28:15,763 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:15,769 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4658.940372 2021-02-19 03:28:16,006 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 49.33 % 2021-02-19 03:28:16,006 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 49.3270714594 2021-02-19 03:28:16,502 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 807.129294 2021-02-19 03:28:16,586 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3448.259068 2021-02-19 03:28:16,628 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2861.408478 2021-02-19 03:28:16,776 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:16,798 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3711.947610 2021-02-19 03:28:16,980 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4719.627175 2021-02-19 03:28:17,013 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4258.014837 2021-02-19 03:28:17,118 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4972.099180 2021-02-19 03:28:17,384 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:17,413 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4658.940372 2021-02-19 03:28:18,131 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 807.129294 2021-02-19 03:28:18,203 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3448.259068 2021-02-19 03:28:18,280 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2861.408478 2021-02-19 03:28:18,407 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:18,430 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3711.947610 2021-02-19 03:28:18,608 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4719.627175 2021-02-19 03:28:18,638 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4258.014837 2021-02-19 03:28:18,752 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4972.099180 2021-02-19 03:28:19,013 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:19,026 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4658.940372 2021-02-19 03:28:19,747 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 926.129294 2021-02-19 03:28:19,838 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3448.259068 2021-02-19 03:28:19,921 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2889.408478 2021-02-19 03:28:20,026 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:20,072 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3776.947610 2021-02-19 03:28:20,240 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4719.627175 2021-02-19 03:28:20,276 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4250.614837 2021-02-19 03:28:20,385 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4972.099180 2021-02-19 03:28:20,637 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:20,648 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4658.940372 2021-02-19 03:28:21,069 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.00 % 2021-02-19 03:28:21,069 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 50.0 2021-02-19 03:28:21,440 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 926.129294 2021-02-19 03:28:21,480 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3448.259068 2021-02-19 03:28:21,571 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2889.408478 2021-02-19 03:28:21,670 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:21,710 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3776.947610 2021-02-19 03:28:21,871 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4719.627175 2021-02-19 03:28:21,923 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4250.614837 2021-02-19 03:28:22,052 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4972.099180 2021-02-19 03:28:22,267 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:22,282 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4552.240372 2021-02-19 03:28:22,601 | infra | INFO | pool-2-thread-21 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.29' completed 2021-02-19 03:28:22,601 | infra | INFO | pool-2-thread-21 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:28:22,980 | infra | INFO | pool-2-thread-58 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.35' completed 2021-02-19 03:28:22,980 | infra | INFO | pool-2-thread-58 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:28:23,075 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1047.529294 2021-02-19 03:28:23,142 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3256.159068 2021-02-19 03:28:23,206 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2909.008478 2021-02-19 03:28:23,342 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3818.747610 2021-02-19 03:28:23,357 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:23,506 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4782.527175 2021-02-19 03:28:23,561 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4193.014837 2021-02-19 03:28:23,673 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4945.299180 2021-02-19 03:28:23,717 | infra | INFO | pool-2-thread-15 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.26' completed 2021-02-19 03:28:23,717 | infra | INFO | pool-2-thread-15 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:28:23,897 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:23,938 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4552.240372 2021-02-19 03:28:24,697 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1047.529294 2021-02-19 03:28:24,769 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3256.159068 2021-02-19 03:28:24,869 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2909.008478 2021-02-19 03:28:25,039 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:25,046 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3818.747610 2021-02-19 03:28:25,138 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4782.527175 2021-02-19 03:28:25,197 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4193.014837 2021-02-19 03:28:25,305 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4945.299180 2021-02-19 03:28:25,517 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:25,555 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4552.240372 2021-02-19 03:28:26,115 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.43 % 2021-02-19 03:28:26,115 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 50.4333598396 2021-02-19 03:28:26,323 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1662.893779 2021-02-19 03:28:26,384 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3064.402581 2021-02-19 03:28:26,510 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2898.389398 2021-02-19 03:28:26,691 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:26,700 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3751.538948 2021-02-19 03:28:26,775 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4716.659652 2021-02-19 03:28:26,855 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4097.566073 2021-02-19 03:28:26,917 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4786.469054 2021-02-19 03:28:27,167 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:27,188 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4491.647510 2021-02-19 03:28:27,957 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1662.893779 2021-02-19 03:28:28,000 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3064.402581 2021-02-19 03:28:28,154 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2898.389398 2021-02-19 03:28:28,322 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:28,375 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3751.538948 2021-02-19 03:28:28,417 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4716.659652 2021-02-19 03:28:28,529 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4097.566073 2021-02-19 03:28:28,542 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4786.469054 2021-02-19 03:28:28,786 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:28,832 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4491.647510 2021-02-19 03:28:29,581 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1662.893779 2021-02-19 03:28:29,621 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3064.402581 2021-02-19 03:28:29,775 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2870.089398 2021-02-19 03:28:29,934 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:30,013 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3676.838948 2021-02-19 03:28:30,046 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4716.659652 2021-02-19 03:28:30,164 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4127.866073 2021-02-19 03:28:30,181 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4786.469054 2021-02-19 03:28:30,401 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:30,450 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4491.647510 2021-02-19 03:28:31,164 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 51.25 % 2021-02-19 03:28:31,164 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 51.2479324829 2021-02-19 03:28:31,220 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2279.593779 2021-02-19 03:28:31,240 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3064.402581 2021-02-19 03:28:31,411 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2870.089398 2021-02-19 03:28:31,556 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:31,680 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3676.838948 2021-02-19 03:28:31,680 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4716.659652 2021-02-19 03:28:31,795 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4127.866073 2021-02-19 03:28:31,835 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4786.469054 2021-02-19 03:28:32,017 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:32,069 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4491.647510 2021-02-19 03:28:32,868 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2546.993779 2021-02-19 03:28:32,875 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3273.902581 2021-02-19 03:28:33,046 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2844.289398 2021-02-19 03:28:33,174 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:33,312 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4785.759652 2021-02-19 03:28:33,325 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3631.638948 2021-02-19 03:28:33,418 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4312.666073 2021-02-19 03:28:33,476 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4095.169054 2021-02-19 03:28:33,632 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:33,683 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4545.147510 2021-02-19 03:28:34,486 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3273.902581 2021-02-19 03:28:34,530 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2546.993779 2021-02-19 03:28:34,700 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2844.289398 2021-02-19 03:28:34,802 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:34,953 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3631.638948 2021-02-19 03:28:34,963 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4785.759652 2021-02-19 03:28:35,061 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4312.666073 2021-02-19 03:28:35,119 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4095.169054 2021-02-19 03:28:35,257 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:35,332 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4545.147510 2021-02-19 03:28:36,107 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3653.567770 2021-02-19 03:28:36,164 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1638.418095 2021-02-19 03:28:36,207 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 52.12 % 2021-02-19 03:28:36,207 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 52.1244209816 2021-02-19 03:28:36,322 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2906.302701 2021-02-19 03:28:36,405 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:36,586 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5177.907122 2021-02-19 03:28:36,619 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3758.396449 2021-02-19 03:28:36,730 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4638.096739 2021-02-19 03:28:36,756 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3201.235401 2021-02-19 03:28:36,871 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:36,944 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4707.519976 2021-02-19 03:28:37,713 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3653.567770 2021-02-19 03:28:37,801 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1638.418095 2021-02-19 03:28:37,941 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2906.302701 2021-02-19 03:28:38,013 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:38,256 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3758.396449 2021-02-19 03:28:38,266 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5177.907122 2021-02-19 03:28:38,365 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4638.096739 2021-02-19 03:28:38,424 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3201.235401 2021-02-19 03:28:38,490 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:38,555 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4707.519976 2021-02-19 03:28:39,319 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3653.567770 2021-02-19 03:28:39,427 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1638.418095 2021-02-19 03:28:39,559 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2906.302701 2021-02-19 03:28:39,634 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:39,890 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5177.907122 2021-02-19 03:28:39,920 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3888.533281 2021-02-19 03:28:40,010 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4891.852761 2021-02-19 03:28:40,142 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3292.289873 2021-02-19 03:28:40,144 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:40,181 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4707.519976 2021-02-19 03:28:40,921 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3653.567770 2021-02-19 03:28:41,042 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 750.118095 2021-02-19 03:28:41,221 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3011.879912 2021-02-19 03:28:41,256 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 52.95 % 2021-02-19 03:28:41,256 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 52.9487878881 2021-02-19 03:28:41,311 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:41,507 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5177.907122 2021-02-19 03:28:41,562 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3888.533281 2021-02-19 03:28:41,684 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4891.852761 2021-02-19 03:28:41,765 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:41,793 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3292.289873 2021-02-19 03:28:41,806 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4707.519976 2021-02-19 03:28:42,539 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3825.567770 2021-02-19 03:28:42,694 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 60.318095 2021-02-19 03:28:42,864 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3107.579912 2021-02-19 03:28:42,924 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:43,122 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5447.407122 2021-02-19 03:28:43,194 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3998.033281 2021-02-19 03:28:43,325 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4998.752761 2021-02-19 03:28:43,417 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:43,418 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2505.889873 2021-02-19 03:28:43,476 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4874.219976 2021-02-19 03:28:44,155 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3825.567770 2021-02-19 03:28:44,308 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 60.318095 2021-02-19 03:28:44,509 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3107.579912 2021-02-19 03:28:44,566 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:44,763 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5447.407122 2021-02-19 03:28:44,835 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3998.033281 2021-02-19 03:28:44,960 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4998.752761 2021-02-19 03:28:45,052 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2505.889873 2021-02-19 03:28:45,055 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:45,096 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4874.219976 2021-02-19 03:28:45,776 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3849.975093 2021-02-19 03:28:45,948 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:28:46,138 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3136.088465 2021-02-19 03:28:46,164 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:46,302 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 53.80 % 2021-02-19 03:28:46,302 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 53.7991837206 2021-02-19 03:28:46,375 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5513.426928 2021-02-19 03:28:46,453 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4037.345074 2021-02-19 03:28:46,585 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5011.356542 2021-02-19 03:28:46,680 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1918.113540 2021-02-19 03:28:46,690 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:46,710 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5012.261388 2021-02-19 03:28:47,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3849.975093 2021-02-19 03:28:47,582 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:28:47,772 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:47,790 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3136.088465 2021-02-19 03:28:48,005 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5513.426928 2021-02-19 03:28:48,078 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4037.345074 2021-02-19 03:28:48,220 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5011.356542 2021-02-19 03:28:48,336 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:48,344 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1918.113540 2021-02-19 03:28:48,357 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5012.261388 2021-02-19 03:28:48,990 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3849.975093 2021-02-19 03:28:49,204 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:28:49,390 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:49,428 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3113.422709 2021-02-19 03:28:49,618 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5513.426928 2021-02-19 03:28:49,691 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4059.782630 2021-02-19 03:28:49,842 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5029.753697 2021-02-19 03:28:49,960 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2008.349713 2021-02-19 03:28:50,002 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:50,023 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5012.261388 2021-02-19 03:28:50,585 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3849.975093 2021-02-19 03:28:50,819 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:28:51,010 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:51,055 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3113.422709 2021-02-19 03:28:51,256 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5513.426928 2021-02-19 03:28:51,326 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4059.782630 2021-02-19 03:28:51,349 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 54.54 % 2021-02-19 03:28:51,349 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 54.5355677359 2021-02-19 03:28:51,453 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5029.753697 2021-02-19 03:28:51,576 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2008.349713 2021-02-19 03:28:51,612 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:51,638 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5012.261388 2021-02-19 03:28:52,200 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3849.975093 2021-02-19 03:28:52,446 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:28:52,658 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:52,717 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3098.722709 2021-02-19 03:28:52,869 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5503.926928 2021-02-19 03:28:52,940 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4074.782630 2021-02-19 03:28:53,092 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5124.753697 2021-02-19 03:28:53,240 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1837.149713 2021-02-19 03:28:53,272 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5031.261388 2021-02-19 03:28:53,282 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:53,799 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3841.475093 2021-02-19 03:28:54,062 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:28:54,270 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:54,322 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3098.722709 2021-02-19 03:28:54,479 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5503.926928 2021-02-19 03:28:54,555 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4074.782630 2021-02-19 03:28:54,713 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5124.753697 2021-02-19 03:28:54,855 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1837.149713 2021-02-19 03:28:54,892 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5031.261388 2021-02-19 03:28:54,904 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:55,427 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3841.475093 2021-02-19 03:28:55,690 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:28:55,904 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:55,936 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3106.811456 2021-02-19 03:28:56,099 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5482.300000 2021-02-19 03:28:56,201 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4059.474387 2021-02-19 03:28:56,331 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5182.153177 2021-02-19 03:28:56,390 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 55.26 % 2021-02-19 03:28:56,390 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 55.258943621 2021-02-19 03:28:56,496 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1820.690645 2021-02-19 03:28:56,519 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4934.700000 2021-02-19 03:28:56,529 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:57,046 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3880.900000 2021-02-19 03:28:57,319 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:28:57,520 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:57,572 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3106.811456 2021-02-19 03:28:57,736 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5482.300000 2021-02-19 03:28:57,832 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4059.474387 2021-02-19 03:28:57,947 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5182.153177 2021-02-19 03:28:58,131 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1820.690645 2021-02-19 03:28:58,160 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:58,160 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4934.700000 2021-02-19 03:28:58,650 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3880.900000 2021-02-19 03:28:58,940 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:28:59,142 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:28:59,184 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3106.811456 2021-02-19 03:28:59,358 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5482.300000 2021-02-19 03:28:59,448 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4059.474387 2021-02-19 03:28:59,565 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5182.153177 2021-02-19 03:28:59,789 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:28:59,806 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1901.500000 2021-02-19 03:28:59,821 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4934.700000 2021-02-19 03:29:00,246 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3880.900000 2021-02-19 03:29:00,561 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:00,750 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:00,855 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3113.700000 2021-02-19 03:29:01,026 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5482.300000 2021-02-19 03:29:01,069 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4094.700000 2021-02-19 03:29:01,174 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5185.200000 2021-02-19 03:29:01,405 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:01,430 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 55.99 % 2021-02-19 03:29:01,430 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 55.9921392503 2021-02-19 03:29:01,441 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4934.700000 2021-02-19 03:29:01,450 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1901.500000 2021-02-19 03:29:01,852 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3880.900000 2021-02-19 03:29:02,188 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:02,381 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:02,496 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3080.300000 2021-02-19 03:29:02,647 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5483.900000 2021-02-19 03:29:02,681 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4110.900000 2021-02-19 03:29:02,799 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5174.800000 2021-02-19 03:29:03,052 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:03,081 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4980.600000 2021-02-19 03:29:03,088 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1840.600000 2021-02-19 03:29:03,466 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3878.400000 2021-02-19 03:29:03,799 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:03,990 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:04,117 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3080.300000 2021-02-19 03:29:04,256 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5483.900000 2021-02-19 03:29:04,305 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4110.900000 2021-02-19 03:29:04,410 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5174.800000 2021-02-19 03:29:04,674 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:04,726 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1840.600000 2021-02-19 03:29:04,736 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4980.600000 2021-02-19 03:29:05,094 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3878.400000 2021-02-19 03:29:05,407 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:05,595 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:05,733 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3025.000000 2021-02-19 03:29:05,871 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5502.800000 2021-02-19 03:29:05,915 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4148.300000 2021-02-19 03:29:06,026 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5152.600000 2021-02-19 03:29:06,301 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:06,365 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1730.100000 2021-02-19 03:29:06,372 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5080.800000 2021-02-19 03:29:06,476 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 56.66 % 2021-02-19 03:29:06,476 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 56.6633553962 2021-02-19 03:29:06,727 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3858.100000 2021-02-19 03:29:07,025 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:07,207 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:07,362 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3025.000000 2021-02-19 03:29:07,487 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5502.800000 2021-02-19 03:29:07,525 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4148.300000 2021-02-19 03:29:07,640 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5152.600000 2021-02-19 03:29:07,918 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:07,970 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1730.100000 2021-02-19 03:29:08,015 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5080.800000 2021-02-19 03:29:08,344 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3858.100000 2021-02-19 03:29:08,641 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:08,834 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:08,984 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3025.000000 2021-02-19 03:29:09,107 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5502.800000 2021-02-19 03:29:09,148 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4148.300000 2021-02-19 03:29:09,266 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5152.600000 2021-02-19 03:29:09,555 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:09,595 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1730.100000 2021-02-19 03:29:09,648 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5080.800000 2021-02-19 03:29:09,957 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3858.100000 2021-02-19 03:29:10,286 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:10,444 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:10,601 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3004.600000 2021-02-19 03:29:10,726 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5502.800000 2021-02-19 03:29:10,776 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4105.400000 2021-02-19 03:29:10,894 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5095.100000 2021-02-19 03:29:11,174 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:11,221 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1820.800000 2021-02-19 03:29:11,296 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5080.800000 2021-02-19 03:29:11,519 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 57.38 % 2021-02-19 03:29:11,519 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 57.3769496839 2021-02-19 03:29:11,562 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3858.100000 2021-02-19 03:29:11,891 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:12,046 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:12,232 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3004.600000 2021-02-19 03:29:12,359 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5515.200000 2021-02-19 03:29:12,405 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4087.000000 2021-02-19 03:29:12,526 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5026.800000 2021-02-19 03:29:12,783 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:12,842 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1863.100000 2021-02-19 03:29:12,926 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5032.100000 2021-02-19 03:29:13,163 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3938.600000 2021-02-19 03:29:13,493 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:13,690 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:13,880 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3051.900000 2021-02-19 03:29:13,986 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5515.200000 2021-02-19 03:29:14,040 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4087.000000 2021-02-19 03:29:14,148 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5026.800000 2021-02-19 03:29:14,417 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:14,486 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1863.100000 2021-02-19 03:29:14,553 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5032.100000 2021-02-19 03:29:14,782 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3938.600000 2021-02-19 03:29:15,099 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:15,303 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:15,529 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3051.900000 2021-02-19 03:29:15,638 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5515.200000 2021-02-19 03:29:15,686 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4087.000000 2021-02-19 03:29:15,770 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5024.900000 2021-02-19 03:29:16,028 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:16,118 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1822.500000 2021-02-19 03:29:16,181 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4971.900000 2021-02-19 03:29:16,382 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3969.000000 2021-02-19 03:29:16,559 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 58.01 % 2021-02-19 03:29:16,559 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 58.0123298626 2021-02-19 03:29:16,717 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:16,921 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:17,145 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3116.400000 2021-02-19 03:29:17,273 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5526.000000 2021-02-19 03:29:17,315 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4081.200000 2021-02-19 03:29:17,388 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5024.900000 2021-02-19 03:29:17,648 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:17,763 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1822.500000 2021-02-19 03:29:17,796 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4971.900000 2021-02-19 03:29:17,987 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3969.000000 2021-02-19 03:29:18,338 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:18,532 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:18,763 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3116.400000 2021-02-19 03:29:18,904 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5526.000000 2021-02-19 03:29:18,937 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4081.200000 2021-02-19 03:29:19,028 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5024.900000 2021-02-19 03:29:19,272 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:19,394 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1938.300000 2021-02-19 03:29:19,427 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4971.900000 2021-02-19 03:29:19,592 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3969.000000 2021-02-19 03:29:19,947 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:20,155 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:20,295 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 58.50 % 2021-02-19 03:29:20,296 | test | INFO | MainThread | [Magma:abort_rebalance:933] Rebalance % = 58.5043535065 2021-02-19 03:29:20,306 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 58.50 % 2021-02-19 03:29:20,319 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:29:20,319 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:29:20,371 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3164.500000 2021-02-19 03:29:20,522 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5526.000000 2021-02-19 03:29:20,565 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4108.800000 2021-02-19 03:29:20,644 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5087.900000 2021-02-19 03:29:20,891 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:21,036 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1938.300000 2021-02-19 03:29:21,051 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4971.900000 2021-02-19 03:29:21,198 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3969.000000 2021-02-19 03:29:21,578 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:21,605 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 58.72 % 2021-02-19 03:29:21,605 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 58.7161554056 2021-02-19 03:29:21,776 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:22,009 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3164.500000 2021-02-19 03:29:22,155 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5526.000000 2021-02-19 03:29:22,183 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4108.800000 2021-02-19 03:29:22,273 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5125.100000 2021-02-19 03:29:22,503 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:22,687 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1901.200000 2021-02-19 03:29:22,707 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4980.600000 2021-02-19 03:29:22,802 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3941.500000 2021-02-19 03:29:23,180 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:23,377 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:23,617 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3112.300000 2021-02-19 03:29:23,796 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4082.100000 2021-02-19 03:29:23,831 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5463.500000 2021-02-19 03:29:23,937 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5125.100000 2021-02-19 03:29:24,128 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:24,315 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1901.200000 2021-02-19 03:29:24,334 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4980.600000 2021-02-19 03:29:24,426 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3941.500000 2021-02-19 03:29:24,799 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:24,986 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:25,211 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3112.300000 2021-02-19 03:29:25,421 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4082.100000 2021-02-19 03:29:25,450 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5415.400000 2021-02-19 03:29:25,553 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5125.100000 2021-02-19 03:29:25,739 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:25,937 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4978.900000 2021-02-19 03:29:25,980 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1870.400000 2021-02-19 03:29:26,039 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3945.800000 2021-02-19 03:29:26,411 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:26,601 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:26,663 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 59.46 % 2021-02-19 03:29:26,663 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 59.4623462751 2021-02-19 03:29:26,806 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3054.800000 2021-02-19 03:29:27,068 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4027.900000 2021-02-19 03:29:27,078 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5415.400000 2021-02-19 03:29:27,168 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5123.200000 2021-02-19 03:29:27,344 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:27,545 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4978.900000 2021-02-19 03:29:27,635 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1870.400000 2021-02-19 03:29:27,657 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3945.800000 2021-02-19 03:29:28,032 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:28,204 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:28,413 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3054.800000 2021-02-19 03:29:28,691 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5415.400000 2021-02-19 03:29:28,719 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4027.900000 2021-02-19 03:29:28,802 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5123.200000 2021-02-19 03:29:28,936 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:29,194 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4978.900000 2021-02-19 03:29:29,298 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1870.400000 2021-02-19 03:29:29,313 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3945.800000 2021-02-19 03:29:29,651 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:29,792 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:30,013 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2975.500000 2021-02-19 03:29:30,302 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5415.400000 2021-02-19 03:29:30,329 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 59.97 % 2021-02-19 03:29:30,342 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:29:30,342 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:29:30,365 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4024.900000 2021-02-19 03:29:30,450 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5131.900000 2021-02-19 03:29:30,546 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:30,832 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4978.900000 2021-02-19 03:29:30,970 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1760.000000 2021-02-19 03:29:30,986 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3945.800000 2021-02-19 03:29:31,270 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:31,388 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:31,644 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2975.500000 2021-02-19 03:29:31,808 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 60.00 % 2021-02-19 03:29:31,808 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 60.0 2021-02-19 03:29:31,930 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5415.400000 2021-02-19 03:29:32,029 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4024.900000 2021-02-19 03:29:32,111 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5131.900000 2021-02-19 03:29:32,194 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:32,450 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4909.200000 2021-02-19 03:29:32,592 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1516.200000 2021-02-19 03:29:32,615 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4004.300000 2021-02-19 03:29:32,915 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:33,005 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:33,290 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2975.500000 2021-02-19 03:29:33,551 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5517.600000 2021-02-19 03:29:33,660 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4066.500000 2021-02-19 03:29:33,739 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5128.800000 2021-02-19 03:29:33,813 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:34,059 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4909.200000 2021-02-19 03:29:34,233 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1516.200000 2021-02-19 03:29:34,239 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4004.300000 2021-02-19 03:29:34,533 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:34,617 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:34,921 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2975.500000 2021-02-19 03:29:35,157 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5517.600000 2021-02-19 03:29:35,299 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4066.500000 2021-02-19 03:29:35,358 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5128.800000 2021-02-19 03:29:35,450 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:35,680 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4909.200000 2021-02-19 03:29:35,865 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1684.100000 2021-02-19 03:29:35,871 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4012.700000 2021-02-19 03:29:36,144 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:36,220 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:36,532 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2969.800000 2021-02-19 03:29:36,786 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5536.300000 2021-02-19 03:29:36,875 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 60.87 % 2021-02-19 03:29:36,875 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 60.873261966 2021-02-19 03:29:36,923 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4073.900000 2021-02-19 03:29:36,989 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5106.200000 2021-02-19 03:29:37,069 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:37,288 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4866.700000 2021-02-19 03:29:37,496 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1684.100000 2021-02-19 03:29:37,515 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4012.700000 2021-02-19 03:29:37,750 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:37,835 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:38,137 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2969.800000 2021-02-19 03:29:38,405 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5536.300000 2021-02-19 03:29:38,536 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4073.900000 2021-02-19 03:29:38,625 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5106.200000 2021-02-19 03:29:38,684 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:38,894 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4866.700000 2021-02-19 03:29:39,121 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1684.100000 2021-02-19 03:29:39,125 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4012.700000 2021-02-19 03:29:39,364 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:39,450 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:39,746 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2989.700000 2021-02-19 03:29:40,016 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5536.300000 2021-02-19 03:29:40,140 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3953.300000 2021-02-19 03:29:40,240 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4957.200000 2021-02-19 03:29:40,302 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:40,357 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 61.42 % 2021-02-19 03:29:40,371 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:29:40,372 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:29:40,519 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4866.700000 2021-02-19 03:29:40,756 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2677.400000 2021-02-19 03:29:40,765 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4012.700000 2021-02-19 03:29:40,976 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:41,068 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:41,367 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2989.700000 2021-02-19 03:29:41,634 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5536.300000 2021-02-19 03:29:41,749 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3953.300000 2021-02-19 03:29:41,857 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4957.200000 2021-02-19 03:29:41,937 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 61.70 % 2021-02-19 03:29:41,937 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 61.6976543909 2021-02-19 03:29:41,941 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:42,118 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4866.700000 2021-02-19 03:29:42,387 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3817.100000 2021-02-19 03:29:42,398 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3860.400000 2021-02-19 03:29:42,588 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:42,700 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:42,987 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2930.500000 2021-02-19 03:29:43,236 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5278.900000 2021-02-19 03:29:43,358 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3777.200000 2021-02-19 03:29:43,466 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4815.300000 2021-02-19 03:29:43,548 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:43,723 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4758.400000 2021-02-19 03:29:44,053 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3817.100000 2021-02-19 03:29:44,078 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3860.400000 2021-02-19 03:29:44,210 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:44,328 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:44,611 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2930.500000 2021-02-19 03:29:44,846 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5278.900000 2021-02-19 03:29:45,006 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3777.200000 2021-02-19 03:29:45,102 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4815.300000 2021-02-19 03:29:45,197 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:45,334 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4758.400000 2021-02-19 03:29:45,667 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3817.100000 2021-02-19 03:29:45,723 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3860.400000 2021-02-19 03:29:45,822 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:45,944 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:46,221 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2876.656020 2021-02-19 03:29:46,447 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5040.952563 2021-02-19 03:29:46,615 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3657.210720 2021-02-19 03:29:46,736 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4680.112189 2021-02-19 03:29:46,836 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:46,970 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4639.813248 2021-02-19 03:29:46,982 | test | DEBUG | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 62.59 % 2021-02-19 03:29:46,982 | test | INFO | pool-1-thread-21 | [task:check:330] Rebalance - status: running, progress: 62.5904794021 2021-02-19 03:29:47,311 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3737.190638 2021-02-19 03:29:47,342 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4722.973893 2021-02-19 03:29:47,443 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:47,552 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:47,831 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2876.656020 2021-02-19 03:29:48,076 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5040.952563 2021-02-19 03:29:48,232 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3657.210720 2021-02-19 03:29:48,359 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4680.112189 2021-02-19 03:29:48,457 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:48,576 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4639.813248 2021-02-19 03:29:48,947 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3737.190638 2021-02-19 03:29:49,003 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4722.973893 2021-02-19 03:29:49,069 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:49,180 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:49,470 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2863.756020 2021-02-19 03:29:49,698 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5040.952563 2021-02-19 03:29:49,848 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3658.710720 2021-02-19 03:29:49,990 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4677.312189 2021-02-19 03:29:50,118 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:50,220 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4639.813248 2021-02-19 03:29:50,372 | test | INFO | MainThread | [rest_client:rebalance_reached:108] Rebalance reached >61.4239494142% in 30.0769999027 seconds 2021-02-19 03:29:50,391 | test | DEBUG | MainThread | [rest_client:diag_eval:1363] /diag/eval status on 172.23.110.64:8091: 1 content: true command: ns_orchestrator:needs_rebalance() 2021-02-19 03:29:50,391 | test | INFO | MainThread | [Magma:abort_rebalance:912] Abort rebalance 2021-02-19 03:29:50,559 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3737.190638 2021-02-19 03:29:50,647 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5123.673893 2021-02-19 03:29:50,709 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:50,789 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:50,834 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L914 2021-02-19 03:29:50,835 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 60 seconds. Reason: Sleep after error introduction 2021-02-19 03:29:51,073 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2863.756020 2021-02-19 03:29:51,292 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5040.952563 2021-02-19 03:29:51,473 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3658.710720 2021-02-19 03:29:51,697 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4677.312189 2021-02-19 03:29:51,763 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:51,867 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4639.813248 2021-02-19 03:29:52,026 | test | ERROR | pool-1-thread-21 | [rest_client:_rebalance_status_and_progress:1494] {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 03:29:52,051 | test | ERROR | pool-1-thread-21 | [task:call:242] Expecting , delimiter: line 1 column 36670 (char 36669) 2021-02-19 03:29:52,154 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3737.190638 2021-02-19 03:29:52,371 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:52,391 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5218.173893 2021-02-19 03:29:52,405 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:52,759 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2962.156020 2021-02-19 03:29:52,901 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5069.452563 2021-02-19 03:29:53,082 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3706.210720 2021-02-19 03:29:53,322 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4631.412189 2021-02-19 03:29:53,427 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:53,480 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4665.113248 2021-02-19 03:29:53,769 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3788.890638 2021-02-19 03:29:53,976 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:54,000 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5218.173893 2021-02-19 03:29:54,023 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:54,375 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2962.156020 2021-02-19 03:29:54,496 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5069.452563 2021-02-19 03:29:54,671 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3706.210720 2021-02-19 03:29:54,921 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4631.412189 2021-02-19 03:29:55,029 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:55,088 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4665.113248 2021-02-19 03:29:55,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3788.890638 2021-02-19 03:29:55,637 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:55,648 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5218.173893 2021-02-19 03:29:55,665 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:55,982 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2821.617496 2021-02-19 03:29:56,084 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4611.735492 2021-02-19 03:29:56,265 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3433.143519 2021-02-19 03:29:56,546 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4208.707377 2021-02-19 03:29:56,710 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:56,786 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4120.696777 2021-02-19 03:29:56,996 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3298.968432 2021-02-19 03:29:57,269 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:57,309 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4862.806276 2021-02-19 03:29:57,325 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:57,609 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2821.617496 2021-02-19 03:29:57,676 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4611.735492 2021-02-19 03:29:57,865 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3433.143519 2021-02-19 03:29:58,151 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4208.707377 2021-02-19 03:29:58,312 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:58,371 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4120.696777 2021-02-19 03:29:58,651 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3298.968432 2021-02-19 03:29:58,864 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:29:58,926 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4862.806276 2021-02-19 03:29:58,947 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:29:59,216 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2821.617496 2021-02-19 03:29:59,269 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4611.735492 2021-02-19 03:29:59,476 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2583.243519 2021-02-19 03:29:59,816 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3089.607377 2021-02-19 03:29:59,907 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:29:59,957 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4120.696777 2021-02-19 03:30:00,247 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3298.968432 2021-02-19 03:30:00,519 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:00,552 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:00,589 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3669.906276 2021-02-19 03:30:00,815 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2163.117496 2021-02-19 03:30:00,861 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4611.735492 2021-02-19 03:30:01,109 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2583.243519 2021-02-19 03:30:01,437 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3089.607377 2021-02-19 03:30:01,513 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:01,558 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4120.696777 2021-02-19 03:30:01,868 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3298.968432 2021-02-19 03:30:02,135 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:02,153 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:02,211 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3669.906276 2021-02-19 03:30:02,418 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1123.917496 2021-02-19 03:30:02,453 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2039.435492 2021-02-19 03:30:02,713 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1333.943519 2021-02-19 03:30:03,061 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1572.007377 2021-02-19 03:30:03,161 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:03,177 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1774.196777 2021-02-19 03:30:03,483 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1409.368432 2021-02-19 03:30:03,776 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:03,789 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:03,848 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1899.606276 2021-02-19 03:30:04,026 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1123.917496 2021-02-19 03:30:04,055 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2039.435492 2021-02-19 03:30:04,338 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1333.943519 2021-02-19 03:30:04,674 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1572.007377 2021-02-19 03:30:04,765 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:04,805 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1774.196777 2021-02-19 03:30:05,130 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1409.368432 2021-02-19 03:30:05,394 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:05,421 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:05,463 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 559.300000 2021-02-19 03:30:05,657 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2039.435492 2021-02-19 03:30:05,658 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1123.917496 2021-02-19 03:30:05,948 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 420.171834 2021-02-19 03:30:06,283 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 453.798682 2021-02-19 03:30:06,367 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:06,407 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:30:06,736 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:30:07,033 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:07,055 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:07,155 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 559.300000 2021-02-19 03:30:07,285 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 617.351219 2021-02-19 03:30:07,302 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:30:07,549 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 420.171834 2021-02-19 03:30:07,884 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 453.798682 2021-02-19 03:30:07,969 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:08,013 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:30:08,331 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:30:08,683 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:08,704 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:08,845 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 559.300000 2021-02-19 03:30:08,903 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 617.351219 2021-02-19 03:30:08,940 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:30:09,151 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 420.171834 2021-02-19 03:30:09,497 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2.598682 2021-02-19 03:30:09,572 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:09,617 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:30:09,933 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:30:10,312 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:10,362 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:10,457 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 521.800000 2021-02-19 03:30:10,535 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1249.351219 2021-02-19 03:30:10,542 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:30:10,785 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 780.471834 2021-02-19 03:30:11,095 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2.598682 2021-02-19 03:30:11,183 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:11,221 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:30:11,529 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:30:11,957 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:12,023 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:12,085 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 521.800000 2021-02-19 03:30:12,160 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:30:12,177 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1249.351219 2021-02-19 03:30:12,408 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1986.371834 2021-02-19 03:30:12,724 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3.198682 2021-02-19 03:30:12,809 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:12,845 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1.700000 2021-02-19 03:30:13,157 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4.300000 2021-02-19 03:30:13,573 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:13,657 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:13,710 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1436.700000 2021-02-19 03:30:13,766 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 83.400000 2021-02-19 03:30:13,799 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2630.151219 2021-02-19 03:30:14,025 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1986.371834 2021-02-19 03:30:14,378 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3.198682 2021-02-19 03:30:14,489 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1.700000 2021-02-19 03:30:14,502 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:14,796 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4.300000 2021-02-19 03:30:15,186 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:15,280 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:15,355 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1436.700000 2021-02-19 03:30:15,375 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 83.400000 2021-02-19 03:30:15,420 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2630.151219 2021-02-19 03:30:15,640 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1986.371834 2021-02-19 03:30:16,003 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2.400360 2021-02-19 03:30:16,144 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 635.660753 2021-02-19 03:30:16,167 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:16,407 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 426.606768 2021-02-19 03:30:16,798 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:16,928 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:16,989 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2813.151742 2021-02-19 03:30:17,003 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 770.724790 2021-02-19 03:30:17,052 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3781.930917 2021-02-19 03:30:17,250 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3512.058991 2021-02-19 03:30:17,628 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2.400360 2021-02-19 03:30:17,782 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 635.660753 2021-02-19 03:30:17,790 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:18,010 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 426.606768 2021-02-19 03:30:18,397 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:18,575 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:18,624 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2813.151742 2021-02-19 03:30:18,647 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 770.724790 2021-02-19 03:30:18,677 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3781.930917 2021-02-19 03:30:18,878 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3512.058991 2021-02-19 03:30:19,256 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2.400360 2021-02-19 03:30:19,401 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 635.660753 2021-02-19 03:30:19,414 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:19,617 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 426.606768 2021-02-19 03:30:20,023 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:20,187 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:20,252 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4027.651742 2021-02-19 03:30:20,266 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 770.724790 2021-02-19 03:30:20,308 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4039.930917 2021-02-19 03:30:20,494 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4172.558991 2021-02-19 03:30:20,861 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.900360 2021-02-19 03:30:21,016 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 635.660753 2021-02-19 03:30:21,039 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:21,210 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 426.606768 2021-02-19 03:30:21,619 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:21,831 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:21,885 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4027.651742 2021-02-19 03:30:21,892 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 770.724790 2021-02-19 03:30:21,930 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4039.930917 2021-02-19 03:30:22,122 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4172.558991 2021-02-19 03:30:22,479 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300360 2021-02-19 03:30:22,635 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3036.360753 2021-02-19 03:30:22,661 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:22,845 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2297.006768 2021-02-19 03:30:23,236 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:23,453 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:23,512 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3421.724790 2021-02-19 03:30:23,558 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5048.851742 2021-02-19 03:30:23,598 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3779.130917 2021-02-19 03:30:23,755 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4285.858991 2021-02-19 03:30:24,101 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300360 2021-02-19 03:30:24,243 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3036.360753 2021-02-19 03:30:24,286 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:24,461 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2297.006768 2021-02-19 03:30:24,839 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:25,148 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:25,180 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3421.724790 2021-02-19 03:30:25,217 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5048.851742 2021-02-19 03:30:25,230 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3779.130917 2021-02-19 03:30:25,375 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4285.858991 2021-02-19 03:30:25,710 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300360 2021-02-19 03:30:25,836 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4906.700000 2021-02-19 03:30:25,891 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:26,063 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3889.900000 2021-02-19 03:30:26,440 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:26,808 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:26,844 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5690.900000 2021-02-19 03:30:26,888 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3411.000000 2021-02-19 03:30:26,907 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5692.600000 2021-02-19 03:30:26,990 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4016.800000 2021-02-19 03:30:27,332 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:30:27,499 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4906.700000 2021-02-19 03:30:27,558 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:27,670 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3889.900000 2021-02-19 03:30:28,039 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:28,440 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:28,506 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5690.900000 2021-02-19 03:30:28,549 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5692.600000 2021-02-19 03:30:28,562 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3411.000000 2021-02-19 03:30:28,627 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4016.800000 2021-02-19 03:30:28,963 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:30:29,121 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4906.700000 2021-02-19 03:30:29,186 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:29,305 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3889.900000 2021-02-19 03:30:29,644 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:30,049 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:30,122 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5690.900000 2021-02-19 03:30:30,196 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5963.600000 2021-02-19 03:30:30,226 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3295.700000 2021-02-19 03:30:30,256 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3915.100000 2021-02-19 03:30:30,572 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 88.300000 2021-02-19 03:30:30,733 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4906.700000 2021-02-19 03:30:30,805 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:30,910 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3889.900000 2021-02-19 03:30:31,246 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:31,674 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:31,760 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5690.900000 2021-02-19 03:30:31,835 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5963.600000 2021-02-19 03:30:31,884 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3295.700000 2021-02-19 03:30:31,910 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3915.100000 2021-02-19 03:30:32,203 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 88.300000 2021-02-19 03:30:32,342 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4996.700000 2021-02-19 03:30:32,414 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:32,526 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3986.200000 2021-02-19 03:30:32,880 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:33,289 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:33,369 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5814.700000 2021-02-19 03:30:33,505 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6010.600000 2021-02-19 03:30:33,538 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3261.500000 2021-02-19 03:30:33,573 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3917.900000 2021-02-19 03:30:33,815 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 650.200000 2021-02-19 03:30:33,948 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4996.700000 2021-02-19 03:30:34,045 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:34,155 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3986.200000 2021-02-19 03:30:34,516 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:34,905 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:35,005 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5814.700000 2021-02-19 03:30:35,158 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6010.600000 2021-02-19 03:30:35,186 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3261.500000 2021-02-19 03:30:35,240 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3917.900000 2021-02-19 03:30:35,440 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1672.393342 2021-02-19 03:30:35,556 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4996.700000 2021-02-19 03:30:35,688 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:35,773 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3986.200000 2021-02-19 03:30:36,167 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:36,516 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:36,631 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5695.848705 2021-02-19 03:30:36,772 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5963.408098 2021-02-19 03:30:36,832 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3272.574388 2021-02-19 03:30:36,894 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3964.302049 2021-02-19 03:30:37,056 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1672.393342 2021-02-19 03:30:37,181 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4877.084595 2021-02-19 03:30:37,321 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:37,395 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3950.806058 2021-02-19 03:30:37,822 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:38,137 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:38,252 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5695.848705 2021-02-19 03:30:38,405 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5963.408098 2021-02-19 03:30:38,436 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3272.574388 2021-02-19 03:30:38,539 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3964.302049 2021-02-19 03:30:38,697 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1672.393342 2021-02-19 03:30:38,796 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4877.084595 2021-02-19 03:30:38,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:39,005 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3950.806058 2021-02-19 03:30:39,418 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:39,756 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:39,875 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5695.848705 2021-02-19 03:30:40,017 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5866.970494 2021-02-19 03:30:40,061 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3216.442700 2021-02-19 03:30:40,157 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3922.710104 2021-02-19 03:30:40,321 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3240.134113 2021-02-19 03:30:40,404 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4877.084595 2021-02-19 03:30:40,546 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:40,615 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3950.806058 2021-02-19 03:30:41,029 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:41,369 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:41,506 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5695.848705 2021-02-19 03:30:41,641 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5866.970494 2021-02-19 03:30:41,683 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3216.442700 2021-02-19 03:30:41,786 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3922.710104 2021-02-19 03:30:41,950 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3240.134113 2021-02-19 03:30:42,013 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4877.084595 2021-02-19 03:30:42,168 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:42,249 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3950.806058 2021-02-19 03:30:42,638 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:43,005 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:43,124 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5513.148705 2021-02-19 03:30:43,265 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5777.170494 2021-02-19 03:30:43,316 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3168.442700 2021-02-19 03:30:43,424 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3870.110104 2021-02-19 03:30:43,584 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4264.934113 2021-02-19 03:30:43,624 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4692.284595 2021-02-19 03:30:43,799 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:43,880 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3851.306058 2021-02-19 03:30:44,256 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:44,611 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:44,727 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5513.148705 2021-02-19 03:30:44,930 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5777.170494 2021-02-19 03:30:44,950 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3168.442700 2021-02-19 03:30:45,102 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3870.110104 2021-02-19 03:30:45,224 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4264.934113 2021-02-19 03:30:45,244 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4692.284595 2021-02-19 03:30:45,424 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:45,497 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3667.061332 2021-02-19 03:30:45,861 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:46,221 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:46,338 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5273.220684 2021-02-19 03:30:46,561 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5680.599465 2021-02-19 03:30:46,582 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3091.865673 2021-02-19 03:30:46,730 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3779.237366 2021-02-19 03:30:46,848 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4827.465354 2021-02-19 03:30:46,865 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4679.488433 2021-02-19 03:30:47,049 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:47,105 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3667.061332 2021-02-19 03:30:47,453 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:47,828 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:47,956 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5273.220684 2021-02-19 03:30:48,207 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5680.599465 2021-02-19 03:30:48,240 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3091.865673 2021-02-19 03:30:48,362 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3779.237366 2021-02-19 03:30:48,470 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4827.465354 2021-02-19 03:30:48,477 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4679.488433 2021-02-19 03:30:48,683 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:48,714 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3667.061332 2021-02-19 03:30:49,078 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:49,424 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:49,575 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5273.220684 2021-02-19 03:30:49,823 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5614.728563 2021-02-19 03:30:49,878 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3032.987834 2021-02-19 03:30:49,997 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3772.816762 2021-02-19 03:30:50,128 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4679.488433 2021-02-19 03:30:50,131 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4777.648940 2021-02-19 03:30:50,322 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:50,341 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3667.061332 2021-02-19 03:30:50,688 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:50,864 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.69:8091 2021-02-19 03:30:50,864 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 03:30:50,881 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.69:8091 is running 2021-02-19 03:30:50,881 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.0. 2021-02-19 03:30:50,882 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.000999927520752. 2021-02-19 03:30:50,882 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.0. 2021-02-19 03:30:50,882 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.0. 2021-02-19 03:30:50,882 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.0. 2021-02-19 03:30:50,882 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.0. 2021-02-19 03:30:50,882 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.0. 2021-02-19 03:30:50,882 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.0. 2021-02-19 03:30:50,882 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.0. 2021-02-19 03:30:50,884 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.0. 2021-02-19 03:30:50,903 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.64:8091 2021-02-19 03:30:50,904 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 03:30:50,918 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.64:8091 is running 2021-02-19 03:30:50,918 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.0. 2021-02-19 03:30:50,918 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.0. 2021-02-19 03:30:50,918 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.0. 2021-02-19 03:30:50,918 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.0. 2021-02-19 03:30:50,918 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.0. 2021-02-19 03:30:50,920 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.0. 2021-02-19 03:30:50,920 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.0. 2021-02-19 03:30:50,920 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.0. 2021-02-19 03:30:50,920 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.0. 2021-02-19 03:30:50,920 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.0. 2021-02-19 03:30:50,937 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.65:8091 2021-02-19 03:30:50,937 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 03:30:50,963 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.65:8091 is running 2021-02-19 03:30:50,963 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.0. 2021-02-19 03:30:50,963 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.0. 2021-02-19 03:30:50,963 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.0. 2021-02-19 03:30:50,963 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.0. 2021-02-19 03:30:50,963 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.0. 2021-02-19 03:30:50,963 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.0. 2021-02-19 03:30:50,963 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.0. 2021-02-19 03:30:50,963 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.0. 2021-02-19 03:30:50,963 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.0. 2021-02-19 03:30:50,963 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.0. 2021-02-19 03:30:50,963 | test | INFO | MainThread | [Magma:abort_rebalance:927] Restarting Rebalance after killing at 60 2021-02-19 03:30:51,026 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[]_OUT=[]_1613734250.96 2021-02-19 03:30:51,026 | infra | INFO | pool-1-thread-22 | [task:start_task:84] Thread 'Rebalance_task_IN=[]_OUT=[]_1613734250.96' started 2021-02-19 03:30:51,042 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L932 2021-02-19 03:30:51,042 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 120 seconds. Reason: Let the rebalance begin after abort 2021-02-19 03:30:51,068 | test | DEBUG | pool-1-thread-22 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': '', 'user': 'Administrator'} 2021-02-19 03:30:51,078 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:51,105 | test | DEBUG | pool-1-thread-22 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 03:30:51,115 | test | INFO | pool-1-thread-22 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+---------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 14.4373315364 | Cluster node | | 172.23.110.69 | kv | 7.0.0-4498-enterprise | 8.64724231022 | Cluster node | | 172.23.110.65 | kv | 7.0.0-4498-enterprise | 14.3203509313 | Cluster node | +---------------+----------+-----------------------+---------------+--------------+ 2021-02-19 03:30:51,132 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 03:30:51,132 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 03:30:51,227 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5273.220684 2021-02-19 03:30:51,440 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5614.728563 2021-02-19 03:30:51,500 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3032.987834 2021-02-19 03:30:51,641 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3772.816762 2021-02-19 03:30:51,756 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4679.488433 2021-02-19 03:30:51,769 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4777.648940 2021-02-19 03:30:51,940 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:51,963 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3667.061332 2021-02-19 03:30:52,292 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:52,700 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:52,842 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5181.220684 2021-02-19 03:30:53,055 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5549.928563 2021-02-19 03:30:53,121 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3013.587834 2021-02-19 03:30:53,275 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3756.916762 2021-02-19 03:30:53,421 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4758.288433 2021-02-19 03:30:53,438 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4777.648940 2021-02-19 03:30:53,565 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:53,579 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3614.561332 2021-02-19 03:30:53,894 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:54,312 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:54,453 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5181.220684 2021-02-19 03:30:54,700 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5549.928563 2021-02-19 03:30:54,750 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3013.587834 2021-02-19 03:30:54,895 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3756.916762 2021-02-19 03:30:55,059 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4758.288433 2021-02-19 03:30:55,069 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4777.648940 2021-02-19 03:30:55,184 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:55,204 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3614.561332 2021-02-19 03:30:55,496 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:55,927 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:56,059 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5170.051931 2021-02-19 03:30:56,187 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 60.65 % 2021-02-19 03:30:56,187 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 60.6473965505 2021-02-19 03:30:56,326 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5459.363017 2021-02-19 03:30:56,371 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2996.485490 2021-02-19 03:30:56,513 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3847.082929 2021-02-19 03:30:56,686 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4748.157497 2021-02-19 03:30:56,700 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4731.807244 2021-02-19 03:30:56,819 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:56,844 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3659.104062 2021-02-19 03:30:57,108 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:57,542 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:57,694 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5170.051931 2021-02-19 03:30:57,950 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5459.363017 2021-02-19 03:30:57,993 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2996.485490 2021-02-19 03:30:58,145 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3847.082929 2021-02-19 03:30:58,306 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4748.157497 2021-02-19 03:30:58,312 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4731.807244 2021-02-19 03:30:58,470 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3659.104062 2021-02-19 03:30:58,477 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:30:58,726 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:30:59,164 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:30:59,316 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5170.051931 2021-02-19 03:30:59,575 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5414.971523 2021-02-19 03:30:59,605 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2996.485490 2021-02-19 03:30:59,826 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3847.082929 2021-02-19 03:30:59,928 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4669.233140 2021-02-19 03:31:00,020 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4731.807244 2021-02-19 03:31:00,176 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:00,197 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3659.104062 2021-02-19 03:31:00,332 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:00,788 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:00,937 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5170.051931 2021-02-19 03:31:01,230 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 61.97 % 2021-02-19 03:31:01,230 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 61.9654645175 2021-02-19 03:31:01,243 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5414.971523 2021-02-19 03:31:01,285 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3040.695017 2021-02-19 03:31:01,444 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3859.995477 2021-02-19 03:31:01,594 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4669.233140 2021-02-19 03:31:01,674 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4731.807244 2021-02-19 03:31:01,828 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3659.104062 2021-02-19 03:31:01,848 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:02,019 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:02,421 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:02,569 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5099.551931 2021-02-19 03:31:02,877 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5360.071523 2021-02-19 03:31:02,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3044.395017 2021-02-19 03:31:03,078 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3862.495477 2021-02-19 03:31:03,230 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4608.633140 2021-02-19 03:31:03,326 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4676.907244 2021-02-19 03:31:03,506 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:03,520 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3711.104062 2021-02-19 03:31:03,651 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:04,036 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:04,190 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5099.551931 2021-02-19 03:31:04,505 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5360.071523 2021-02-19 03:31:04,549 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3044.395017 2021-02-19 03:31:04,697 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3862.495477 2021-02-19 03:31:04,861 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4608.633140 2021-02-19 03:31:04,964 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4676.907244 2021-02-19 03:31:05,200 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3711.104062 2021-02-19 03:31:05,201 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:05,328 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:05,638 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:05,813 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5099.551931 2021-02-19 03:31:06,151 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5371.400000 2021-02-19 03:31:06,190 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3065.100000 2021-02-19 03:31:06,276 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 63.30 % 2021-02-19 03:31:06,276 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 63.300156158 2021-02-19 03:31:06,336 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3726.400000 2021-02-19 03:31:06,476 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4599.500000 2021-02-19 03:31:06,582 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4670.200000 2021-02-19 03:31:06,835 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:06,849 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3767.500000 2021-02-19 03:31:06,950 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:07,259 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:07,446 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5001.600000 2021-02-19 03:31:07,775 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5371.400000 2021-02-19 03:31:07,811 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3065.100000 2021-02-19 03:31:07,964 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3726.400000 2021-02-19 03:31:08,095 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4599.500000 2021-02-19 03:31:08,207 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4670.200000 2021-02-19 03:31:08,463 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:08,483 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3767.500000 2021-02-19 03:31:08,586 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:08,878 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:09,065 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5001.600000 2021-02-19 03:31:09,414 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5339.700000 2021-02-19 03:31:09,453 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2983.700000 2021-02-19 03:31:09,595 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3726.400000 2021-02-19 03:31:09,723 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4599.500000 2021-02-19 03:31:09,835 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4670.200000 2021-02-19 03:31:10,101 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:10,128 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3767.500000 2021-02-19 03:31:10,214 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:10,500 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:10,704 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5001.600000 2021-02-19 03:31:11,039 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5339.700000 2021-02-19 03:31:11,096 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2983.700000 2021-02-19 03:31:11,229 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3666.300000 2021-02-19 03:31:11,319 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 64.52 % 2021-02-19 03:31:11,319 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 64.5239608369 2021-02-19 03:31:11,362 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4636.400000 2021-02-19 03:31:11,459 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4670.200000 2021-02-19 03:31:11,733 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:11,773 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3767.500000 2021-02-19 03:31:11,855 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:12,118 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:12,319 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5015.000000 2021-02-19 03:31:12,670 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5365.100000 2021-02-19 03:31:12,721 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2928.500000 2021-02-19 03:31:12,855 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3656.600000 2021-02-19 03:31:12,984 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4677.400000 2021-02-19 03:31:13,089 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4682.700000 2021-02-19 03:31:13,368 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:13,404 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3798.000000 2021-02-19 03:31:13,500 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:13,734 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:13,934 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5015.000000 2021-02-19 03:31:14,303 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5365.100000 2021-02-19 03:31:14,341 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2928.500000 2021-02-19 03:31:14,496 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3656.600000 2021-02-19 03:31:14,595 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4677.400000 2021-02-19 03:31:14,713 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4682.700000 2021-02-19 03:31:14,993 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:15,029 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3798.000000 2021-02-19 03:31:15,128 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:15,341 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:15,542 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5051.800000 2021-02-19 03:31:15,937 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5331.800000 2021-02-19 03:31:16,003 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2883.000000 2021-02-19 03:31:16,115 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3721.900000 2021-02-19 03:31:16,213 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4685.700000 2021-02-19 03:31:16,321 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4690.300000 2021-02-19 03:31:16,371 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 65.66 % 2021-02-19 03:31:16,371 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 65.6558384919 2021-02-19 03:31:16,605 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:16,645 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3797.500000 2021-02-19 03:31:16,746 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:16,953 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:17,164 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5051.800000 2021-02-19 03:31:17,575 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5331.800000 2021-02-19 03:31:17,651 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2883.000000 2021-02-19 03:31:17,756 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3721.900000 2021-02-19 03:31:17,839 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4685.700000 2021-02-19 03:31:17,947 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4690.300000 2021-02-19 03:31:18,234 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:18,249 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3797.500000 2021-02-19 03:31:18,357 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:18,558 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:18,782 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5051.800000 2021-02-19 03:31:19,234 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5331.800000 2021-02-19 03:31:19,285 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2883.000000 2021-02-19 03:31:19,414 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3739.057346 2021-02-19 03:31:19,460 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4673.768639 2021-02-19 03:31:19,559 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4690.300000 2021-02-19 03:31:19,838 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:19,865 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3797.500000 2021-02-19 03:31:19,976 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:20,171 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:20,390 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5051.800000 2021-02-19 03:31:20,858 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5327.940975 2021-02-19 03:31:20,907 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2917.509774 2021-02-19 03:31:21,042 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3739.057346 2021-02-19 03:31:21,092 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4673.768639 2021-02-19 03:31:21,174 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4690.300000 2021-02-19 03:31:21,430 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 66.83 % 2021-02-19 03:31:21,430 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 66.8284285268 2021-02-19 03:31:21,493 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:21,507 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3797.500000 2021-02-19 03:31:21,602 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:21,811 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:21,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5051.800000 2021-02-19 03:31:22,506 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5311.340975 2021-02-19 03:31:22,579 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2921.809774 2021-02-19 03:31:22,726 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3730.957346 2021-02-19 03:31:22,743 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4678.968639 2021-02-19 03:31:22,795 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4630.800000 2021-02-19 03:31:23,132 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3882.000000 2021-02-19 03:31:23,144 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:23,282 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:23,421 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:23,595 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5005.500000 2021-02-19 03:31:24,131 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5311.340975 2021-02-19 03:31:24,216 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2921.809774 2021-02-19 03:31:24,371 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3730.957346 2021-02-19 03:31:24,390 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4678.968639 2021-02-19 03:31:24,433 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4630.800000 2021-02-19 03:31:24,812 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3882.000000 2021-02-19 03:31:24,819 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:24,914 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:25,042 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:25,207 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5005.500000 2021-02-19 03:31:25,750 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5311.340975 2021-02-19 03:31:25,841 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2921.809774 2021-02-19 03:31:25,999 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3717.757346 2021-02-19 03:31:26,017 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4689.468639 2021-02-19 03:31:26,056 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4599.100000 2021-02-19 03:31:26,427 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3942.500000 2021-02-19 03:31:26,434 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:26,483 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 68.12 % 2021-02-19 03:31:26,483 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 68.1192490671 2021-02-19 03:31:26,561 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:26,676 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:26,809 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4986.000000 2021-02-19 03:31:27,371 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5342.340975 2021-02-19 03:31:27,467 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2920.009774 2021-02-19 03:31:27,628 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3717.757346 2021-02-19 03:31:27,661 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4689.468639 2021-02-19 03:31:27,717 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4599.100000 2021-02-19 03:31:28,048 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:28,073 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3942.500000 2021-02-19 03:31:28,186 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:28,289 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:28,414 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4986.000000 2021-02-19 03:31:29,003 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5342.340975 2021-02-19 03:31:29,086 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2920.009774 2021-02-19 03:31:29,279 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3717.757346 2021-02-19 03:31:29,309 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4689.468639 2021-02-19 03:31:29,345 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4599.100000 2021-02-19 03:31:29,680 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:29,694 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3942.500000 2021-02-19 03:31:29,828 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:29,894 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:30,025 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4986.000000 2021-02-19 03:31:30,624 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5359.156371 2021-02-19 03:31:30,711 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2855.583857 2021-02-19 03:31:30,917 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3723.948790 2021-02-19 03:31:30,937 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4677.208002 2021-02-19 03:31:30,964 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4599.100000 2021-02-19 03:31:31,299 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:31,309 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3942.500000 2021-02-19 03:31:31,454 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:31,505 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:31,532 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 69.31 % 2021-02-19 03:31:31,532 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 69.3100100465 2021-02-19 03:31:31,628 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4986.000000 2021-02-19 03:31:32,250 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5395.756371 2021-02-19 03:31:32,335 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2852.383857 2021-02-19 03:31:32,565 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3768.848790 2021-02-19 03:31:32,589 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4646.408002 2021-02-19 03:31:32,607 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4751.600000 2021-02-19 03:31:32,936 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:32,971 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3827.500000 2021-02-19 03:31:33,085 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:33,124 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:33,240 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5091.900000 2021-02-19 03:31:33,865 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5395.756371 2021-02-19 03:31:33,974 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2852.383857 2021-02-19 03:31:34,236 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4646.408002 2021-02-19 03:31:34,247 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3768.848790 2021-02-19 03:31:34,280 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4751.600000 2021-02-19 03:31:34,595 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:34,644 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3827.500000 2021-02-19 03:31:34,723 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:34,753 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:34,861 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5091.900000 2021-02-19 03:31:35,487 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5357.556371 2021-02-19 03:31:35,638 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2852.383857 2021-02-19 03:31:35,904 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4646.408002 2021-02-19 03:31:35,921 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3768.848790 2021-02-19 03:31:35,941 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4820.300000 2021-02-19 03:31:36,233 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:36,292 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3775.000000 2021-02-19 03:31:36,411 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:36,426 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:36,503 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5148.100000 2021-02-19 03:31:36,581 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 70.07 % 2021-02-19 03:31:36,581 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 70.0716846376 2021-02-19 03:31:37,105 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5357.556371 2021-02-19 03:31:37,262 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2832.183857 2021-02-19 03:31:37,563 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3780.348790 2021-02-19 03:31:37,585 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4623.708002 2021-02-19 03:31:37,599 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4820.300000 2021-02-19 03:31:37,842 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:37,937 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3775.000000 2021-02-19 03:31:38,038 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:38,078 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:38,138 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5148.100000 2021-02-19 03:31:38,723 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5357.556371 2021-02-19 03:31:38,878 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2832.183857 2021-02-19 03:31:39,200 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3780.348790 2021-02-19 03:31:39,210 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4623.708002 2021-02-19 03:31:39,221 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4820.300000 2021-02-19 03:31:39,460 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:39,563 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3775.000000 2021-02-19 03:31:39,706 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:39,753 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:39,782 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5148.100000 2021-02-19 03:31:40,338 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5313.326237 2021-02-19 03:31:40,486 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2900.301260 2021-02-19 03:31:40,842 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3779.375702 2021-02-19 03:31:40,848 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4653.742996 2021-02-19 03:31:40,878 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4820.300000 2021-02-19 03:31:41,066 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:41,197 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3775.000000 2021-02-19 03:31:41,345 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:41,374 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:41,414 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5148.100000 2021-02-19 03:31:41,641 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 70.79 % 2021-02-19 03:31:41,641 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 70.7852790001 2021-02-19 03:31:41,951 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5313.326237 2021-02-19 03:31:42,115 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2900.301260 2021-02-19 03:31:42,486 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4771.842996 2021-02-19 03:31:42,505 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3732.675702 2021-02-19 03:31:42,549 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4657.200000 2021-02-19 03:31:42,760 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:42,880 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3814.900000 2021-02-19 03:31:43,002 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:43,020 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:43,062 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4690.400000 2021-02-19 03:31:43,585 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5234.326237 2021-02-19 03:31:43,720 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2936.201260 2021-02-19 03:31:44,119 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4771.842996 2021-02-19 03:31:44,128 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3732.675702 2021-02-19 03:31:44,160 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4657.200000 2021-02-19 03:31:44,359 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:44,528 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3814.900000 2021-02-19 03:31:44,634 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:44,668 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:44,717 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4690.400000 2021-02-19 03:31:45,210 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5234.326237 2021-02-19 03:31:45,331 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2936.201260 2021-02-19 03:31:45,760 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3732.675702 2021-02-19 03:31:45,779 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4771.842996 2021-02-19 03:31:45,786 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4657.200000 2021-02-19 03:31:45,959 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:46,161 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3850.400000 2021-02-19 03:31:46,296 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:46,299 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:46,372 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3881.000000 2021-02-19 03:31:46,690 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 71.36 % 2021-02-19 03:31:46,690 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 71.3587305827 2021-02-19 03:31:46,821 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5250.826237 2021-02-19 03:31:46,959 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3044.001260 2021-02-19 03:31:47,378 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3758.575702 2021-02-19 03:31:47,404 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4615.400000 2021-02-19 03:31:47,421 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4882.942996 2021-02-19 03:31:47,585 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:47,780 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3850.400000 2021-02-19 03:31:47,930 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:47,948 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:48,005 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3881.000000 2021-02-19 03:31:48,446 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5250.826237 2021-02-19 03:31:48,573 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3044.001260 2021-02-19 03:31:49,003 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3758.575702 2021-02-19 03:31:49,029 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4615.400000 2021-02-19 03:31:49,052 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4882.942996 2021-02-19 03:31:49,203 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:49,403 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3850.400000 2021-02-19 03:31:49,575 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:49,624 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:49,698 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3881.000000 2021-02-19 03:31:50,072 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5323.889311 2021-02-19 03:31:50,224 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3126.530070 2021-02-19 03:31:50,631 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3824.391209 2021-02-19 03:31:50,657 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4615.400000 2021-02-19 03:31:50,691 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4975.837063 2021-02-19 03:31:50,813 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:51,020 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3850.400000 2021-02-19 03:31:51,229 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:51,276 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:51,332 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3940.440559 2021-02-19 03:31:51,696 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5323.889311 2021-02-19 03:31:51,734 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 72.06 % 2021-02-19 03:31:51,736 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 72.0625433851 2021-02-19 03:31:51,845 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3126.530070 2021-02-19 03:31:52,252 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3927.991209 2021-02-19 03:31:52,280 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4808.700000 2021-02-19 03:31:52,322 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4953.837063 2021-02-19 03:31:52,437 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:52,632 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3952.600000 2021-02-19 03:31:52,894 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:52,913 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:52,987 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2963.040559 2021-02-19 03:31:53,318 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5415.889311 2021-02-19 03:31:53,476 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3251.530070 2021-02-19 03:31:53,888 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3927.991209 2021-02-19 03:31:53,911 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4808.700000 2021-02-19 03:31:53,960 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4953.837063 2021-02-19 03:31:54,075 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:54,226 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3952.600000 2021-02-19 03:31:54,506 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:54,546 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:54,601 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2963.040559 2021-02-19 03:31:54,934 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5415.889311 2021-02-19 03:31:55,098 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3251.530070 2021-02-19 03:31:55,520 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3984.422704 2021-02-19 03:31:55,555 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4937.823501 2021-02-19 03:31:55,585 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4945.021475 2021-02-19 03:31:55,698 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:55,841 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3952.600000 2021-02-19 03:31:56,141 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:56,210 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:56,250 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2275.488441 2021-02-19 03:31:56,553 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5530.878759 2021-02-19 03:31:56,714 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3304.745338 2021-02-19 03:31:56,778 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 72.68 % 2021-02-19 03:31:56,778 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 72.6816889382 2021-02-19 03:31:57,147 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3984.422704 2021-02-19 03:31:57,240 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4937.823501 2021-02-19 03:31:57,259 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4945.021475 2021-02-19 03:31:57,323 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:57,451 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3985.921743 2021-02-19 03:31:57,775 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:57,841 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:57,884 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2275.488441 2021-02-19 03:31:58,168 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5530.878759 2021-02-19 03:31:58,338 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3304.745338 2021-02-19 03:31:58,769 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3984.422704 2021-02-19 03:31:58,852 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4937.823501 2021-02-19 03:31:58,871 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4945.021475 2021-02-19 03:31:58,940 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:31:59,049 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3985.921743 2021-02-19 03:31:59,390 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:31:59,502 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:31:59,526 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2332.752916 2021-02-19 03:31:59,792 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5530.878759 2021-02-19 03:31:59,970 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3280.456345 2021-02-19 03:32:00,427 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4003.526600 2021-02-19 03:32:00,497 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4937.823501 2021-02-19 03:32:00,555 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4913.652824 2021-02-19 03:32:00,582 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:00,677 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3985.921743 2021-02-19 03:32:01,019 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:01,127 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:01,145 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2332.752916 2021-02-19 03:32:01,407 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5635.513240 2021-02-19 03:32:01,589 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3280.456345 2021-02-19 03:32:01,826 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 73.36 % 2021-02-19 03:32:01,826 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 73.3594218523 2021-02-19 03:32:02,046 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4003.526600 2021-02-19 03:32:02,131 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4937.823501 2021-02-19 03:32:02,220 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4913.652824 2021-02-19 03:32:02,266 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:02,302 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3983.421743 2021-02-19 03:32:02,658 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:02,766 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:02,785 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2061.352916 2021-02-19 03:32:03,039 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5710.413240 2021-02-19 03:32:03,219 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3164.556345 2021-02-19 03:32:03,660 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3969.326600 2021-02-19 03:32:03,757 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4951.823501 2021-02-19 03:32:03,854 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4922.052824 2021-02-19 03:32:03,907 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:03,937 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3983.421743 2021-02-19 03:32:04,283 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:04,391 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:04,417 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2061.352916 2021-02-19 03:32:04,648 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5710.413240 2021-02-19 03:32:04,832 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3164.556345 2021-02-19 03:32:05,275 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3969.326600 2021-02-19 03:32:05,382 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4951.823501 2021-02-19 03:32:05,479 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4917.680501 2021-02-19 03:32:05,538 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:05,569 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4057.937870 2021-02-19 03:32:05,927 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:06,052 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:06,058 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1865.500471 2021-02-19 03:32:06,250 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5707.732198 2021-02-19 03:32:06,443 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3077.956529 2021-02-19 03:32:06,880 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3961.757556 2021-02-19 03:32:06,880 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 74.07 % 2021-02-19 03:32:06,881 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 74.0730543617 2021-02-19 03:32:07,053 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4929.658767 2021-02-19 03:32:07,125 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4917.680501 2021-02-19 03:32:07,197 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:07,207 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4057.937870 2021-02-19 03:32:07,559 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:07,706 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:07,713 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1865.500471 2021-02-19 03:32:07,882 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5707.732198 2021-02-19 03:32:08,062 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3077.956529 2021-02-19 03:32:08,496 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3961.757556 2021-02-19 03:32:08,678 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4929.658767 2021-02-19 03:32:08,749 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4917.680501 2021-02-19 03:32:08,816 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:08,841 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4057.937870 2021-02-19 03:32:09,191 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:09,336 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1865.500471 2021-02-19 03:32:09,349 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:09,509 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5689.846870 2021-02-19 03:32:09,700 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3077.956529 2021-02-19 03:32:10,109 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3986.974317 2021-02-19 03:32:10,323 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4929.658767 2021-02-19 03:32:10,371 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4943.606586 2021-02-19 03:32:10,473 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4057.937870 2021-02-19 03:32:10,490 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:10,802 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:10,976 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:11,006 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1913.294136 2021-02-19 03:32:11,128 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5689.846870 2021-02-19 03:32:11,338 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3109.061500 2021-02-19 03:32:11,730 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3986.974317 2021-02-19 03:32:11,951 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 74.60 % 2021-02-19 03:32:11,953 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 74.604140543 2021-02-19 03:32:11,974 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4929.658767 2021-02-19 03:32:12,013 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4943.606586 2021-02-19 03:32:12,096 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4057.937870 2021-02-19 03:32:12,137 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:12,424 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:12,601 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:12,618 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1767.494136 2021-02-19 03:32:12,766 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5665.646870 2021-02-19 03:32:12,948 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3194.161500 2021-02-19 03:32:13,348 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4051.674317 2021-02-19 03:32:13,647 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4904.758767 2021-02-19 03:32:13,661 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4967.406586 2021-02-19 03:32:13,723 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4061.737870 2021-02-19 03:32:13,756 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:14,061 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:14,233 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:14,256 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1767.494136 2021-02-19 03:32:14,401 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5665.646870 2021-02-19 03:32:14,572 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3194.161500 2021-02-19 03:32:14,976 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4051.674317 2021-02-19 03:32:15,273 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4904.758767 2021-02-19 03:32:15,296 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4967.406586 2021-02-19 03:32:15,348 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4061.737870 2021-02-19 03:32:15,394 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:15,680 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:15,859 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:15,901 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1767.494136 2021-02-19 03:32:16,039 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5668.438463 2021-02-19 03:32:16,217 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3294.646048 2021-02-19 03:32:16,586 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4099.711867 2021-02-19 03:32:16,911 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4928.700000 2021-02-19 03:32:16,937 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5005.994497 2021-02-19 03:32:16,970 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3999.300000 2021-02-19 03:32:17,007 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 75.18 % 2021-02-19 03:32:17,009 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 75.1776175693 2021-02-19 03:32:17,022 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:17,292 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:17,500 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:17,519 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1547.598699 2021-02-19 03:32:17,701 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5668.438463 2021-02-19 03:32:17,869 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3294.646048 2021-02-19 03:32:18,186 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4099.711867 2021-02-19 03:32:18,552 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4928.700000 2021-02-19 03:32:18,562 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5005.994497 2021-02-19 03:32:18,581 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3999.300000 2021-02-19 03:32:18,631 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:18,921 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:19,125 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:19,132 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1547.598699 2021-02-19 03:32:19,344 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5668.438463 2021-02-19 03:32:19,499 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3303.800000 2021-02-19 03:32:19,809 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4099.711867 2021-02-19 03:32:20,203 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5010.000000 2021-02-19 03:32:20,269 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4928.700000 2021-02-19 03:32:20,279 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3999.300000 2021-02-19 03:32:20,299 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:20,552 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:20,757 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:20,775 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1639.400000 2021-02-19 03:32:20,994 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5655.800000 2021-02-19 03:32:21,135 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3303.800000 2021-02-19 03:32:21,441 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4146.700000 2021-02-19 03:32:21,852 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5010.000000 2021-02-19 03:32:21,891 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4928.700000 2021-02-19 03:32:21,907 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3999.300000 2021-02-19 03:32:21,921 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:22,058 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 75.58 % 2021-02-19 03:32:22,058 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 75.5849102612 2021-02-19 03:32:22,158 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:22,357 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:22,385 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1746.200000 2021-02-19 03:32:22,615 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5664.800000 2021-02-19 03:32:22,744 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3276.400000 2021-02-19 03:32:23,066 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4187.300000 2021-02-19 03:32:23,509 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5000.600000 2021-02-19 03:32:23,546 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4865.300000 2021-02-19 03:32:23,556 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3923.200000 2021-02-19 03:32:23,551 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:23,806 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:23,973 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:23,997 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1746.200000 2021-02-19 03:32:24,250 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5664.800000 2021-02-19 03:32:24,364 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3276.400000 2021-02-19 03:32:24,680 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4187.300000 2021-02-19 03:32:25,140 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5000.600000 2021-02-19 03:32:25,188 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4865.300000 2021-02-19 03:32:25,203 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3923.200000 2021-02-19 03:32:25,219 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:25,440 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:25,598 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:25,635 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2042.300000 2021-02-19 03:32:25,875 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5664.800000 2021-02-19 03:32:25,976 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3220.400000 2021-02-19 03:32:26,312 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4172.100000 2021-02-19 03:32:26,770 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4979.200000 2021-02-19 03:32:26,819 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4776.000000 2021-02-19 03:32:26,848 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3915.300000 2021-02-19 03:32:26,855 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:27,056 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:27,105 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 75.96 % 2021-02-19 03:32:27,105 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 75.9563415421 2021-02-19 03:32:27,289 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:27,334 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2042.300000 2021-02-19 03:32:27,510 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5633.700000 2021-02-19 03:32:27,595 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3220.400000 2021-02-19 03:32:27,917 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4172.100000 2021-02-19 03:32:28,388 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4979.200000 2021-02-19 03:32:28,476 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4776.000000 2021-02-19 03:32:28,506 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:28,533 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3915.300000 2021-02-19 03:32:28,709 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:28,913 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:28,957 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2042.300000 2021-02-19 03:32:29,158 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5633.700000 2021-02-19 03:32:29,219 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3220.400000 2021-02-19 03:32:29,519 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4117.908184 2021-02-19 03:32:30,038 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4952.829741 2021-02-19 03:32:30,098 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4776.000000 2021-02-19 03:32:30,154 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:30,188 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3915.300000 2021-02-19 03:32:30,325 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:30,526 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:30,589 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2278.115768 2021-02-19 03:32:30,783 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5567.961876 2021-02-19 03:32:30,839 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3216.935130 2021-02-19 03:32:31,119 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4117.908184 2021-02-19 03:32:31,660 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4952.829741 2021-02-19 03:32:31,727 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4776.000000 2021-02-19 03:32:31,803 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:31,841 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3915.300000 2021-02-19 03:32:31,944 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:32,161 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 76.36 % 2021-02-19 03:32:32,161 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 76.3636214934 2021-02-19 03:32:32,187 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:32,275 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2278.115768 2021-02-19 03:32:32,433 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5550.861876 2021-02-19 03:32:32,480 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3244.535130 2021-02-19 03:32:32,746 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4035.408184 2021-02-19 03:32:33,312 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4977.729741 2021-02-19 03:32:33,351 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4793.300000 2021-02-19 03:32:33,437 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:33,499 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3924.500000 2021-02-19 03:32:33,565 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:33,811 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:33,963 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2468.015768 2021-02-19 03:32:34,125 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5550.861876 2021-02-19 03:32:34,144 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3244.535130 2021-02-19 03:32:34,361 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4035.408184 2021-02-19 03:32:34,944 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4977.729741 2021-02-19 03:32:34,977 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4793.300000 2021-02-19 03:32:35,063 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:35,125 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3924.500000 2021-02-19 03:32:35,178 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:35,413 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:35,621 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2542.015768 2021-02-19 03:32:35,756 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5550.861876 2021-02-19 03:32:35,759 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3244.535130 2021-02-19 03:32:35,986 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3992.608184 2021-02-19 03:32:36,648 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4984.029741 2021-02-19 03:32:36,663 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4812.700000 2021-02-19 03:32:36,760 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:36,763 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3942.900000 2021-02-19 03:32:36,828 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:37,019 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:37,207 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 76.85 % 2021-02-19 03:32:37,207 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 76.8458508742 2021-02-19 03:32:37,296 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2542.015768 2021-02-19 03:32:37,400 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5550.461876 2021-02-19 03:32:37,413 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3269.235130 2021-02-19 03:32:37,602 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3992.608184 2021-02-19 03:32:38,292 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4812.700000 2021-02-19 03:32:38,335 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4984.029741 2021-02-19 03:32:38,403 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:38,428 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3942.900000 2021-02-19 03:32:38,469 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:38,618 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:38,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2542.015768 2021-02-19 03:32:39,055 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5550.461876 2021-02-19 03:32:39,058 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3269.235130 2021-02-19 03:32:39,210 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3992.608184 2021-02-19 03:32:39,954 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4812.700000 2021-02-19 03:32:40,000 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5043.589379 2021-02-19 03:32:40,085 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:40,095 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3942.900000 2021-02-19 03:32:40,105 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:40,240 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:40,618 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2408.918036 2021-02-19 03:32:40,697 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3295.317034 2021-02-19 03:32:40,706 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5594.225651 2021-02-19 03:32:40,859 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3934.876353 2021-02-19 03:32:41,612 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4812.700000 2021-02-19 03:32:41,681 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5043.589379 2021-02-19 03:32:41,710 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:41,746 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3942.900000 2021-02-19 03:32:41,763 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:41,865 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:42,234 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2408.918036 2021-02-19 03:32:42,252 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 77.30 % 2021-02-19 03:32:42,252 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 77.2988247587 2021-02-19 03:32:42,332 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3293.617034 2021-02-19 03:32:42,338 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5581.525651 2021-02-19 03:32:42,483 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3904.776353 2021-02-19 03:32:43,227 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4754.600000 2021-02-19 03:32:43,315 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5037.789379 2021-02-19 03:32:43,349 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:43,408 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4054.600000 2021-02-19 03:32:43,421 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:43,496 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:43,858 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2258.918036 2021-02-19 03:32:43,963 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5581.525651 2021-02-19 03:32:43,973 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3293.617034 2021-02-19 03:32:44,099 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3904.776353 2021-02-19 03:32:44,865 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4754.600000 2021-02-19 03:32:44,967 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5037.789379 2021-02-19 03:32:44,993 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:45,049 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4054.600000 2021-02-19 03:32:45,079 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:45,131 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:45,533 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2043.153553 2021-02-19 03:32:45,595 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5603.870677 2021-02-19 03:32:45,665 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3311.089867 2021-02-19 03:32:45,734 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3904.776353 2021-02-19 03:32:46,473 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4801.660527 2021-02-19 03:32:46,655 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5058.668004 2021-02-19 03:32:46,665 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:46,710 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4038.824451 2021-02-19 03:32:46,720 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:46,756 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:47,173 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2043.153553 2021-02-19 03:32:47,236 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5603.870677 2021-02-19 03:32:47,290 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3311.089867 2021-02-19 03:32:47,292 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 77.94 % 2021-02-19 03:32:47,292 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 77.940747224 2021-02-19 03:32:47,364 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3893.707915 2021-02-19 03:32:48,108 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4801.660527 2021-02-19 03:32:48,309 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:48,335 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4038.824451 2021-02-19 03:32:48,358 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5058.668004 2021-02-19 03:32:48,375 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:48,385 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:48,805 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2043.153553 2021-02-19 03:32:48,880 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5603.870677 2021-02-19 03:32:48,926 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3311.089867 2021-02-19 03:32:48,987 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3893.707915 2021-02-19 03:32:49,721 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4801.660527 2021-02-19 03:32:49,960 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:49,979 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4038.824451 2021-02-19 03:32:49,996 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5039.378626 2021-02-19 03:32:50,032 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:50,039 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:50,450 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2024.035517 2021-02-19 03:32:50,525 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5703.345026 2021-02-19 03:32:50,576 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3316.272833 2021-02-19 03:32:50,631 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3948.731562 2021-02-19 03:32:51,055 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 78.38 % 2021-02-19 03:32:51,055 | test | INFO | MainThread | [Magma:abort_rebalance:933] Rebalance % = 78.3806110914 2021-02-19 03:32:51,065 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 78.38 % 2021-02-19 03:32:51,078 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:32:51,079 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:32:51,332 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4801.660527 2021-02-19 03:32:51,607 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4038.824451 2021-02-19 03:32:51,625 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:51,657 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5039.378626 2021-02-19 03:32:51,684 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:51,707 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:52,104 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2024.035517 2021-02-19 03:32:52,161 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5703.345026 2021-02-19 03:32:52,209 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3316.272833 2021-02-19 03:32:52,262 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4006.931562 2021-02-19 03:32:52,338 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 78.48 % 2021-02-19 03:32:52,338 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 78.4816276311 2021-02-19 03:32:52,934 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4988.760527 2021-02-19 03:32:53,244 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4005.124451 2021-02-19 03:32:53,283 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:53,312 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5010.378626 2021-02-19 03:32:53,339 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:53,365 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:53,776 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1573.935517 2021-02-19 03:32:53,834 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3345.572833 2021-02-19 03:32:53,848 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5759.245026 2021-02-19 03:32:53,881 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4006.931562 2021-02-19 03:32:54,529 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4988.760527 2021-02-19 03:32:54,865 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4005.124451 2021-02-19 03:32:54,914 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:54,940 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5010.378626 2021-02-19 03:32:54,971 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:54,983 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:55,405 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1573.935517 2021-02-19 03:32:55,457 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3366.652463 2021-02-19 03:32:55,483 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5797.801241 2021-02-19 03:32:55,516 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4061.734201 2021-02-19 03:32:56,132 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4991.142331 2021-02-19 03:32:56,516 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4086.573288 2021-02-19 03:32:56,562 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:56,637 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4955.355346 2021-02-19 03:32:56,644 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:56,660 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:57,032 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1183.896436 2021-02-19 03:32:57,086 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3366.652463 2021-02-19 03:32:57,118 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5797.801241 2021-02-19 03:32:57,132 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4061.734201 2021-02-19 03:32:57,382 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 79.27 % 2021-02-19 03:32:57,382 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 79.2669319628 2021-02-19 03:32:57,747 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4991.142331 2021-02-19 03:32:58,118 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4086.573288 2021-02-19 03:32:58,176 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:58,269 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:58,301 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4955.355346 2021-02-19 03:32:58,315 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:32:58,657 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1183.896436 2021-02-19 03:32:58,740 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5797.801241 2021-02-19 03:32:58,752 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3366.652463 2021-02-19 03:32:58,793 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4061.734201 2021-02-19 03:32:59,351 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4991.142331 2021-02-19 03:32:59,744 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4086.573288 2021-02-19 03:32:59,805 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:32:59,887 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:32:59,953 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4955.355346 2021-02-19 03:32:59,960 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:00,288 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1073.996436 2021-02-19 03:33:00,369 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5723.301241 2021-02-19 03:33:00,381 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3367.952463 2021-02-19 03:33:00,420 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4094.834201 2021-02-19 03:33:00,956 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4991.142331 2021-02-19 03:33:01,096 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 79.69 % 2021-02-19 03:33:01,111 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:33:01,112 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:33:01,390 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4086.573288 2021-02-19 03:33:01,437 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:01,502 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:01,592 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:01,617 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4933.355346 2021-02-19 03:33:01,913 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1073.996436 2021-02-19 03:33:02,000 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5723.301241 2021-02-19 03:33:02,009 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3367.952463 2021-02-19 03:33:02,043 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4094.834201 2021-02-19 03:33:02,437 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 79.89 % 2021-02-19 03:33:02,437 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 79.8860008859 2021-02-19 03:33:02,552 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4884.242331 2021-02-19 03:33:03,000 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4179.573288 2021-02-19 03:33:03,081 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:03,141 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:03,232 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:03,253 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4971.155346 2021-02-19 03:33:03,566 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1013.896436 2021-02-19 03:33:03,664 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5687.201241 2021-02-19 03:33:03,671 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3347.552463 2021-02-19 03:33:03,710 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4081.534201 2021-02-19 03:33:04,154 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4884.242331 2021-02-19 03:33:04,618 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4179.573288 2021-02-19 03:33:04,713 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:04,759 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:04,875 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:04,900 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4971.155346 2021-02-19 03:33:05,210 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1013.896436 2021-02-19 03:33:05,318 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5687.201241 2021-02-19 03:33:05,334 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3347.552463 2021-02-19 03:33:05,346 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4081.534201 2021-02-19 03:33:05,756 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4884.242331 2021-02-19 03:33:06,253 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4243.300000 2021-02-19 03:33:06,345 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:06,382 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:06,509 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:06,532 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5060.400000 2021-02-19 03:33:06,851 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 947.900000 2021-02-19 03:33:06,982 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5662.600000 2021-02-19 03:33:06,996 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3310.700000 2021-02-19 03:33:07,000 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4049.100000 2021-02-19 03:33:07,378 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4876.600000 2021-02-19 03:33:07,483 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.30 % 2021-02-19 03:33:07,483 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 80.2997593839 2021-02-19 03:33:07,872 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4243.300000 2021-02-19 03:33:07,992 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:08,048 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:08,177 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5060.400000 2021-02-19 03:33:08,181 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:08,519 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 947.900000 2021-02-19 03:33:08,632 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5662.600000 2021-02-19 03:33:08,658 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3310.700000 2021-02-19 03:33:08,665 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4049.100000 2021-02-19 03:33:08,984 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4876.600000 2021-02-19 03:33:09,519 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4243.300000 2021-02-19 03:33:09,627 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:09,697 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:09,828 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5060.400000 2021-02-19 03:33:09,832 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:10,167 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1698.200000 2021-02-19 03:33:10,260 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5629.900000 2021-02-19 03:33:10,305 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3251.400000 2021-02-19 03:33:10,313 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3960.000000 2021-02-19 03:33:10,594 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4876.600000 2021-02-19 03:33:11,124 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.74 % 2021-02-19 03:33:11,140 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:33:11,140 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:33:11,141 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4243.300000 2021-02-19 03:33:11,236 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:11,361 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:11,453 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:11,476 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5081.000000 2021-02-19 03:33:11,788 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1698.200000 2021-02-19 03:33:11,953 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3960.000000 2021-02-19 03:33:11,967 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5629.900000 2021-02-19 03:33:11,983 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3251.400000 2021-02-19 03:33:12,223 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4876.600000 2021-02-19 03:33:12,548 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.90 % 2021-02-19 03:33:12,548 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 80.8960388409 2021-02-19 03:33:12,756 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4058.800000 2021-02-19 03:33:12,838 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:12,996 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:13,086 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:13,111 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5080.600000 2021-02-19 03:33:13,420 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2732.100000 2021-02-19 03:33:13,588 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3914.400000 2021-02-19 03:33:13,611 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5553.200000 2021-02-19 03:33:13,618 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3180.500000 2021-02-19 03:33:13,854 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4457.300000 2021-02-19 03:33:14,359 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4058.800000 2021-02-19 03:33:14,446 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:14,608 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:14,744 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:14,782 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5080.600000 2021-02-19 03:33:15,043 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2732.100000 2021-02-19 03:33:15,229 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3914.400000 2021-02-19 03:33:15,263 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5553.200000 2021-02-19 03:33:15,266 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3180.500000 2021-02-19 03:33:15,473 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3725.900000 2021-02-19 03:33:15,967 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3799.700000 2021-02-19 03:33:16,052 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:16,246 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:16,365 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:16,440 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5032.200000 2021-02-19 03:33:16,664 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4162.600000 2021-02-19 03:33:16,920 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3902.300000 2021-02-19 03:33:16,953 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5410.400000 2021-02-19 03:33:16,961 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3108.000000 2021-02-19 03:33:17,095 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3725.900000 2021-02-19 03:33:17,565 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3799.700000 2021-02-19 03:33:17,596 | test | DEBUG | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 81.49 % 2021-02-19 03:33:17,598 | test | INFO | pool-1-thread-22 | [task:check:330] Rebalance - status: running, progress: 81.4857887144 2021-02-19 03:33:17,657 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:17,862 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:18,003 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:18,062 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5032.200000 2021-02-19 03:33:18,278 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4162.600000 2021-02-19 03:33:18,562 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3902.300000 2021-02-19 03:33:18,598 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3108.000000 2021-02-19 03:33:18,607 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5410.400000 2021-02-19 03:33:18,721 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3725.900000 2021-02-19 03:33:19,170 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3799.700000 2021-02-19 03:33:19,266 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:19,471 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:19,638 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:19,694 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5040.300000 2021-02-19 03:33:19,901 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4162.600000 2021-02-19 03:33:20,180 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3957.300000 2021-02-19 03:33:20,227 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3099.000000 2021-02-19 03:33:20,243 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5332.600000 2021-02-19 03:33:20,345 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3803.600000 2021-02-19 03:33:20,786 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3799.700000 2021-02-19 03:33:20,869 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:21,085 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:21,141 | test | INFO | MainThread | [rest_client:rebalance_reached:108] Rebalance reached >80.7363839779% in 30.0840001106 seconds 2021-02-19 03:33:21,161 | test | DEBUG | MainThread | [rest_client:diag_eval:1363] /diag/eval status on 172.23.110.64:8091: 1 content: true command: ns_orchestrator:needs_rebalance() 2021-02-19 03:33:21,161 | test | INFO | MainThread | [Magma:abort_rebalance:912] Abort rebalance 2021-02-19 03:33:21,299 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:21,348 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5040.300000 2021-02-19 03:33:21,523 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4966.200000 2021-02-19 03:33:21,592 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L914 2021-02-19 03:33:21,592 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 60 seconds. Reason: Sleep after error introduction 2021-02-19 03:33:21,805 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3957.300000 2021-02-19 03:33:21,848 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3099.000000 2021-02-19 03:33:21,869 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5332.600000 2021-02-19 03:33:21,947 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3803.600000 2021-02-19 03:33:22,384 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3776.700000 2021-02-19 03:33:22,522 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:22,641 | test | ERROR | pool-1-thread-22 | [rest_client:_rebalance_status_and_progress:1494] {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 03:33:22,665 | test | ERROR | pool-1-thread-22 | [task:call:242] Expecting , delimiter: line 1 column 19227 (char 19226) 2021-02-19 03:33:22,687 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:22,897 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:22,960 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5010.400000 2021-02-19 03:33:23,138 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5322.600000 2021-02-19 03:33:23,417 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3988.600000 2021-02-19 03:33:23,523 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3155.700000 2021-02-19 03:33:23,529 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5372.900000 2021-02-19 03:33:23,543 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3073.700000 2021-02-19 03:33:24,040 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3776.700000 2021-02-19 03:33:24,141 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:24,346 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:24,555 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:24,599 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5010.400000 2021-02-19 03:33:24,759 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5322.600000 2021-02-19 03:33:25,026 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3988.600000 2021-02-19 03:33:25,134 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3155.700000 2021-02-19 03:33:25,157 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5372.900000 2021-02-19 03:33:25,161 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3073.700000 2021-02-19 03:33:25,648 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3551.874601 2021-02-19 03:33:25,740 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:25,970 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:26,191 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:26,243 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4732.172684 2021-02-19 03:33:26,349 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5007.259425 2021-02-19 03:33:26,634 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3760.557188 2021-02-19 03:33:26,749 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3051.438498 2021-02-19 03:33:26,759 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2390.652236 2021-02-19 03:33:26,772 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5161.837220 2021-02-19 03:33:27,263 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3551.874601 2021-02-19 03:33:27,342 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:27,581 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:27,799 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:27,859 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4732.172684 2021-02-19 03:33:27,993 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5007.259425 2021-02-19 03:33:28,292 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3760.557188 2021-02-19 03:33:28,387 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2390.652236 2021-02-19 03:33:28,414 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5161.837220 2021-02-19 03:33:28,426 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3051.438498 2021-02-19 03:33:28,864 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3551.874601 2021-02-19 03:33:28,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:29,184 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:29,427 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:29,500 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3714.243593 2021-02-19 03:33:29,586 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3931.256001 2021-02-19 03:33:29,903 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3760.557188 2021-02-19 03:33:30,012 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2370.654143 2021-02-19 03:33:30,039 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4104.912582 2021-02-19 03:33:30,051 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2454.973100 2021-02-19 03:33:30,454 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3551.874601 2021-02-19 03:33:30,516 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:30,782 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:31,068 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:31,153 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3714.243593 2021-02-19 03:33:31,194 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3931.256001 2021-02-19 03:33:31,512 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2918.407104 2021-02-19 03:33:31,628 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2370.654143 2021-02-19 03:33:31,671 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4104.912582 2021-02-19 03:33:31,678 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2454.973100 2021-02-19 03:33:32,062 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3551.874601 2021-02-19 03:33:32,144 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:32,385 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:32,663 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:32,763 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2058.743593 2021-02-19 03:33:32,802 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2170.756001 2021-02-19 03:33:33,130 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1589.307104 2021-02-19 03:33:33,298 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1087.554143 2021-02-19 03:33:33,319 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2259.612582 2021-02-19 03:33:33,328 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1363.673100 2021-02-19 03:33:33,651 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1640.874601 2021-02-19 03:33:33,733 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:33,992 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:34,272 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:34,384 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2058.743593 2021-02-19 03:33:34,408 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2170.756001 2021-02-19 03:33:34,740 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1589.307104 2021-02-19 03:33:34,927 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1087.554143 2021-02-19 03:33:34,944 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2259.612582 2021-02-19 03:33:34,954 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1363.673100 2021-02-19 03:33:35,252 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1640.874601 2021-02-19 03:33:35,325 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:35,594 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:35,904 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:36,007 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 666.670909 2021-02-19 03:33:36,062 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 707.896576 2021-02-19 03:33:36,346 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 500.049915 2021-02-19 03:33:36,548 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 60.402447 2021-02-19 03:33:36,573 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 720.375362 2021-02-19 03:33:36,585 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 450.234601 2021-02-19 03:33:36,845 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:33:36,917 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:37,234 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:37,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:37,628 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 666.670909 2021-02-19 03:33:37,674 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 707.896576 2021-02-19 03:33:37,947 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 500.049915 2021-02-19 03:33:38,167 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 60.402447 2021-02-19 03:33:38,206 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 720.375362 2021-02-19 03:33:38,220 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 450.234601 2021-02-19 03:33:38,441 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:33:38,517 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:38,823 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:39,101 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:39,256 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 666.670909 2021-02-19 03:33:39,290 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 707.896576 2021-02-19 03:33:39,548 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 336.672343 2021-02-19 03:33:39,790 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 60.402447 2021-02-19 03:33:39,835 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 720.375362 2021-02-19 03:33:39,849 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 450.234601 2021-02-19 03:33:40,046 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:33:40,127 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:40,436 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:40,700 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:40,881 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2.900681 2021-02-19 03:33:40,934 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 69.718521 2021-02-19 03:33:41,161 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 336.672343 2021-02-19 03:33:41,420 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4.503605 2021-02-19 03:33:41,483 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 238.104778 2021-02-19 03:33:41,503 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:33:41,663 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:33:41,756 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:42,036 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:42,303 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:42,507 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 7.000681 2021-02-19 03:33:42,555 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 722.618521 2021-02-19 03:33:42,780 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1110.472343 2021-02-19 03:33:43,066 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 56.203605 2021-02-19 03:33:43,118 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:33:43,137 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1129.704778 2021-02-19 03:33:43,256 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3.700000 2021-02-19 03:33:43,381 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:43,632 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:43,907 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:44,131 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 7.000681 2021-02-19 03:33:44,168 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 722.618521 2021-02-19 03:33:44,384 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1110.472343 2021-02-19 03:33:44,737 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 56.203605 2021-02-19 03:33:44,750 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:33:44,819 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1129.704778 2021-02-19 03:33:44,878 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3.700000 2021-02-19 03:33:44,986 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:45,240 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:45,523 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:45,763 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 7.000681 2021-02-19 03:33:45,809 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 722.618521 2021-02-19 03:33:46,006 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2243.758944 2021-02-19 03:33:46,365 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 549.898018 2021-02-19 03:33:46,385 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.801122 2021-02-19 03:33:46,463 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2595.256551 2021-02-19 03:33:46,506 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 410.669758 2021-02-19 03:33:46,615 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:46,838 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:47,124 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:47,410 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 7.701663 2021-02-19 03:33:47,447 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1850.697833 2021-02-19 03:33:47,615 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2243.758944 2021-02-19 03:33:47,990 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 549.898018 2021-02-19 03:33:48,017 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.801122 2021-02-19 03:33:48,092 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2595.256551 2021-02-19 03:33:48,127 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 410.669758 2021-02-19 03:33:48,243 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:48,453 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:48,724 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:49,036 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 7.701663 2021-02-19 03:33:49,059 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1850.697833 2021-02-19 03:33:49,244 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2243.758944 2021-02-19 03:33:49,628 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 762.594953 2021-02-19 03:33:49,648 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.801122 2021-02-19 03:33:49,709 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4406.951772 2021-02-19 03:33:49,737 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 410.669758 2021-02-19 03:33:49,851 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:50,059 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:50,319 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:50,657 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 7.400981 2021-02-19 03:33:50,680 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3546.479311 2021-02-19 03:33:50,865 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3316.786601 2021-02-19 03:33:51,243 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 762.594953 2021-02-19 03:33:51,282 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.801122 2021-02-19 03:33:51,336 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4406.951772 2021-02-19 03:33:51,361 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 410.669758 2021-02-19 03:33:51,456 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:51,654 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:51,917 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:52,290 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800981 2021-02-19 03:33:52,299 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4549.779311 2021-02-19 03:33:52,473 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3927.586601 2021-02-19 03:33:52,880 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2922.594953 2021-02-19 03:33:52,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2.301122 2021-02-19 03:33:52,960 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5463.051772 2021-02-19 03:33:52,980 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2306.769758 2021-02-19 03:33:53,075 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:53,263 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:53,516 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:53,927 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800981 2021-02-19 03:33:53,948 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4549.779311 2021-02-19 03:33:54,109 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3927.586601 2021-02-19 03:33:54,506 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2922.594953 2021-02-19 03:33:54,555 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2.301122 2021-02-19 03:33:54,608 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5463.051772 2021-02-19 03:33:54,615 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2306.769758 2021-02-19 03:33:54,687 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:54,869 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:55,109 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:55,533 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.100000 2021-02-19 03:33:55,562 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5037.900000 2021-02-19 03:33:55,727 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4201.400000 2021-02-19 03:33:56,130 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4865.400000 2021-02-19 03:33:56,213 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.500000 2021-02-19 03:33:56,232 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5883.900000 2021-02-19 03:33:56,246 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4027.500000 2021-02-19 03:33:56,322 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:56,473 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:56,710 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:57,154 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.100000 2021-02-19 03:33:57,191 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5037.900000 2021-02-19 03:33:57,331 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4201.400000 2021-02-19 03:33:57,772 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4865.400000 2021-02-19 03:33:57,834 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.500000 2021-02-19 03:33:57,865 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5883.900000 2021-02-19 03:33:57,881 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4027.500000 2021-02-19 03:33:57,959 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:58,095 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:58,328 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:33:58,773 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.100000 2021-02-19 03:33:58,851 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5037.900000 2021-02-19 03:33:58,997 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4201.400000 2021-02-19 03:33:59,390 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5005.716147 2021-02-19 03:33:59,450 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.500000 2021-02-19 03:33:59,480 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4027.500000 2021-02-19 03:33:59,519 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5698.608393 2021-02-19 03:33:59,575 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:33:59,697 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:33:59,924 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:00,407 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:34:00,529 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4886.208953 2021-02-19 03:34:00,657 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4174.094085 2021-02-19 03:34:01,029 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5005.716147 2021-02-19 03:34:01,099 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4027.500000 2021-02-19 03:34:01,109 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.500000 2021-02-19 03:34:01,144 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5698.608393 2021-02-19 03:34:01,217 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:01,308 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:01,517 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:02,017 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:34:02,154 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4886.208953 2021-02-19 03:34:02,263 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4166.794085 2021-02-19 03:34:02,680 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5423.416147 2021-02-19 03:34:02,719 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4212.700000 2021-02-19 03:34:02,773 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:34:02,801 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5653.808393 2021-02-19 03:34:02,828 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:02,930 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:03,105 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:03,631 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:34:03,776 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4775.308953 2021-02-19 03:34:03,901 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4166.794085 2021-02-19 03:34:04,322 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5423.416147 2021-02-19 03:34:04,364 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4212.700000 2021-02-19 03:34:04,460 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:34:04,474 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:04,479 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5653.808393 2021-02-19 03:34:04,545 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:04,707 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:05,242 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:34:05,391 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4775.308953 2021-02-19 03:34:05,505 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4100.794085 2021-02-19 03:34:05,967 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5423.416147 2021-02-19 03:34:06,005 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4212.700000 2021-02-19 03:34:06,140 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:34:06,164 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5680.708393 2021-02-19 03:34:06,167 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:06,190 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:06,325 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:06,894 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:34:07,065 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4690.608953 2021-02-19 03:34:07,131 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4100.794085 2021-02-19 03:34:07,609 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4107.400000 2021-02-19 03:34:07,644 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5656.716147 2021-02-19 03:34:07,776 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:34:07,806 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:07,826 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5680.708393 2021-02-19 03:34:07,836 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:07,937 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:08,500 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:34:08,690 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4690.608953 2021-02-19 03:34:08,757 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4100.794085 2021-02-19 03:34:09,234 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4107.400000 2021-02-19 03:34:09,332 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5656.716147 2021-02-19 03:34:09,400 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:34:09,444 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:09,469 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5778.785034 2021-02-19 03:34:09,473 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:09,556 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:10,098 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500200 2021-02-19 03:34:10,316 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4570.197359 2021-02-19 03:34:10,371 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4058.335974 2021-02-19 03:34:10,828 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4107.400000 2021-02-19 03:34:10,960 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5673.348579 2021-02-19 03:34:11,023 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:34:11,104 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:11,124 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:11,138 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5778.785034 2021-02-19 03:34:11,191 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:11,717 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500200 2021-02-19 03:34:11,950 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4570.197359 2021-02-19 03:34:11,999 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4058.335974 2021-02-19 03:34:12,460 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4077.900000 2021-02-19 03:34:12,595 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5745.648579 2021-02-19 03:34:12,664 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.600000 2021-02-19 03:34:12,746 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:12,756 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:12,790 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5831.185034 2021-02-19 03:34:12,844 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:13,336 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.200200 2021-02-19 03:34:13,588 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4575.297359 2021-02-19 03:34:13,641 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4020.235974 2021-02-19 03:34:14,065 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4077.900000 2021-02-19 03:34:14,244 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5745.648579 2021-02-19 03:34:14,292 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.600000 2021-02-19 03:34:14,395 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:14,405 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:14,434 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5831.185034 2021-02-19 03:34:14,473 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:14,966 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.200200 2021-02-19 03:34:15,214 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4575.297359 2021-02-19 03:34:15,260 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4020.235974 2021-02-19 03:34:15,674 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4132.000000 2021-02-19 03:34:15,871 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5745.648579 2021-02-19 03:34:15,930 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.600000 2021-02-19 03:34:16,040 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:16,042 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:16,076 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5861.685034 2021-02-19 03:34:16,122 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:16,572 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 333.500200 2021-02-19 03:34:16,852 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4646.297359 2021-02-19 03:34:16,885 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4035.235974 2021-02-19 03:34:17,295 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4132.000000 2021-02-19 03:34:17,496 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5716.748579 2021-02-19 03:34:17,572 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 79.700000 2021-02-19 03:34:17,687 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:17,716 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:17,729 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5861.685034 2021-02-19 03:34:17,763 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:18,174 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 333.500200 2021-02-19 03:34:18,469 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4646.297359 2021-02-19 03:34:18,500 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4035.235974 2021-02-19 03:34:18,908 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4132.000000 2021-02-19 03:34:19,108 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5716.748579 2021-02-19 03:34:19,216 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 79.700000 2021-02-19 03:34:19,325 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:19,384 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:19,384 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5861.685034 2021-02-19 03:34:19,397 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:19,776 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 333.500200 2021-02-19 03:34:20,109 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4871.300000 2021-02-19 03:34:20,130 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4010.600000 2021-02-19 03:34:20,503 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4132.000000 2021-02-19 03:34:20,716 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5684.700000 2021-02-19 03:34:20,851 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 637.800000 2021-02-19 03:34:21,006 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:21,048 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:21,075 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:21,081 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5796.900000 2021-02-19 03:34:21,382 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1338.400000 2021-02-19 03:34:21,617 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.69:8091 2021-02-19 03:34:21,617 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 03:34:21,635 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.69:8091 is running 2021-02-19 03:34:21,635 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.0. 2021-02-19 03:34:21,635 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.0. 2021-02-19 03:34:21,635 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.0. 2021-02-19 03:34:21,637 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.0. 2021-02-19 03:34:21,637 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.0. 2021-02-19 03:34:21,637 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.0. 2021-02-19 03:34:21,637 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.0. 2021-02-19 03:34:21,637 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.0. 2021-02-19 03:34:21,637 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.0. 2021-02-19 03:34:21,637 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.0. 2021-02-19 03:34:21,657 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.64:8091 2021-02-19 03:34:21,658 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 03:34:21,676 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.64:8091 is running 2021-02-19 03:34:21,677 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.0. 2021-02-19 03:34:21,677 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.0. 2021-02-19 03:34:21,677 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.0. 2021-02-19 03:34:21,677 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.0. 2021-02-19 03:34:21,677 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.0. 2021-02-19 03:34:21,677 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.0. 2021-02-19 03:34:21,677 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.0. 2021-02-19 03:34:21,677 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.0. 2021-02-19 03:34:21,677 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.0. 2021-02-19 03:34:21,677 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.0. 2021-02-19 03:34:21,697 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.65:8091 2021-02-19 03:34:21,697 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 03:34:21,716 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.65:8091 is running 2021-02-19 03:34:21,716 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.0. 2021-02-19 03:34:21,717 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.0. 2021-02-19 03:34:21,717 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.0. 2021-02-19 03:34:21,717 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.0. 2021-02-19 03:34:21,717 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.0. 2021-02-19 03:34:21,717 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.0. 2021-02-19 03:34:21,717 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.0. 2021-02-19 03:34:21,717 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.0. 2021-02-19 03:34:21,717 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.0. 2021-02-19 03:34:21,717 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.0. 2021-02-19 03:34:21,717 | test | INFO | MainThread | [Magma:abort_rebalance:927] Restarting Rebalance after killing at 80 2021-02-19 03:34:21,743 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4871.300000 2021-02-19 03:34:21,760 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4010.600000 2021-02-19 03:34:21,785 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[]_OUT=[]_1613734461.72 2021-02-19 03:34:21,786 | infra | INFO | pool-1-thread-23 | [task:start_task:84] Thread 'Rebalance_task_IN=[]_OUT=[]_1613734461.72' started 2021-02-19 03:34:21,805 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L932 2021-02-19 03:34:21,805 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 120 seconds. Reason: Let the rebalance begin after abort 2021-02-19 03:34:21,828 | test | DEBUG | pool-1-thread-23 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': '', 'user': 'Administrator'} 2021-02-19 03:34:21,869 | test | DEBUG | pool-1-thread-23 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 03:34:21,875 | test | INFO | pool-1-thread-23 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+---------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 13.6029463445 | Cluster node | | 172.23.110.69 | kv | 7.0.0-4498-enterprise | 10.7165406255 | Cluster node | | 172.23.110.65 | kv | 7.0.0-4498-enterprise | 14.206171108 | Cluster node | +---------------+----------+-----------------------+---------------+--------------+ 2021-02-19 03:34:21,888 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 03:34:21,888 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 03:34:22,107 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4132.000000 2021-02-19 03:34:22,325 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5345.100000 2021-02-19 03:34:22,480 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1450.100000 2021-02-19 03:34:22,670 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:22,707 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:22,721 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:22,739 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5655.700000 2021-02-19 03:34:23,015 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2816.400000 2021-02-19 03:34:23,367 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5074.000000 2021-02-19 03:34:23,374 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3948.500000 2021-02-19 03:34:23,730 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3996.000000 2021-02-19 03:34:23,940 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5345.100000 2021-02-19 03:34:24,118 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1450.100000 2021-02-19 03:34:24,296 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:24,362 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:24,394 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:24,394 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5655.700000 2021-02-19 03:34:24,640 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2816.400000 2021-02-19 03:34:25,002 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5074.000000 2021-02-19 03:34:25,009 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3948.500000 2021-02-19 03:34:25,348 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3996.000000 2021-02-19 03:34:25,575 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4957.400000 2021-02-19 03:34:25,770 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2376.600000 2021-02-19 03:34:25,946 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:25,996 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:26,042 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:26,059 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5655.700000 2021-02-19 03:34:26,263 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4040.100000 2021-02-19 03:34:26,627 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5195.800000 2021-02-19 03:34:26,638 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3837.000000 2021-02-19 03:34:26,931 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.26 % 2021-02-19 03:34:26,933 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 80.263782714 2021-02-19 03:34:26,980 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3798.000000 2021-02-19 03:34:27,178 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4957.400000 2021-02-19 03:34:27,388 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2376.600000 2021-02-19 03:34:27,594 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:27,621 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:27,680 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:27,704 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5506.500000 2021-02-19 03:34:27,888 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4040.100000 2021-02-19 03:34:28,299 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5195.800000 2021-02-19 03:34:28,312 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3837.000000 2021-02-19 03:34:28,605 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3798.000000 2021-02-19 03:34:28,828 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4957.400000 2021-02-19 03:34:29,003 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2376.600000 2021-02-19 03:34:29,257 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:29,276 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:29,361 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:29,368 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5506.500000 2021-02-19 03:34:29,510 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4596.724810 2021-02-19 03:34:29,927 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5195.800000 2021-02-19 03:34:29,937 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3837.000000 2021-02-19 03:34:30,216 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3798.000000 2021-02-19 03:34:30,450 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4859.096439 2021-02-19 03:34:30,608 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2815.398760 2021-02-19 03:34:30,890 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:30,927 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:30,984 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:31,025 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5341.793237 2021-02-19 03:34:31,167 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4596.724810 2021-02-19 03:34:31,561 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5230.901401 2021-02-19 03:34:31,565 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3812.016126 2021-02-19 03:34:31,849 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3798.000000 2021-02-19 03:34:31,992 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 81.05 % 2021-02-19 03:34:31,992 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 81.0499007527 2021-02-19 03:34:32,063 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4859.096439 2021-02-19 03:34:32,221 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2815.398760 2021-02-19 03:34:32,525 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:32,559 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:32,608 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:32,668 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5320.593237 2021-02-19 03:34:32,799 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4686.024810 2021-02-19 03:34:33,211 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3848.216126 2021-02-19 03:34:33,226 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5300.901401 2021-02-19 03:34:33,479 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3847.500000 2021-02-19 03:34:33,700 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3960.896439 2021-02-19 03:34:33,841 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3031.898760 2021-02-19 03:34:34,180 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:34,210 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:34,234 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:34,325 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5320.593237 2021-02-19 03:34:34,424 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4686.024810 2021-02-19 03:34:34,855 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3848.216126 2021-02-19 03:34:34,864 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5300.901401 2021-02-19 03:34:35,098 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3847.500000 2021-02-19 03:34:35,349 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3960.896439 2021-02-19 03:34:35,466 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3075.298760 2021-02-19 03:34:35,793 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:35,878 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:35,894 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:35,973 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5320.593237 2021-02-19 03:34:36,046 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4686.024810 2021-02-19 03:34:36,480 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5425.401401 2021-02-19 03:34:36,493 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3936.816126 2021-02-19 03:34:36,711 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3946.900000 2021-02-19 03:34:36,980 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2826.496439 2021-02-19 03:34:37,048 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 81.74 % 2021-02-19 03:34:37,049 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 81.7385058195 2021-02-19 03:34:37,075 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3075.298760 2021-02-19 03:34:37,414 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:37,525 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:37,559 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:37,611 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5356.093237 2021-02-19 03:34:37,684 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4725.424810 2021-02-19 03:34:38,111 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5425.401401 2021-02-19 03:34:38,128 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3936.816126 2021-02-19 03:34:38,329 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3946.900000 2021-02-19 03:34:38,648 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2826.496439 2021-02-19 03:34:38,710 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3075.298760 2021-02-19 03:34:39,042 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:39,153 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:39,201 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:39,263 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5356.093237 2021-02-19 03:34:39,306 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4725.424810 2021-02-19 03:34:39,756 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5425.600000 2021-02-19 03:34:39,792 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3937.300000 2021-02-19 03:34:39,934 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3946.900000 2021-02-19 03:34:40,290 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2761.100000 2021-02-19 03:34:40,361 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3153.600000 2021-02-19 03:34:40,683 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:40,790 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:40,855 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:40,914 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5505.600000 2021-02-19 03:34:40,960 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4773.700000 2021-02-19 03:34:41,375 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5425.600000 2021-02-19 03:34:41,453 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3937.300000 2021-02-19 03:34:41,598 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3946.900000 2021-02-19 03:34:41,923 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2761.100000 2021-02-19 03:34:42,002 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3153.600000 2021-02-19 03:34:42,117 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 82.42 % 2021-02-19 03:34:42,117 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 82.4234865675 2021-02-19 03:34:42,296 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:42,414 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:42,486 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:42,555 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5625.900000 2021-02-19 03:34:42,624 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4764.200000 2021-02-19 03:34:42,994 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5366.800000 2021-02-19 03:34:43,075 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3925.900000 2021-02-19 03:34:43,219 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4000.400000 2021-02-19 03:34:43,546 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2180.100000 2021-02-19 03:34:43,631 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3213.100000 2021-02-19 03:34:43,914 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:44,036 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:44,121 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:44,240 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5625.900000 2021-02-19 03:34:44,296 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4764.200000 2021-02-19 03:34:44,627 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5366.800000 2021-02-19 03:34:44,717 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3925.900000 2021-02-19 03:34:44,845 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4000.400000 2021-02-19 03:34:45,180 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2180.100000 2021-02-19 03:34:45,252 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3213.100000 2021-02-19 03:34:45,528 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:45,676 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:45,756 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:45,877 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5625.900000 2021-02-19 03:34:45,920 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4764.200000 2021-02-19 03:34:46,256 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5331.100000 2021-02-19 03:34:46,345 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3848.200000 2021-02-19 03:34:46,460 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4070.000000 2021-02-19 03:34:46,801 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1914.700000 2021-02-19 03:34:46,875 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3269.200000 2021-02-19 03:34:47,170 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 82.95 % 2021-02-19 03:34:47,170 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 82.9467165067 2021-02-19 03:34:47,184 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:47,319 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:47,391 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:47,553 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5671.400000 2021-02-19 03:34:47,581 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4698.400000 2021-02-19 03:34:47,877 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5331.100000 2021-02-19 03:34:47,967 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3848.200000 2021-02-19 03:34:48,075 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4070.000000 2021-02-19 03:34:48,457 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1914.700000 2021-02-19 03:34:48,525 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3269.200000 2021-02-19 03:34:48,802 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:48,934 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:49,020 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:49,170 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5671.400000 2021-02-19 03:34:49,223 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4698.400000 2021-02-19 03:34:49,496 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5390.500000 2021-02-19 03:34:49,621 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3794.400000 2021-02-19 03:34:49,681 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4070.000000 2021-02-19 03:34:50,124 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1990.900000 2021-02-19 03:34:50,200 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3278.000000 2021-02-19 03:34:50,420 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:50,559 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:50,644 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:50,832 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5635.100000 2021-02-19 03:34:50,882 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4667.600000 2021-02-19 03:34:51,115 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5390.500000 2021-02-19 03:34:51,253 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3794.400000 2021-02-19 03:34:51,298 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4070.000000 2021-02-19 03:34:51,743 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1990.900000 2021-02-19 03:34:51,823 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3278.000000 2021-02-19 03:34:52,051 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:52,213 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:52,219 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 83.63 % 2021-02-19 03:34:52,219 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 83.6280729359 2021-02-19 03:34:52,305 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:52,471 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5569.100000 2021-02-19 03:34:52,510 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4746.600000 2021-02-19 03:34:52,739 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5474.300000 2021-02-19 03:34:52,864 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3790.500000 2021-02-19 03:34:52,917 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4023.000000 2021-02-19 03:34:53,368 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2027.200000 2021-02-19 03:34:53,441 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3231.200000 2021-02-19 03:34:53,663 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:53,832 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:53,964 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:54,121 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5569.100000 2021-02-19 03:34:54,135 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4746.600000 2021-02-19 03:34:54,355 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5474.300000 2021-02-19 03:34:54,496 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3790.500000 2021-02-19 03:34:54,526 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4023.000000 2021-02-19 03:34:54,979 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2027.200000 2021-02-19 03:34:55,073 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3231.200000 2021-02-19 03:34:55,288 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:55,446 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:55,578 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:55,779 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4843.900000 2021-02-19 03:34:55,792 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5541.600000 2021-02-19 03:34:56,005 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5474.300000 2021-02-19 03:34:56,112 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3872.500000 2021-02-19 03:34:56,134 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3966.400000 2021-02-19 03:34:56,588 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2110.400000 2021-02-19 03:34:56,703 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3154.100000 2021-02-19 03:34:56,918 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:57,134 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:57,249 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:57,269 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 84.27 % 2021-02-19 03:34:57,269 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 84.272346467 2021-02-19 03:34:57,415 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4843.900000 2021-02-19 03:34:57,436 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5541.600000 2021-02-19 03:34:57,628 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5457.000000 2021-02-19 03:34:57,782 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3872.500000 2021-02-19 03:34:57,786 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3966.400000 2021-02-19 03:34:58,197 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2110.400000 2021-02-19 03:34:58,328 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3154.100000 2021-02-19 03:34:58,526 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:34:58,736 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:34:58,867 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:34:59,071 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4843.900000 2021-02-19 03:34:59,075 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5541.600000 2021-02-19 03:34:59,253 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5457.000000 2021-02-19 03:34:59,400 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3966.400000 2021-02-19 03:34:59,410 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4000.798172 2021-02-19 03:34:59,806 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2157.471132 2021-02-19 03:34:59,944 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3154.100000 2021-02-19 03:35:00,134 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:00,344 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:00,482 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:00,697 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4916.482709 2021-02-19 03:35:00,724 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5578.028998 2021-02-19 03:35:00,871 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5478.681740 2021-02-19 03:35:01,003 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3966.400000 2021-02-19 03:35:01,029 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4000.798172 2021-02-19 03:35:01,447 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2157.471132 2021-02-19 03:35:01,586 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3129.234952 2021-02-19 03:35:01,749 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:01,970 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:02,094 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:02,311 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4948.682709 2021-02-19 03:35:02,328 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 84.80 % 2021-02-19 03:35:02,328 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 84.7952185604 2021-02-19 03:35:02,344 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5591.528998 2021-02-19 03:35:02,497 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5454.681740 2021-02-19 03:35:02,611 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3950.900000 2021-02-19 03:35:02,657 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4040.798172 2021-02-19 03:35:03,075 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2167.371132 2021-02-19 03:35:03,200 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3141.434952 2021-02-19 03:35:03,354 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:03,598 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:03,701 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:03,938 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4948.682709 2021-02-19 03:35:03,976 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5591.528998 2021-02-19 03:35:04,128 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5454.681740 2021-02-19 03:35:04,230 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3950.900000 2021-02-19 03:35:04,306 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4040.798172 2021-02-19 03:35:04,716 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2167.371132 2021-02-19 03:35:04,832 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3141.434952 2021-02-19 03:35:04,964 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:05,210 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:05,321 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:05,581 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5037.982709 2021-02-19 03:35:05,619 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5586.928998 2021-02-19 03:35:05,752 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5418.281740 2021-02-19 03:35:05,865 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3950.900000 2021-02-19 03:35:05,930 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4040.798172 2021-02-19 03:35:06,348 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2158.771132 2021-02-19 03:35:06,469 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3167.734952 2021-02-19 03:35:06,595 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:06,816 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:06,954 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:07,234 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5037.982709 2021-02-19 03:35:07,250 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5586.928998 2021-02-19 03:35:07,378 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 85.39 % 2021-02-19 03:35:07,378 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 85.3866639796 2021-02-19 03:35:07,384 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5418.281740 2021-02-19 03:35:07,490 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3871.500000 2021-02-19 03:35:07,552 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4050.698172 2021-02-19 03:35:07,963 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2158.771132 2021-02-19 03:35:08,095 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3167.734952 2021-02-19 03:35:08,210 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:08,414 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:08,553 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:08,878 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5037.982709 2021-02-19 03:35:08,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5586.928998 2021-02-19 03:35:09,013 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5418.281740 2021-02-19 03:35:09,101 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3871.500000 2021-02-19 03:35:09,188 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4050.698172 2021-02-19 03:35:09,596 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2251.030353 2021-02-19 03:35:09,736 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3165.762879 2021-02-19 03:35:09,825 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:10,006 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:10,161 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:10,502 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5123.211042 2021-02-19 03:35:10,519 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5575.558494 2021-02-19 03:35:10,645 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5339.531635 2021-02-19 03:35:10,733 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3871.500000 2021-02-19 03:35:10,855 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4005.051617 2021-02-19 03:35:11,239 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2251.030353 2021-02-19 03:35:11,368 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3165.762879 2021-02-19 03:35:11,447 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:11,618 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:11,775 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:12,174 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5123.211042 2021-02-19 03:35:12,180 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5575.558494 2021-02-19 03:35:12,279 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5255.031635 2021-02-19 03:35:12,349 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3905.000000 2021-02-19 03:35:12,424 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 86.03 % 2021-02-19 03:35:12,424 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 86.0262441761 2021-02-19 03:35:12,493 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3941.151617 2021-02-19 03:35:12,862 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2222.630353 2021-02-19 03:35:12,996 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3200.262879 2021-02-19 03:35:13,055 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:13,236 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:13,390 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:13,819 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5148.411042 2021-02-19 03:35:13,823 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5609.658494 2021-02-19 03:35:13,923 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5255.031635 2021-02-19 03:35:13,964 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3905.000000 2021-02-19 03:35:14,125 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3941.151617 2021-02-19 03:35:14,489 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2222.630353 2021-02-19 03:35:14,612 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3200.262879 2021-02-19 03:35:14,664 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:14,841 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:15,006 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:15,448 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5096.211042 2021-02-19 03:35:15,464 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5660.958494 2021-02-19 03:35:15,572 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5332.431635 2021-02-19 03:35:15,591 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3982.600000 2021-02-19 03:35:15,749 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3856.551617 2021-02-19 03:35:16,115 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2004.330353 2021-02-19 03:35:16,257 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3214.662879 2021-02-19 03:35:16,286 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:16,483 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:16,628 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:17,079 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5096.211042 2021-02-19 03:35:17,128 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5660.958494 2021-02-19 03:35:17,206 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5332.431635 2021-02-19 03:35:17,213 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3982.600000 2021-02-19 03:35:17,369 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3856.551617 2021-02-19 03:35:17,469 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 86.73 % 2021-02-19 03:35:17,470 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 86.7273279837 2021-02-19 03:35:17,763 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2004.330353 2021-02-19 03:35:17,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3214.662879 2021-02-19 03:35:17,921 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:18,095 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:18,255 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:18,757 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5096.211042 2021-02-19 03:35:18,769 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5660.958494 2021-02-19 03:35:18,838 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3982.600000 2021-02-19 03:35:18,881 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5332.431635 2021-02-19 03:35:18,990 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3856.551617 2021-02-19 03:35:19,417 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1979.623519 2021-02-19 03:35:19,548 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:19,592 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3241.091331 2021-02-19 03:35:19,750 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:19,861 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:20,400 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4987.982193 2021-02-19 03:35:20,417 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5632.504225 2021-02-19 03:35:20,467 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3982.600000 2021-02-19 03:35:20,509 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5463.147229 2021-02-19 03:35:20,624 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3845.299081 2021-02-19 03:35:21,063 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1979.623519 2021-02-19 03:35:21,173 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:21,233 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3241.091331 2021-02-19 03:35:21,380 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:21,510 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:22,043 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4987.982193 2021-02-19 03:35:22,055 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5632.504225 2021-02-19 03:35:22,095 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3982.600000 2021-02-19 03:35:22,141 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5463.147229 2021-02-19 03:35:22,249 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3845.299081 2021-02-19 03:35:22,517 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 87.48 % 2021-02-19 03:35:22,517 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 87.4767254916 2021-02-19 03:35:22,691 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1701.323519 2021-02-19 03:35:22,786 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:22,868 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3194.391331 2021-02-19 03:35:22,986 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:23,141 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:23,713 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5600.104225 2021-02-19 03:35:23,737 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4918.882193 2021-02-19 03:35:23,749 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3967.100000 2021-02-19 03:35:23,795 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5567.347229 2021-02-19 03:35:23,898 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3926.599081 2021-02-19 03:35:24,322 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1701.323519 2021-02-19 03:35:24,414 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:24,486 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3194.391331 2021-02-19 03:35:24,592 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:24,752 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:25,367 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5600.104225 2021-02-19 03:35:25,391 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3967.100000 2021-02-19 03:35:25,395 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4918.882193 2021-02-19 03:35:25,427 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5567.347229 2021-02-19 03:35:25,529 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3977.899081 2021-02-19 03:35:25,957 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1701.323519 2021-02-19 03:35:26,062 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:26,167 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3194.391331 2021-02-19 03:35:26,207 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:26,371 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:27,000 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5547.904225 2021-02-19 03:35:27,032 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3988.600000 2021-02-19 03:35:27,052 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4901.782193 2021-02-19 03:35:27,086 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5548.547229 2021-02-19 03:35:27,174 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3977.899081 2021-02-19 03:35:27,585 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 88.20 % 2021-02-19 03:35:27,585 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 88.1977156005 2021-02-19 03:35:27,596 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1528.523519 2021-02-19 03:35:27,697 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:27,815 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3156.391331 2021-02-19 03:35:27,838 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:27,983 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:28,664 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5547.904225 2021-02-19 03:35:28,694 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3988.600000 2021-02-19 03:35:28,698 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4901.782193 2021-02-19 03:35:28,726 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5548.547229 2021-02-19 03:35:28,822 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3977.899081 2021-02-19 03:35:29,227 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1528.523519 2021-02-19 03:35:29,352 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:29,466 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3156.008171 2021-02-19 03:35:29,496 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:29,601 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:30,303 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5627.999900 2021-02-19 03:35:30,322 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3988.600000 2021-02-19 03:35:30,345 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4925.548703 2021-02-19 03:35:30,359 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5537.238069 2021-02-19 03:35:30,490 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4010.343096 2021-02-19 03:35:30,842 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1424.140783 2021-02-19 03:35:30,990 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:31,122 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3156.008171 2021-02-19 03:35:31,128 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:31,213 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:31,973 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3988.600000 2021-02-19 03:35:31,992 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5627.999900 2021-02-19 03:35:32,026 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4925.548703 2021-02-19 03:35:32,028 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5537.238069 2021-02-19 03:35:32,151 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4010.343096 2021-02-19 03:35:32,459 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1262.040783 2021-02-19 03:35:32,608 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:32,637 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 88.92 % 2021-02-19 03:35:32,637 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 88.9247109297 2021-02-19 03:35:32,775 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3175.708171 2021-02-19 03:35:32,788 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:32,838 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:33,609 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3994.100000 2021-02-19 03:35:33,634 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5656.899900 2021-02-19 03:35:33,680 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5571.938069 2021-02-19 03:35:33,710 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4973.048703 2021-02-19 03:35:33,775 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3974.243096 2021-02-19 03:35:34,079 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1262.040783 2021-02-19 03:35:34,226 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:34,392 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3175.708171 2021-02-19 03:35:34,417 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:34,471 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:35,233 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3994.100000 2021-02-19 03:35:35,289 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5656.899900 2021-02-19 03:35:35,331 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5571.938069 2021-02-19 03:35:35,378 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4973.048703 2021-02-19 03:35:35,417 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3974.243096 2021-02-19 03:35:35,724 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1126.940783 2021-02-19 03:35:35,838 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:36,026 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3175.708171 2021-02-19 03:35:36,035 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:36,078 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:36,869 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3959.300000 2021-02-19 03:35:36,928 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5733.599900 2021-02-19 03:35:36,980 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5628.138069 2021-02-19 03:35:37,033 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4975.748703 2021-02-19 03:35:37,062 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4000.443096 2021-02-19 03:35:37,332 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1126.940783 2021-02-19 03:35:37,457 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:37,648 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3183.708171 2021-02-19 03:35:37,674 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:37,688 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 89.57 % 2021-02-19 03:35:37,690 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 89.5744529126 2021-02-19 03:35:37,691 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:38,480 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3959.300000 2021-02-19 03:35:38,548 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5733.599900 2021-02-19 03:35:38,642 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5628.138069 2021-02-19 03:35:38,684 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4975.748703 2021-02-19 03:35:38,700 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4000.443096 2021-02-19 03:35:38,950 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1126.940783 2021-02-19 03:35:39,125 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:39,295 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3183.708171 2021-02-19 03:35:39,299 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:39,316 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:40,101 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3959.300000 2021-02-19 03:35:40,180 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5678.000000 2021-02-19 03:35:40,292 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5542.400000 2021-02-19 03:35:40,328 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4983.900000 2021-02-19 03:35:40,334 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3986.000000 2021-02-19 03:35:40,578 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1345.800000 2021-02-19 03:35:40,753 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:40,936 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:40,963 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:40,971 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3115.600000 2021-02-19 03:35:41,721 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3959.300000 2021-02-19 03:35:41,806 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5678.000000 2021-02-19 03:35:41,914 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5542.400000 2021-02-19 03:35:41,983 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3986.000000 2021-02-19 03:35:41,993 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4983.900000 2021-02-19 03:35:42,196 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1345.800000 2021-02-19 03:35:42,361 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:42,562 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:42,585 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:42,611 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3103.600000 2021-02-19 03:35:42,733 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 90.00 % 2021-02-19 03:35:42,734 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 90.0 2021-02-19 03:35:43,331 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3964.600000 2021-02-19 03:35:43,457 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5695.000000 2021-02-19 03:35:43,467 | infra | INFO | pool-2-thread-30 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.32' completed 2021-02-19 03:35:43,467 | infra | INFO | pool-2-thread-30 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:35:43,496 | infra | INFO | pool-2-thread-42 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.33' completed 2021-02-19 03:35:43,496 | infra | INFO | pool-2-thread-42 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:35:43,579 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5457.500000 2021-02-19 03:35:43,637 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4001.200000 2021-02-19 03:35:43,653 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4971.800000 2021-02-19 03:35:43,809 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1392.500000 2021-02-19 03:35:43,979 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:44,198 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:44,230 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:44,236 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3103.600000 2021-02-19 03:35:44,510 | infra | INFO | pool-2-thread-64 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' completed 2021-02-19 03:35:44,512 | infra | INFO | pool-2-thread-64 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:35:44,545 | infra | INFO | pool-2-thread-51 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.35' completed 2021-02-19 03:35:44,545 | infra | INFO | pool-2-thread-51 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:35:44,947 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3964.600000 2021-02-19 03:35:45,105 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5695.000000 2021-02-19 03:35:45,246 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5457.500000 2021-02-19 03:35:45,316 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4971.800000 2021-02-19 03:35:45,336 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4001.200000 2021-02-19 03:35:45,447 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1733.500000 2021-02-19 03:35:45,598 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:45,859 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:45,903 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3118.800000 2021-02-19 03:35:45,926 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:46,548 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3949.900000 2021-02-19 03:35:46,714 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5651.700000 2021-02-19 03:35:46,881 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5336.900000 2021-02-19 03:35:47,000 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4970.900000 2021-02-19 03:35:47,003 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3972.900000 2021-02-19 03:35:47,095 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1733.500000 2021-02-19 03:35:47,207 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:47,499 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:47,532 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3118.800000 2021-02-19 03:35:47,585 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:47,782 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 90.40 % 2021-02-19 03:35:47,783 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 90.4040279375 2021-02-19 03:35:48,176 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3949.900000 2021-02-19 03:35:48,342 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5651.700000 2021-02-19 03:35:48,532 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5336.900000 2021-02-19 03:35:48,650 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3972.900000 2021-02-19 03:35:48,684 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4970.900000 2021-02-19 03:35:48,740 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1733.500000 2021-02-19 03:35:48,842 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:35:49,135 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:49,168 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3118.800000 2021-02-19 03:35:49,217 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:49,805 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3949.900000 2021-02-19 03:35:49,957 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5651.700000 2021-02-19 03:35:50,174 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5257.900000 2021-02-19 03:35:50,305 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3981.300000 2021-02-19 03:35:50,332 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4852.600000 2021-02-19 03:35:50,398 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2346.100000 2021-02-19 03:35:50,493 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 505.900000 2021-02-19 03:35:50,779 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:50,826 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3148.600000 2021-02-19 03:35:50,851 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:51,436 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3949.900000 2021-02-19 03:35:51,585 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5520.800000 2021-02-19 03:35:51,812 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5257.900000 2021-02-19 03:35:51,950 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3981.300000 2021-02-19 03:35:51,984 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4852.600000 2021-02-19 03:35:52,033 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2346.100000 2021-02-19 03:35:52,112 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 505.900000 2021-02-19 03:35:52,411 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:52,470 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3198.800000 2021-02-19 03:35:52,486 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:52,828 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 90.81 % 2021-02-19 03:35:52,828 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 90.808055875 2021-02-19 03:35:53,059 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3798.600000 2021-02-19 03:35:53,197 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5166.100000 2021-02-19 03:35:53,427 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5200.400000 2021-02-19 03:35:53,631 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4685.800000 2021-02-19 03:35:53,638 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4003.700000 2021-02-19 03:35:53,710 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3271.900000 2021-02-19 03:35:53,743 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1364.200000 2021-02-19 03:35:54,023 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:54,115 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3198.800000 2021-02-19 03:35:54,131 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:54,677 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3798.600000 2021-02-19 03:35:54,828 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5166.100000 2021-02-19 03:35:55,092 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5200.400000 2021-02-19 03:35:55,273 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4685.800000 2021-02-19 03:35:55,296 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4003.700000 2021-02-19 03:35:55,368 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3271.900000 2021-02-19 03:35:55,387 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1364.200000 2021-02-19 03:35:55,631 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:55,749 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3284.800000 2021-02-19 03:35:55,759 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:56,299 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3648.000000 2021-02-19 03:35:56,456 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4709.600000 2021-02-19 03:35:56,766 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5191.400000 2021-02-19 03:35:56,934 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4484.900000 2021-02-19 03:35:56,940 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4079.300000 2021-02-19 03:35:57,002 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4037.500000 2021-02-19 03:35:57,026 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2587.800000 2021-02-19 03:35:57,247 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:57,426 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:57,426 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3284.800000 2021-02-19 03:35:57,871 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 91.28 % 2021-02-19 03:35:57,871 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 91.2837556722 2021-02-19 03:35:57,924 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3648.000000 2021-02-19 03:35:58,071 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4709.600000 2021-02-19 03:35:58,390 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5191.400000 2021-02-19 03:35:58,584 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4484.900000 2021-02-19 03:35:58,605 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4079.300000 2021-02-19 03:35:58,661 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4037.500000 2021-02-19 03:35:58,664 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2587.800000 2021-02-19 03:35:58,881 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:35:59,069 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:35:59,072 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3284.800000 2021-02-19 03:35:59,552 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3728.400000 2021-02-19 03:35:59,697 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4286.300000 2021-02-19 03:36:00,059 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5191.400000 2021-02-19 03:36:00,244 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4118.300000 2021-02-19 03:36:00,269 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4439.500000 2021-02-19 03:36:00,311 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3375.900000 2021-02-19 03:36:00,325 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4482.000000 2021-02-19 03:36:00,512 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:00,721 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:00,730 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3383.300000 2021-02-19 03:36:01,167 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3728.400000 2021-02-19 03:36:01,342 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4286.300000 2021-02-19 03:36:01,696 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5313.900000 2021-02-19 03:36:01,907 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4118.300000 2021-02-19 03:36:01,924 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4439.500000 2021-02-19 03:36:01,951 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3375.900000 2021-02-19 03:36:01,989 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4482.000000 2021-02-19 03:36:02,188 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:02,354 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:02,375 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3387.400000 2021-02-19 03:36:02,767 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3503.600000 2021-02-19 03:36:02,917 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 91.73 % 2021-02-19 03:36:02,918 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 91.7268333318 2021-02-19 03:36:02,982 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4060.300000 2021-02-19 03:36:03,323 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5419.500000 2021-02-19 03:36:03,555 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4156.600000 2021-02-19 03:36:03,578 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4390.600000 2021-02-19 03:36:03,595 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3820.500000 2021-02-19 03:36:03,631 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4641.000000 2021-02-19 03:36:03,832 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:03,967 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:04,009 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3387.400000 2021-02-19 03:36:04,380 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3503.600000 2021-02-19 03:36:04,619 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4060.300000 2021-02-19 03:36:04,953 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5419.500000 2021-02-19 03:36:05,219 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4156.600000 2021-02-19 03:36:05,237 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4390.600000 2021-02-19 03:36:05,267 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3820.500000 2021-02-19 03:36:05,311 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4641.000000 2021-02-19 03:36:05,447 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:05,608 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:05,647 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3333.600000 2021-02-19 03:36:05,980 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3503.600000 2021-02-19 03:36:06,256 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3958.600000 2021-02-19 03:36:06,584 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5487.800000 2021-02-19 03:36:06,905 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4382.200000 2021-02-19 03:36:06,917 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4154.600000 2021-02-19 03:36:06,954 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3892.200000 2021-02-19 03:36:06,956 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4714.500000 2021-02-19 03:36:07,076 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:07,220 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:07,286 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3333.600000 2021-02-19 03:36:07,595 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3274.800000 2021-02-19 03:36:07,894 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3958.600000 2021-02-19 03:36:07,961 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 92.21 % 2021-02-19 03:36:07,961 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 92.2090881936 2021-02-19 03:36:08,229 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5487.800000 2021-02-19 03:36:08,546 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4382.200000 2021-02-19 03:36:08,559 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4154.600000 2021-02-19 03:36:08,595 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3892.200000 2021-02-19 03:36:08,624 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4714.500000 2021-02-19 03:36:08,710 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:08,854 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:08,930 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3333.600000 2021-02-19 03:36:09,233 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3274.800000 2021-02-19 03:36:09,539 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3962.100000 2021-02-19 03:36:09,878 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5426.200000 2021-02-19 03:36:10,250 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4285.900000 2021-02-19 03:36:10,269 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4715.100000 2021-02-19 03:36:10,286 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4202.400000 2021-02-19 03:36:10,301 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3878.300000 2021-02-19 03:36:10,334 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:10,493 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:10,575 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3285.400000 2021-02-19 03:36:10,839 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3367.400000 2021-02-19 03:36:11,151 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3962.100000 2021-02-19 03:36:11,492 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5426.200000 2021-02-19 03:36:11,911 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4285.900000 2021-02-19 03:36:11,953 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4715.100000 2021-02-19 03:36:11,987 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:11,990 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4202.400000 2021-02-19 03:36:12,000 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3878.300000 2021-02-19 03:36:12,112 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:12,200 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3285.400000 2021-02-19 03:36:12,480 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3229.400000 2021-02-19 03:36:12,753 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3956.900000 2021-02-19 03:36:13,009 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 92.72 % 2021-02-19 03:36:13,009 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 92.7174101284 2021-02-19 03:36:13,111 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5339.700000 2021-02-19 03:36:13,573 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4306.900000 2021-02-19 03:36:13,660 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4697.900000 2021-02-19 03:36:13,671 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:13,677 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4202.000000 2021-02-19 03:36:13,700 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3857.600000 2021-02-19 03:36:13,772 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:13,835 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3292.100000 2021-02-19 03:36:14,089 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3229.400000 2021-02-19 03:36:14,375 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3956.900000 2021-02-19 03:36:14,734 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5339.700000 2021-02-19 03:36:15,279 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4306.900000 2021-02-19 03:36:15,348 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:15,355 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4202.000000 2021-02-19 03:36:15,361 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3857.600000 2021-02-19 03:36:15,381 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4697.900000 2021-02-19 03:36:15,408 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:15,483 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3314.600000 2021-02-19 03:36:15,694 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3155.600000 2021-02-19 03:36:15,983 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3956.900000 2021-02-19 03:36:16,362 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5305.500000 2021-02-19 03:36:16,941 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4330.100000 2021-02-19 03:36:16,986 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:17,023 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3843.200000 2021-02-19 03:36:17,045 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4696.300000 2021-02-19 03:36:17,055 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4210.700000 2021-02-19 03:36:17,068 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:17,135 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3314.600000 2021-02-19 03:36:17,349 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3155.600000 2021-02-19 03:36:17,621 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3950.100000 2021-02-19 03:36:17,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5305.500000 2021-02-19 03:36:18,068 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 93.17 % 2021-02-19 03:36:18,069 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 93.1735723614 2021-02-19 03:36:18,598 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4330.100000 2021-02-19 03:36:18,625 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:18,686 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3843.200000 2021-02-19 03:36:18,701 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4696.300000 2021-02-19 03:36:18,729 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4210.700000 2021-02-19 03:36:18,736 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:18,808 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3314.600000 2021-02-19 03:36:18,992 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3155.600000 2021-02-19 03:36:19,259 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3950.100000 2021-02-19 03:36:19,638 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5370.600000 2021-02-19 03:36:20,236 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4366.600000 2021-02-19 03:36:20,273 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:20,355 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3863.400000 2021-02-19 03:36:20,380 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4731.500000 2021-02-19 03:36:20,385 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4195.100000 2021-02-19 03:36:20,394 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:20,483 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3328.700000 2021-02-19 03:36:20,667 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3256.800000 2021-02-19 03:36:20,871 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3935.600000 2021-02-19 03:36:21,252 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5370.600000 2021-02-19 03:36:21,815 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 93.49 % 2021-02-19 03:36:21,816 | test | INFO | MainThread | [Magma:abort_rebalance:933] Rebalance % = 93.492894828 2021-02-19 03:36:21,901 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4366.600000 2021-02-19 03:36:21,946 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:22,032 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3863.400000 2021-02-19 03:36:22,049 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4195.100000 2021-02-19 03:36:22,065 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4731.500000 2021-02-19 03:36:22,066 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:22,174 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3328.700000 2021-02-19 03:36:22,305 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3191.500000 2021-02-19 03:36:22,484 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3939.900000 2021-02-19 03:36:22,865 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5469.500000 2021-02-19 03:36:23,111 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 93.60 % 2021-02-19 03:36:23,112 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 93.6004536171 2021-02-19 03:36:23,573 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4333.900000 2021-02-19 03:36:23,585 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:23,670 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3909.800000 2021-02-19 03:36:23,723 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:23,736 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4755.300000 2021-02-19 03:36:23,752 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4210.200000 2021-02-19 03:36:23,859 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3287.800000 2021-02-19 03:36:23,930 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3191.500000 2021-02-19 03:36:24,119 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3939.900000 2021-02-19 03:36:24,493 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5469.500000 2021-02-19 03:36:25,252 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:25,272 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4333.900000 2021-02-19 03:36:25,302 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3909.800000 2021-02-19 03:36:25,401 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:25,423 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4210.200000 2021-02-19 03:36:25,470 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4755.300000 2021-02-19 03:36:25,490 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3263.500000 2021-02-19 03:36:25,569 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3119.500000 2021-02-19 03:36:25,721 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3964.800000 2021-02-19 03:36:26,127 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5469.500000 2021-02-19 03:36:26,900 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:26,947 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3964.700000 2021-02-19 03:36:26,954 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4282.500000 2021-02-19 03:36:27,042 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:27,089 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4242.700000 2021-02-19 03:36:27,137 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4757.500000 2021-02-19 03:36:27,148 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3263.500000 2021-02-19 03:36:27,210 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3119.500000 2021-02-19 03:36:27,349 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3964.800000 2021-02-19 03:36:27,742 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5569.200000 2021-02-19 03:36:28,161 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 94.10 % 2021-02-19 03:36:28,161 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 94.0956910532 2021-02-19 03:36:28,548 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:28,608 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3964.700000 2021-02-19 03:36:28,628 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4282.500000 2021-02-19 03:36:28,706 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:28,763 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4242.700000 2021-02-19 03:36:28,805 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4757.500000 2021-02-19 03:36:28,822 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3263.500000 2021-02-19 03:36:28,846 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3119.500000 2021-02-19 03:36:28,989 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3964.800000 2021-02-19 03:36:29,365 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5569.200000 2021-02-19 03:36:30,184 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:30,269 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4004.700000 2021-02-19 03:36:30,292 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4267.800000 2021-02-19 03:36:30,355 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:30,426 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4260.600000 2021-02-19 03:36:30,466 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4812.700000 2021-02-19 03:36:30,484 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3252.700000 2021-02-19 03:36:30,500 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3176.200000 2021-02-19 03:36:30,650 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4035.900000 2021-02-19 03:36:30,982 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5630.000000 2021-02-19 03:36:31,834 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:31,933 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4004.700000 2021-02-19 03:36:31,960 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4267.800000 2021-02-19 03:36:32,032 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:32,141 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4812.700000 2021-02-19 03:36:32,144 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4260.600000 2021-02-19 03:36:32,163 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3176.200000 2021-02-19 03:36:32,193 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3252.700000 2021-02-19 03:36:32,286 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4051.000000 2021-02-19 03:36:32,628 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5671.600000 2021-02-19 03:36:33,209 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 94.50 % 2021-02-19 03:36:33,209 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 94.4964669769 2021-02-19 03:36:33,494 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:33,595 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3994.400000 2021-02-19 03:36:33,657 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4284.200000 2021-02-19 03:36:33,707 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:33,818 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4230.000000 2021-02-19 03:36:33,861 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4844.100000 2021-02-19 03:36:33,868 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3044.200000 2021-02-19 03:36:33,871 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3294.000000 2021-02-19 03:36:33,927 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4051.000000 2021-02-19 03:36:34,285 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5671.600000 2021-02-19 03:36:35,128 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:35,227 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3994.400000 2021-02-19 03:36:35,305 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4284.200000 2021-02-19 03:36:35,375 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:35,476 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4142.900000 2021-02-19 03:36:35,546 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4888.800000 2021-02-19 03:36:35,562 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2927.000000 2021-02-19 03:36:35,571 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3303.200000 2021-02-19 03:36:35,582 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4040.600000 2021-02-19 03:36:35,904 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5652.000000 2021-02-19 03:36:36,760 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:36,880 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3954.900000 2021-02-19 03:36:36,957 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4355.800000 2021-02-19 03:36:37,036 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:37,154 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4142.900000 2021-02-19 03:36:37,217 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4888.800000 2021-02-19 03:36:37,250 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3303.200000 2021-02-19 03:36:37,259 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4040.600000 2021-02-19 03:36:37,276 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2927.000000 2021-02-19 03:36:37,519 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5652.000000 2021-02-19 03:36:38,259 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 94.95 % 2021-02-19 03:36:38,259 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 94.9494281208 2021-02-19 03:36:38,375 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:38,539 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3954.900000 2021-02-19 03:36:38,595 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4355.800000 2021-02-19 03:36:38,654 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:38,799 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4142.900000 2021-02-19 03:36:38,931 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4888.800000 2021-02-19 03:36:38,940 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3303.200000 2021-02-19 03:36:38,960 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2927.000000 2021-02-19 03:36:38,971 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4040.600000 2021-02-19 03:36:39,144 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5652.000000 2021-02-19 03:36:40,000 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:40,193 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3954.900000 2021-02-19 03:36:40,272 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4433.600000 2021-02-19 03:36:40,296 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:40,454 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4061.900000 2021-02-19 03:36:40,624 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3278.400000 2021-02-19 03:36:40,661 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3962.700000 2021-02-19 03:36:40,684 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4882.300000 2021-02-19 03:36:40,690 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3010.100000 2021-02-19 03:36:40,805 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5597.800000 2021-02-19 03:36:41,625 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:41,864 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3912.500000 2021-02-19 03:36:41,915 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:41,950 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4433.600000 2021-02-19 03:36:42,084 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4061.900000 2021-02-19 03:36:42,289 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3253.800000 2021-02-19 03:36:42,332 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3930.500000 2021-02-19 03:36:42,355 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4849.200000 2021-02-19 03:36:42,355 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2959.600000 2021-02-19 03:36:42,443 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5585.200000 2021-02-19 03:36:43,236 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:43,309 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 95.36 % 2021-02-19 03:36:43,309 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 95.3599473455 2021-02-19 03:36:43,523 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3899.000000 2021-02-19 03:36:43,585 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:43,625 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4478.800000 2021-02-19 03:36:43,711 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3994.100000 2021-02-19 03:36:43,937 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3253.800000 2021-02-19 03:36:43,997 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3930.500000 2021-02-19 03:36:44,032 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4849.200000 2021-02-19 03:36:44,095 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2959.600000 2021-02-19 03:36:44,125 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5585.200000 2021-02-19 03:36:44,851 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:45,141 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3899.000000 2021-02-19 03:36:45,217 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:45,267 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4478.800000 2021-02-19 03:36:45,357 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3994.100000 2021-02-19 03:36:45,563 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3246.500000 2021-02-19 03:36:45,698 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3918.200000 2021-02-19 03:36:45,706 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4813.800000 2021-02-19 03:36:45,790 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2934.800000 2021-02-19 03:36:45,821 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5604.800000 2021-02-19 03:36:46,484 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:46,803 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3908.000000 2021-02-19 03:36:46,884 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:46,953 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4427.300000 2021-02-19 03:36:47,025 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4013.000000 2021-02-19 03:36:47,186 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3246.500000 2021-02-19 03:36:47,361 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4813.800000 2021-02-19 03:36:47,381 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3918.200000 2021-02-19 03:36:47,451 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5604.800000 2021-02-19 03:36:47,516 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2934.800000 2021-02-19 03:36:48,115 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:48,355 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 95.71 % 2021-02-19 03:36:48,355 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 95.7053242192 2021-02-19 03:36:48,443 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3908.000000 2021-02-19 03:36:48,509 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:48,618 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4427.300000 2021-02-19 03:36:48,690 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4013.000000 2021-02-19 03:36:48,825 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3246.500000 2021-02-19 03:36:49,038 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3918.200000 2021-02-19 03:36:49,051 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4813.800000 2021-02-19 03:36:49,096 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5604.800000 2021-02-19 03:36:49,216 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2934.800000 2021-02-19 03:36:49,729 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:50,055 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3908.000000 2021-02-19 03:36:50,137 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:50,267 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4349.400000 2021-02-19 03:36:50,331 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4050.700000 2021-02-19 03:36:50,454 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3260.300000 2021-02-19 03:36:50,664 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3902.100000 2021-02-19 03:36:50,687 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4734.600000 2021-02-19 03:36:50,740 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5625.700000 2021-02-19 03:36:50,846 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3033.600000 2021-02-19 03:36:51,349 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:51,677 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3869.100000 2021-02-19 03:36:51,757 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:51,892 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4349.400000 2021-02-19 03:36:51,974 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4050.700000 2021-02-19 03:36:52,098 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3260.300000 2021-02-19 03:36:52,349 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3878.600000 2021-02-19 03:36:52,384 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4689.100000 2021-02-19 03:36:52,401 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5618.200000 2021-02-19 03:36:52,457 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3072.200000 2021-02-19 03:36:52,992 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:53,290 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3824.500000 2021-02-19 03:36:53,394 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:53,407 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 96.11 % 2021-02-19 03:36:53,407 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 96.1093903783 2021-02-19 03:36:53,569 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4261.400000 2021-02-19 03:36:53,601 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4140.300000 2021-02-19 03:36:53,726 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3269.800000 2021-02-19 03:36:54,015 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3878.600000 2021-02-19 03:36:54,040 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4689.100000 2021-02-19 03:36:54,049 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5618.200000 2021-02-19 03:36:54,082 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3072.200000 2021-02-19 03:36:54,632 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:54,918 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3824.500000 2021-02-19 03:36:55,007 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:55,197 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4261.400000 2021-02-19 03:36:55,236 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4140.300000 2021-02-19 03:36:55,384 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3269.800000 2021-02-19 03:36:55,651 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3854.200000 2021-02-19 03:36:55,700 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4631.500000 2021-02-19 03:36:55,703 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5600.600000 2021-02-19 03:36:55,723 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3045.600000 2021-02-19 03:36:56,260 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:56,535 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3779.500000 2021-02-19 03:36:56,618 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:56,826 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4295.900000 2021-02-19 03:36:56,872 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4171.000000 2021-02-19 03:36:57,016 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3275.400000 2021-02-19 03:36:57,316 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3854.200000 2021-02-19 03:36:57,359 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5600.600000 2021-02-19 03:36:57,391 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4631.500000 2021-02-19 03:36:57,394 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3045.600000 2021-02-19 03:36:57,898 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:58,200 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3779.500000 2021-02-19 03:36:58,243 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:36:58,473 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4295.900000 2021-02-19 03:36:58,484 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 96.54 % 2021-02-19 03:36:58,486 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 96.5394599451 2021-02-19 03:36:58,522 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4171.000000 2021-02-19 03:36:58,638 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3275.400000 2021-02-19 03:36:58,953 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3854.200000 2021-02-19 03:36:59,035 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4631.500000 2021-02-19 03:36:59,046 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5600.600000 2021-02-19 03:36:59,065 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3045.600000 2021-02-19 03:36:59,516 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:36:59,861 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3820.800000 2021-02-19 03:36:59,907 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:00,108 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4295.900000 2021-02-19 03:37:00,148 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4171.000000 2021-02-19 03:37:00,273 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3284.700000 2021-02-19 03:37:00,647 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3879.200000 2021-02-19 03:37:00,709 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4618.900000 2021-02-19 03:37:00,723 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5565.900000 2021-02-19 03:37:00,749 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3064.600000 2021-02-19 03:37:01,128 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:01,493 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3820.800000 2021-02-19 03:37:01,538 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:01,746 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4345.900000 2021-02-19 03:37:01,789 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4194.200000 2021-02-19 03:37:01,904 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3284.700000 2021-02-19 03:37:02,276 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3905.000000 2021-02-19 03:37:02,391 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5517.000000 2021-02-19 03:37:02,413 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4604.000000 2021-02-19 03:37:02,434 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2872.400000 2021-02-19 03:37:02,739 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:03,101 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3874.300000 2021-02-19 03:37:03,160 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:03,367 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4464.800000 2021-02-19 03:37:03,421 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4178.400000 2021-02-19 03:37:03,526 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3253.200000 2021-02-19 03:37:03,539 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 96.94 % 2021-02-19 03:37:03,539 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 96.9402358687 2021-02-19 03:37:03,923 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3905.000000 2021-02-19 03:37:04,043 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5517.000000 2021-02-19 03:37:04,072 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4604.000000 2021-02-19 03:37:04,082 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2872.400000 2021-02-19 03:37:04,355 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:04,716 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3874.300000 2021-02-19 03:37:04,789 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:05,023 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4464.800000 2021-02-19 03:37:05,058 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4178.400000 2021-02-19 03:37:05,163 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3253.200000 2021-02-19 03:37:05,540 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3916.629185 2021-02-19 03:37:05,716 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2768.090318 2021-02-19 03:37:05,730 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5475.443437 2021-02-19 03:37:05,755 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4571.042509 2021-02-19 03:37:05,970 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:06,372 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3933.592774 2021-02-19 03:37:06,407 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:06,644 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4523.902685 2021-02-19 03:37:06,690 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4145.223366 2021-02-19 03:37:06,792 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3232.564787 2021-02-19 03:37:07,190 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3916.629185 2021-02-19 03:37:07,375 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2768.090318 2021-02-19 03:37:07,407 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5475.443437 2021-02-19 03:37:07,418 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4571.042509 2021-02-19 03:37:07,594 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:08,042 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3933.592774 2021-02-19 03:37:08,065 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:08,289 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4523.902685 2021-02-19 03:37:08,322 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4145.223366 2021-02-19 03:37:08,430 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3232.564787 2021-02-19 03:37:08,589 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 97.39 % 2021-02-19 03:37:08,591 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 97.3931970127 2021-02-19 03:37:08,802 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3916.629185 2021-02-19 03:37:09,003 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2768.090318 2021-02-19 03:37:09,048 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5475.443437 2021-02-19 03:37:09,069 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4571.042509 2021-02-19 03:37:09,203 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:09,681 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3935.092774 2021-02-19 03:37:09,701 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:09,924 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4514.702685 2021-02-19 03:37:09,961 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4145.223366 2021-02-19 03:37:10,055 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3232.564787 2021-02-19 03:37:10,446 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3915.129185 2021-02-19 03:37:10,625 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2846.190318 2021-02-19 03:37:10,671 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5425.043437 2021-02-19 03:37:10,742 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4598.042509 2021-02-19 03:37:10,861 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:11,312 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3935.092774 2021-02-19 03:37:11,325 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:11,552 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4514.702685 2021-02-19 03:37:11,611 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4106.123366 2021-02-19 03:37:11,690 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3245.164787 2021-02-19 03:37:12,063 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3915.129185 2021-02-19 03:37:12,260 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2846.190318 2021-02-19 03:37:12,311 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5435.943437 2021-02-19 03:37:12,387 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4582.942509 2021-02-19 03:37:12,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:12,944 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:12,974 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3911.692774 2021-02-19 03:37:13,180 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4437.502685 2021-02-19 03:37:13,237 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4086.823366 2021-02-19 03:37:13,309 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3347.464787 2021-02-19 03:37:13,641 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 97.81 % 2021-02-19 03:37:13,641 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 97.8069809917 2021-02-19 03:37:13,713 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3890.629185 2021-02-19 03:37:13,891 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2812.690318 2021-02-19 03:37:13,954 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5435.943437 2021-02-19 03:37:14,040 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4582.942509 2021-02-19 03:37:14,138 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:14,555 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:14,598 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3911.692774 2021-02-19 03:37:14,842 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4437.502685 2021-02-19 03:37:14,898 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4086.823366 2021-02-19 03:37:14,976 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3347.464787 2021-02-19 03:37:15,372 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3890.629185 2021-02-19 03:37:15,529 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2755.601212 2021-02-19 03:37:15,599 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5447.678860 2021-02-19 03:37:15,688 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4635.757840 2021-02-19 03:37:15,756 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:16,184 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:16,226 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3873.133965 2021-02-19 03:37:16,473 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4331.495902 2021-02-19 03:37:16,528 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4088.980733 2021-02-19 03:37:16,615 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3428.188588 2021-02-19 03:37:17,000 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3875.542150 2021-02-19 03:37:17,168 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2755.601212 2021-02-19 03:37:17,260 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5447.678860 2021-02-19 03:37:17,348 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4635.757840 2021-02-19 03:37:17,397 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:17,809 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:17,875 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3873.133965 2021-02-19 03:37:18,108 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4331.495902 2021-02-19 03:37:18,176 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4088.980733 2021-02-19 03:37:18,253 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3428.188588 2021-02-19 03:37:18,630 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3875.542150 2021-02-19 03:37:18,690 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 98.29 % 2021-02-19 03:37:18,690 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 98.2924751269 2021-02-19 03:37:18,809 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2755.601212 2021-02-19 03:37:18,894 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5447.678860 2021-02-19 03:37:18,983 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4635.757840 2021-02-19 03:37:19,013 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:19,459 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:19,536 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3857.490577 2021-02-19 03:37:19,816 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4283.197660 2021-02-19 03:37:19,888 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4067.269147 2021-02-19 03:37:19,917 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3433.450993 2021-02-19 03:37:20,280 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3863.593129 2021-02-19 03:37:20,473 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2775.545399 2021-02-19 03:37:20,569 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5559.709503 2021-02-19 03:37:20,640 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:20,660 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4642.080892 2021-02-19 03:37:21,075 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:21,167 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3857.490577 2021-02-19 03:37:21,457 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4283.197660 2021-02-19 03:37:21,558 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4067.269147 2021-02-19 03:37:21,585 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3433.450993 2021-02-19 03:37:21,921 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3863.593129 2021-02-19 03:37:22,095 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2775.545399 2021-02-19 03:37:22,209 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5559.709503 2021-02-19 03:37:22,280 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:22,296 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4693.380892 2021-02-19 03:37:22,716 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:22,786 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3870.190577 2021-02-19 03:37:23,092 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4248.397660 2021-02-19 03:37:23,203 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3365.950993 2021-02-19 03:37:23,226 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4084.069147 2021-02-19 03:37:23,575 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3893.093129 2021-02-19 03:37:23,724 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2654.445399 2021-02-19 03:37:23,739 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 98.67 % 2021-02-19 03:37:23,739 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 98.6671966433 2021-02-19 03:37:23,836 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5563.209503 2021-02-19 03:37:23,907 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:23,944 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4693.380892 2021-02-19 03:37:24,331 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:24,404 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3870.190577 2021-02-19 03:37:24,723 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4248.397660 2021-02-19 03:37:24,829 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3365.950993 2021-02-19 03:37:24,891 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4084.069147 2021-02-19 03:37:25,197 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3893.093129 2021-02-19 03:37:25,380 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2654.445399 2021-02-19 03:37:25,476 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5587.174160 2021-02-19 03:37:25,559 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:25,582 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4715.049524 2021-02-19 03:37:25,937 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:26,030 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3870.190577 2021-02-19 03:37:26,372 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4219.184853 2021-02-19 03:37:26,473 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3311.033314 2021-02-19 03:37:26,506 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4121.169799 2021-02-19 03:37:26,811 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3903.262325 2021-02-19 03:37:27,013 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2501.758223 2021-02-19 03:37:27,115 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5587.174160 2021-02-19 03:37:27,194 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:27,232 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4715.049524 2021-02-19 03:37:27,591 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:27,696 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3888.566789 2021-02-19 03:37:28,009 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4219.184853 2021-02-19 03:37:28,128 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3311.033314 2021-02-19 03:37:28,141 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4121.169799 2021-02-19 03:37:28,460 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3903.262325 2021-02-19 03:37:28,654 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2501.758223 2021-02-19 03:37:28,786 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 99.18 % 2021-02-19 03:37:28,786 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 99.1819589405 2021-02-19 03:37:28,788 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5587.174160 2021-02-19 03:37:28,868 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:28,894 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4715.049524 2021-02-19 03:37:29,213 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:29,339 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3888.566789 2021-02-19 03:37:29,657 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4235.601037 2021-02-19 03:37:29,792 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4177.060040 2021-02-19 03:37:29,809 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3330.732142 2021-02-19 03:37:30,119 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3903.262325 2021-02-19 03:37:30,305 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2504.473107 2021-02-19 03:37:30,444 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5557.577358 2021-02-19 03:37:30,532 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4780.381818 2021-02-19 03:37:30,535 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:30,855 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:30,993 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3947.624434 2021-02-19 03:37:31,283 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4235.601037 2021-02-19 03:37:31,447 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4177.060040 2021-02-19 03:37:31,460 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3330.732142 2021-02-19 03:37:31,759 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3933.496649 2021-02-19 03:37:31,926 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2504.473107 2021-02-19 03:37:32,078 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5557.577358 2021-02-19 03:37:32,157 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4780.381818 2021-02-19 03:37:32,161 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:32,463 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:32,631 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3979.223675 2021-02-19 03:37:32,911 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4264.635036 2021-02-19 03:37:33,078 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4184.425940 2021-02-19 03:37:33,108 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3401.629964 2021-02-19 03:37:33,391 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3917.016397 2021-02-19 03:37:33,578 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2391.889437 2021-02-19 03:37:33,730 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5612.739600 2021-02-19 03:37:33,828 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:33,839 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 99.63 % 2021-02-19 03:37:33,841 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 99.6251384497 2021-02-19 03:37:33,842 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4845.599188 2021-02-19 03:37:34,098 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:34,262 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3979.223675 2021-02-19 03:37:34,546 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4264.635036 2021-02-19 03:37:34,729 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4184.425940 2021-02-19 03:37:34,755 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3401.629964 2021-02-19 03:37:35,013 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3917.016397 2021-02-19 03:37:35,233 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2391.889437 2021-02-19 03:37:35,375 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5612.739600 2021-02-19 03:37:35,463 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:35,490 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4893.660662 2021-02-19 03:37:35,727 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:35,904 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4012.613338 2021-02-19 03:37:36,186 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4264.635036 2021-02-19 03:37:36,357 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4190.464981 2021-02-19 03:37:36,371 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3478.411180 2021-02-19 03:37:36,657 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3920.894867 2021-02-19 03:37:36,918 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2311.537260 2021-02-19 03:37:37,015 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5664.868205 2021-02-19 03:37:37,111 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:37,138 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4893.660662 2021-02-19 03:37:37,355 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:37,522 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4012.613338 2021-02-19 03:37:37,838 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4322.086081 2021-02-19 03:37:37,990 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4190.464981 2021-02-19 03:37:37,993 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3478.411180 2021-02-19 03:37:38,279 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3920.894867 2021-02-19 03:37:38,535 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2311.537260 2021-02-19 03:37:38,651 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5664.868205 2021-02-19 03:37:38,733 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:38,773 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4893.660662 2021-02-19 03:37:38,969 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:39,009 | test | DEBUG | pool-1-thread-23 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 100.00 % 2021-02-19 03:37:39,009 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: running, progress: 100 2021-02-19 03:37:39,171 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4012.613338 2021-02-19 03:37:39,507 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4400.168140 2021-02-19 03:37:39,645 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4185.686327 2021-02-19 03:37:39,657 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3472.249947 2021-02-19 03:37:39,898 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3877.409565 2021-02-19 03:37:40,168 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2311.537260 2021-02-19 03:37:40,305 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5715.734364 2021-02-19 03:37:40,375 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:40,421 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4853.005316 2021-02-19 03:37:40,595 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:40,812 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4005.599080 2021-02-19 03:37:41,163 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4400.168140 2021-02-19 03:37:41,319 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4185.686327 2021-02-19 03:37:41,336 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3472.249947 2021-02-19 03:37:41,532 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3877.409565 2021-02-19 03:37:41,790 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2445.978189 2021-02-19 03:37:41,938 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5715.734364 2021-02-19 03:37:42,033 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:42,063 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4853.005316 2021-02-19 03:37:42,230 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:42,444 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4034.017651 2021-02-19 03:37:42,786 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4480.448309 2021-02-19 03:37:42,950 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4173.147002 2021-02-19 03:37:42,997 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3376.997153 2021-02-19 03:37:43,177 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3864.562360 2021-02-19 03:37:43,431 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2638.060778 2021-02-19 03:37:43,588 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5725.115508 2021-02-19 03:37:43,686 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4776.924929 2021-02-19 03:37:43,703 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:43,875 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:44,072 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4034.017651 2021-02-19 03:37:44,431 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4480.448309 2021-02-19 03:37:44,598 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4173.147002 2021-02-19 03:37:44,641 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3376.997153 2021-02-19 03:37:44,822 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3864.562360 2021-02-19 03:37:45,089 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2638.060778 2021-02-19 03:37:45,236 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5725.115508 2021-02-19 03:37:45,325 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4776.924929 2021-02-19 03:37:45,329 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:45,526 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:45,710 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4045.617811 2021-02-19 03:37:46,062 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4480.448309 2021-02-19 03:37:46,239 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4173.147002 2021-02-19 03:37:46,270 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3256.345027 2021-02-19 03:37:46,460 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3834.372544 2021-02-19 03:37:46,734 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2949.098919 2021-02-19 03:37:46,871 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5689.743386 2021-02-19 03:37:46,950 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4697.136982 2021-02-19 03:37:46,960 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:47,128 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:47,328 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4045.617811 2021-02-19 03:37:47,665 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4523.914169 2021-02-19 03:37:47,892 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4089.226576 2021-02-19 03:37:47,904 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3256.345027 2021-02-19 03:37:48,109 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3834.372544 2021-02-19 03:37:48,365 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2949.098919 2021-02-19 03:37:48,513 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5689.743386 2021-02-19 03:37:48,612 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:48,632 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4697.136982 2021-02-19 03:37:48,769 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:48,948 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4045.617811 2021-02-19 03:37:49,084 | test | INFO | pool-1-thread-23 | [task:check:330] Rebalance - status: none, progress: 100 2021-02-19 03:37:49,121 | test | INFO | pool-1-thread-23 | [task:check:389] Rebalance completed with progress: 100% in 207.252000093 sec 2021-02-19 03:37:49,121 | infra | INFO | pool-1-thread-23 | [task:complete_task:99] Thread 'Rebalance_task_IN=[]_OUT=[]_1613734461.72' completed 2021-02-19 03:37:49,286 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 4007.617810686412, u'diskFetches': 0, u'dataUsed': 2236550367L, u'itemCount': 3456284, u'quotaPercentUsed': 4.43048642280056, u'storageTotals': {u'hdd': {u'usedByData': 71892411562L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 29041116408L, u'used': 122992582656L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 3062694970L, u'vbActiveNumNonResident': 0, u'memUsed': 2581430624L} 2021-02-19 03:37:49,290 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 3184.04502701621, u'diskFetches': 0, u'dataUsed': 2179476162L, u'itemCount': 3257048, u'quotaPercentUsed': 4.204013367105636, u'storageTotals': {u'hdd': {u'usedByData': 71892411562L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 29041116408L, u'used': 122992582656L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 4507728050L, u'vbActiveNumNonResident': 0, u'memUsed': 2449475704L} 2021-02-19 03:37:49,293 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4523.914169 2021-02-19 03:37:49,293 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 4450.314168501101, u'diskFetches': 0, u'dataUsed': 2860819052L, u'itemCount': 4255484, u'quotaPercentUsed': 5.364947876310485, u'storageTotals': {u'hdd': {u'usedByData': 71892411562L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 29041116408L, u'used': 122992582656L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 5916323816L, u'vbActiveNumNonResident': 0, u'memUsed': 3125896216L} 2021-02-19 03:37:49,296 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 3930.926575945567, u'diskFetches': 0, u'dataUsed': 2790807937L, u'itemCount': 3887355, u'quotaPercentUsed': 4.923820310246029, u'storageTotals': {u'hdd': {u'usedByData': 71892411562L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 29041116408L, u'used': 122992582656L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 10253966280L, u'vbActiveNumNonResident': 0, u'memUsed': 2868872472L} 2021-02-19 03:37:49,301 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 1984244156, u'itemCount': 2989884, u'quotaPercentUsed': 3.828854085954302, u'storageTotals': {u'hdd': {u'usedByData': 71892411562L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 29041116408L, u'used': 122992582656L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 4643518543L, u'vbActiveNumNonResident': 0, u'memUsed': 2230888496L} 2021-02-19 03:37:49,303 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 3802.472543526116, u'diskFetches': 0, u'dataUsed': 3670397851L, u'itemCount': 4896914, u'quotaPercentUsed': 6.087533192685556, u'storageTotals': {u'hdd': {u'usedByData': 71892411562L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 29041116408L, u'used': 122992582656L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 12158254437L, u'vbActiveNumNonResident': 0, u'memUsed': 3546911808L} 2021-02-19 03:37:49,306 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 2096122532, u'itemCount': 2984431, u'quotaPercentUsed': 4.995359552518873, u'storageTotals': {u'hdd': {u'usedByData': 71892411562L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 29041116408L, u'used': 122992582656L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 5088682521L, u'vbActiveNumNonResident': 0, u'memUsed': 2910554936L} 2021-02-19 03:37:49,309 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 5568.343386031619, u'diskFetches': 0, u'dataUsed': 3445173408L, u'itemCount': 4635244, u'quotaPercentUsed': 5.803950673984716, u'storageTotals': {u'hdd': {u'usedByData': 71892411562L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 29041116408L, u'used': 122992582656L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 10931964887L, u'vbActiveNumNonResident': 0, u'memUsed': 3381681960L} 2021-02-19 03:37:49,312 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 4632.236982189313, u'diskFetches': 0, u'dataUsed': 3146560198L, u'itemCount': 4357961, u'quotaPercentUsed': 5.513276454160895, u'storageTotals': {u'hdd': {u'usedByData': 71892411562L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 29041116408L, u'used': 122992582656L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 8798844865L, u'vbActiveNumNonResident': 0, u'memUsed': 3212320120L} 2021-02-19 03:37:49,315 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 3570.698919351611, u'diskFetches': 0, u'dataUsed': 2553963985L, u'itemCount': 3643910, u'quotaPercentUsed': 4.690767886918998, u'storageTotals': {u'hdd': {u'usedByData': 71892411562L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 29041116408L, u'used': 122992582656L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 6530433193L, u'vbActiveNumNonResident': 0, u'memUsed': 2733084072L} 2021-02-19 03:37:49,316 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +-----------------+-----------+----------+------------+-----+---------+-------------+------------+-------------+ | Bucket | Type | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | +-----------------+-----------+----------+------------+-----+---------+-------------+------------+-------------+ | GleamBookUsers0 | couchbase | 1 | none | 0 | 3456284 | 58265174016 | 2581430624 | 3062694970 | | GleamBookUsers1 | couchbase | 1 | none | 0 | 3257048 | 58265174016 | 2449475704 | 4507728050 | | GleamBookUsers2 | couchbase | 1 | none | 0 | 4255484 | 58265174016 | 3125896216 | 5916323816 | | GleamBookUsers3 | couchbase | 1 | none | 0 | 3887355 | 58265174016 | 2868872472 | 10253966280 | | GleamBookUsers4 | couchbase | 1 | none | 0 | 2989884 | 58265174016 | 2230888496 | 4643518543 | | GleamBookUsers5 | couchbase | 1 | none | 0 | 4896914 | 58265174016 | 3546911808 | 12158254437 | | GleamBookUsers6 | couchbase | 1 | none | 0 | 2984431 | 58265174016 | 2910554936 | 5088682521 | | GleamBookUsers7 | couchbase | 1 | none | 0 | 4635244 | 58265174016 | 3381681960 | 10931964887 | | GleamBookUsers8 | couchbase | 1 | none | 0 | 4357961 | 58265174016 | 3212320120 | 8798844865 | | GleamBookUsers9 | couchbase | 1 | none | 0 | 3643910 | 58265174016 | 2733084072 | 6530433193 | +-----------------+-----------+----------+------------+-----+---------+-------------+------------+-------------+ 2021-02-19 03:37:49,318 | test | INFO | MainThread | [table_view:display:72] Docs statistics +---------------+---------------+-----------------+-----------------+---------------+---------------+ | Initial Items | Current Items | Items Updated | Items Created | Items Deleted | Items Expired | +---------------+---------------+-----------------+-----------------+---------------+---------------+ | 0 | -30000000 | 2000000-3000000 | 1000000-2000000 | 0-1000000 | 0-1000000 | +---------------+---------------+-----------------+-----------------+---------------+---------------+ 2021-02-19 03:37:49,559 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3184.045027 2021-02-19 03:37:49,561 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3930.926576 2021-02-19 03:37:49,740 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3802.472544 2021-02-19 03:37:49,986 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers0 is 100 2021-02-19 03:37:50,017 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2949.098919 2021-02-19 03:37:50,157 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5689.743386 2021-02-19 03:37:50,246 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:50,273 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4697.136982 2021-02-19 03:37:50,391 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:50,581 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4007.617811 2021-02-19 03:37:50,628 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers1 is 100 2021-02-19 03:37:50,907 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4450.314169 2021-02-19 03:37:51,193 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3930.926576 2021-02-19 03:37:51,203 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3184.045027 2021-02-19 03:37:51,286 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers2 is 100 2021-02-19 03:37:51,388 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3802.472544 2021-02-19 03:37:51,644 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3570.698919 2021-02-19 03:37:51,813 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5568.343386 2021-02-19 03:37:51,921 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4632.236982 2021-02-19 03:37:51,928 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:51,960 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers3 is 100 2021-02-19 03:37:52,059 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:52,206 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4007.617811 2021-02-19 03:37:52,517 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4334.500000 2021-02-19 03:37:52,602 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers4 is 100 2021-02-19 03:37:52,821 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3854.800000 2021-02-19 03:37:52,848 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3181.300000 2021-02-19 03:37:52,997 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3751.600000 2021-02-19 03:37:53,289 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers5 is 100 2021-02-19 03:37:53,290 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3982.600000 2021-02-19 03:37:53,450 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5457.600000 2021-02-19 03:37:53,601 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4598.900000 2021-02-19 03:37:53,615 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:53,686 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:53,872 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3932.400000 2021-02-19 03:37:53,986 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers6 is 100 2021-02-19 03:37:54,164 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4334.500000 2021-02-19 03:37:54,457 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3854.800000 2021-02-19 03:37:54,500 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3181.300000 2021-02-19 03:37:54,628 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3751.600000 2021-02-19 03:37:54,674 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers7 is 100 2021-02-19 03:37:54,930 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3982.600000 2021-02-19 03:37:55,088 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5457.600000 2021-02-19 03:37:55,319 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:55,345 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:55,352 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4598.900000 2021-02-19 03:37:55,516 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3888.400000 2021-02-19 03:37:55,602 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers8 is 100 2021-02-19 03:37:55,796 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4279.800000 2021-02-19 03:37:56,096 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3854.800000 2021-02-19 03:37:56,127 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3181.300000 2021-02-19 03:37:56,256 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers9 is 100 2021-02-19 03:37:56,259 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3751.600000 ############################################################ # # RAM FootPrint: 3893.52734375 # ############################################################ 2021-02-19 03:37:56,316 | test | DEBUG | Thread-371 | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> crash_thread():L729 2021-02-19 03:37:56,316 | test | INFO | Thread-371 | [common_lib:sleep:22] Sleep 61 seconds. Reason: Iteration:0 waiting to kill memc on all nodes 2021-02-19 03:37:56,582 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4225.400000 2021-02-19 03:37:56,744 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5407.800000 2021-02-19 03:37:56,951 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:56,984 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:57,006 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4560.600000 2021-02-19 03:37:57,135 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3888.400000 2021-02-19 03:37:57,417 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4279.800000 2021-02-19 03:37:57,733 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3853.500000 2021-02-19 03:37:57,746 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3214.500000 2021-02-19 03:37:57,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3747.200000 2021-02-19 03:37:58,217 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4225.400000 2021-02-19 03:37:58,375 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5407.800000 2021-02-19 03:37:58,578 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:37:58,611 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:37:58,660 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4560.600000 2021-02-19 03:37:58,762 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3888.400000 2021-02-19 03:37:59,032 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4279.800000 2021-02-19 03:37:59,382 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3214.500000 2021-02-19 03:37:59,404 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3853.500000 2021-02-19 03:37:59,519 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3756.343219 2021-02-19 03:37:59,859 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4203.187058 2021-02-19 03:38:00,036 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5407.800000 2021-02-19 03:38:00,226 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:00,278 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:00,306 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4486.370461 2021-02-19 03:38:00,398 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3881.489395 2021-02-19 03:38:00,658 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4299.262213 2021-02-19 03:38:01,058 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3260.557260 2021-02-19 03:38:01,084 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3927.266607 2021-02-19 03:38:01,178 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3756.343219 2021-02-19 03:38:01,526 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4203.187058 2021-02-19 03:38:01,726 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5490.177272 2021-02-19 03:38:01,881 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:01,974 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:01,996 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4486.370461 2021-02-19 03:38:02,046 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3881.489395 2021-02-19 03:38:02,311 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4356.462213 2021-02-19 03:38:02,723 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3260.157260 2021-02-19 03:38:02,746 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3946.966607 2021-02-19 03:38:02,822 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3797.243219 2021-02-19 03:38:03,140 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4182.587058 2021-02-19 03:38:03,388 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5562.877272 2021-02-19 03:38:03,551 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:03,605 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:03,665 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4449.870461 2021-02-19 03:38:03,720 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3900.289395 2021-02-19 03:38:03,957 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4356.462213 2021-02-19 03:38:04,384 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3260.157260 2021-02-19 03:38:04,400 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3946.966607 2021-02-19 03:38:04,474 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3797.243219 2021-02-19 03:38:04,770 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4182.587058 2021-02-19 03:38:05,009 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5562.877272 2021-02-19 03:38:05,213 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:05,252 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:05,315 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4449.870461 2021-02-19 03:38:05,378 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3900.289395 2021-02-19 03:38:05,448 | infra | INFO | pool-2-thread-55 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' completed 2021-02-19 03:38:05,448 | infra | INFO | pool-2-thread-55 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:38:05,584 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4361.962213 2021-02-19 03:38:06,009 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3251.657260 2021-02-19 03:38:06,038 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3946.966607 2021-02-19 03:38:06,101 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3797.243219 2021-02-19 03:38:06,384 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4078.387058 2021-02-19 03:38:06,650 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5608.377272 2021-02-19 03:38:06,836 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:06,867 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:06,944 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4405.770461 2021-02-19 03:38:07,006 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3877.889395 2021-02-19 03:38:07,201 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4361.962213 2021-02-19 03:38:07,660 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3251.657260 2021-02-19 03:38:07,676 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3961.166607 2021-02-19 03:38:07,746 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3760.443219 2021-02-19 03:38:08,003 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4078.387058 2021-02-19 03:38:08,295 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5608.377272 2021-02-19 03:38:08,486 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:08,500 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:08,582 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4405.770461 2021-02-19 03:38:08,631 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3877.889395 2021-02-19 03:38:08,836 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4361.962213 2021-02-19 03:38:09,288 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3251.657260 2021-02-19 03:38:09,309 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3961.166607 2021-02-19 03:38:09,381 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3760.443219 2021-02-19 03:38:09,647 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4042.100000 2021-02-19 03:38:09,920 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5641.000000 2021-02-19 03:38:10,161 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:10,171 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:10,206 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4405.770461 2021-02-19 03:38:10,275 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3877.889395 2021-02-19 03:38:10,507 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4342.300000 2021-02-19 03:38:10,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3262.100000 2021-02-19 03:38:10,930 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4014.200000 2021-02-19 03:38:11,007 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3461.200000 2021-02-19 03:38:11,276 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4042.100000 2021-02-19 03:38:11,536 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5641.000000 2021-02-19 03:38:11,785 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:11,819 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:11,849 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4459.500000 2021-02-19 03:38:11,911 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3897.700000 2021-02-19 03:38:12,131 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4342.300000 2021-02-19 03:38:12,539 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3325.000000 2021-02-19 03:38:12,565 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4111.900000 2021-02-19 03:38:12,650 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2792.900000 2021-02-19 03:38:12,888 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4013.100000 2021-02-19 03:38:13,144 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5741.700000 2021-02-19 03:38:13,413 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:13,453 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:13,483 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4515.300000 2021-02-19 03:38:13,539 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3917.800000 2021-02-19 03:38:13,743 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4343.900000 2021-02-19 03:38:14,160 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3325.000000 2021-02-19 03:38:14,190 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4111.900000 2021-02-19 03:38:14,278 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2792.900000 2021-02-19 03:38:14,509 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4013.100000 2021-02-19 03:38:14,756 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5741.700000 2021-02-19 03:38:15,036 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:15,117 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:15,168 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4515.300000 2021-02-19 03:38:15,210 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3917.800000 2021-02-19 03:38:15,381 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4343.900000 2021-02-19 03:38:15,785 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3416.115542 2021-02-19 03:38:15,828 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4222.879310 2021-02-19 03:38:15,908 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1841.561669 2021-02-19 03:38:16,128 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4013.100000 2021-02-19 03:38:16,367 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5826.923688 2021-02-19 03:38:16,651 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:16,746 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:16,849 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4627.311844 2021-02-19 03:38:16,888 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4016.211794 2021-02-19 03:38:17,013 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4433.134683 2021-02-19 03:38:17,430 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3416.115542 2021-02-19 03:38:17,479 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4222.879310 2021-02-19 03:38:17,563 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1841.561669 2021-02-19 03:38:17,740 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4131.579510 2021-02-19 03:38:17,999 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5826.923688 2021-02-19 03:38:18,282 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:18,403 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:18,474 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4627.311844 2021-02-19 03:38:18,523 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4016.211794 2021-02-19 03:38:18,641 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4433.134683 2021-02-19 03:38:19,072 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3416.115542 2021-02-19 03:38:19,121 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4222.879310 2021-02-19 03:38:19,203 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1841.561669 2021-02-19 03:38:19,380 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4300.377968 2021-02-19 03:38:19,631 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5921.925090 2021-02-19 03:38:19,915 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:20,042 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:20,109 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4627.311844 2021-02-19 03:38:20,165 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4016.211794 2021-02-19 03:38:20,252 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4433.134683 2021-02-19 03:38:20,706 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3475.756399 2021-02-19 03:38:20,750 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4317.519447 2021-02-19 03:38:20,831 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 885.961669 2021-02-19 03:38:20,987 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4300.377968 2021-02-19 03:38:21,253 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5921.925090 2021-02-19 03:38:21,526 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:21,678 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:21,760 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4692.507879 2021-02-19 03:38:21,799 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4096.963186 2021-02-19 03:38:21,897 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4575.844737 2021-02-19 03:38:22,335 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3515.556399 2021-02-19 03:38:22,391 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4345.119447 2021-02-19 03:38:22,496 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 276.661669 2021-02-19 03:38:22,670 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4465.377968 2021-02-19 03:38:22,890 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5979.725090 2021-02-19 03:38:23,128 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:23,305 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:23,401 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4703.207879 2021-02-19 03:38:23,427 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4200.163186 2021-02-19 03:38:23,525 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4693.544737 2021-02-19 03:38:23,959 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3515.556399 2021-02-19 03:38:24,026 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4345.119447 2021-02-19 03:38:24,124 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 276.661669 2021-02-19 03:38:24,289 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4465.377968 2021-02-19 03:38:24,516 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5979.725090 2021-02-19 03:38:24,736 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:24,973 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:25,032 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4703.207879 2021-02-19 03:38:25,059 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4200.163186 2021-02-19 03:38:25,164 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4693.544737 2021-02-19 03:38:25,611 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3512.874104 2021-02-19 03:38:25,701 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4344.028194 2021-02-19 03:38:25,770 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:25,913 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4509.095397 2021-02-19 03:38:26,197 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5979.725090 2021-02-19 03:38:26,335 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:26,585 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:26,673 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4672.105076 2021-02-19 03:38:26,678 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4228.732388 2021-02-19 03:38:26,792 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4709.319336 2021-02-19 03:38:27,250 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3512.874104 2021-02-19 03:38:27,339 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4344.028194 2021-02-19 03:38:27,407 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:27,529 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4509.095397 2021-02-19 03:38:27,865 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6057.707523 2021-02-19 03:38:27,971 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:28,209 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:28,312 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4672.105076 2021-02-19 03:38:28,336 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4228.732388 2021-02-19 03:38:28,443 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4709.319336 2021-02-19 03:38:28,897 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3512.874104 2021-02-19 03:38:28,977 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4344.028194 2021-02-19 03:38:29,028 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:29,150 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4509.095397 2021-02-19 03:38:29,486 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6115.806121 2021-02-19 03:38:29,594 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:29,828 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:29,993 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4695.109042 2021-02-19 03:38:30,019 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4266.080996 2021-02-19 03:38:30,059 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4709.319336 2021-02-19 03:38:30,519 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3517.133247 2021-02-19 03:38:30,608 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4342.988058 2021-02-19 03:38:30,648 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:30,756 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4528.296939 2021-02-19 03:38:31,104 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6115.806121 2021-02-19 03:38:31,203 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:31,441 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:31,627 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4695.109042 2021-02-19 03:38:31,661 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4266.080996 2021-02-19 03:38:31,678 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4648.309282 2021-02-19 03:38:32,145 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3517.133247 2021-02-19 03:38:32,236 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4342.988058 2021-02-19 03:38:32,299 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:32,392 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4505.696939 2021-02-19 03:38:32,723 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6118.506121 2021-02-19 03:38:32,808 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:33,069 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:33,263 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4731.709042 2021-02-19 03:38:33,312 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4240.580996 2021-02-19 03:38:33,326 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4636.009282 2021-02-19 03:38:33,801 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3520.533247 2021-02-19 03:38:33,921 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4367.988058 2021-02-19 03:38:33,946 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:34,022 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4505.696939 2021-02-19 03:38:34,364 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6118.506121 2021-02-19 03:38:34,418 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:34,687 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:34,928 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4731.709042 2021-02-19 03:38:34,957 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4636.009282 2021-02-19 03:38:34,973 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4240.580996 2021-02-19 03:38:35,428 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3520.533247 2021-02-19 03:38:35,607 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:35,612 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4383.436721 2021-02-19 03:38:35,714 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4554.059918 2021-02-19 03:38:36,013 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6125.311223 2021-02-19 03:38:36,042 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:36,305 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:36,592 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4804.885516 2021-02-19 03:38:36,628 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4247.023427 2021-02-19 03:38:36,642 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4670.474262 2021-02-19 03:38:37,079 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3532.753536 2021-02-19 03:38:37,269 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4383.436721 2021-02-19 03:38:37,276 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:37,362 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4554.059918 2021-02-19 03:38:37,644 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6125.311223 2021-02-19 03:38:37,657 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:37,924 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:38,045 | infra | INFO | pool-2-thread-60 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' completed 2021-02-19 03:38:38,045 | infra | INFO | pool-2-thread-60 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:38:38,220 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4804.885516 2021-02-19 03:38:38,279 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4670.474262 2021-02-19 03:38:38,303 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4247.023427 2021-02-19 03:38:38,717 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3532.753536 2021-02-19 03:38:38,920 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4383.436721 2021-02-19 03:38:38,947 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:39,042 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4554.059918 2021-02-19 03:38:39,278 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6125.311223 2021-02-19 03:38:39,293 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:39,555 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:39,780 | infra | INFO | pool-2-thread-25 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.31' completed 2021-02-19 03:38:39,782 | infra | INFO | pool-2-thread-25 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:38:39,848 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4812.985516 2021-02-19 03:38:39,924 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4672.174262 2021-02-19 03:38:39,938 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4177.123427 2021-02-19 03:38:40,309 | infra | INFO | pool-2-thread-48 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.34' completed 2021-02-19 03:38:40,309 | infra | INFO | pool-2-thread-48 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:38:40,357 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3501.353536 2021-02-19 03:38:40,582 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4343.436721 2021-02-19 03:38:40,608 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:40,677 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4513.759918 2021-02-19 03:38:40,923 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:40,924 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6037.111223 2021-02-19 03:38:41,164 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:41,346 | infra | INFO | pool-2-thread-59 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' completed 2021-02-19 03:38:41,348 | infra | INFO | pool-2-thread-59 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:38:41,482 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4812.985516 2021-02-19 03:38:41,565 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4672.174262 2021-02-19 03:38:41,578 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4177.123427 2021-02-19 03:38:41,588 | infra | INFO | pool-2-thread-50 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.34' completed 2021-02-19 03:38:41,589 | infra | INFO | pool-2-thread-50 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:38:41,984 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3501.353536 2021-02-19 03:38:42,250 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4343.436721 2021-02-19 03:38:42,262 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:42,312 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4483.759918 2021-02-19 03:38:42,561 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6052.311223 2021-02-19 03:38:42,572 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:42,805 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:43,111 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4777.585516 2021-02-19 03:38:43,186 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4628.674262 2021-02-19 03:38:43,211 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4133.223427 2021-02-19 03:38:43,624 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3470.553536 2021-02-19 03:38:43,918 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4283.436721 2021-02-19 03:38:43,937 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:43,957 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4483.759918 2021-02-19 03:38:44,207 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:44,227 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6052.311223 2021-02-19 03:38:44,414 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:44,736 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4777.585516 2021-02-19 03:38:44,813 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4628.674262 2021-02-19 03:38:44,846 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4133.223427 2021-02-19 03:38:45,233 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3470.553536 2021-02-19 03:38:45,549 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4277.800000 2021-02-19 03:38:45,561 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:45,588 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4406.800000 2021-02-19 03:38:45,828 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:45,849 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6051.700000 2021-02-19 03:38:46,059 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:46,391 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4744.900000 2021-02-19 03:38:46,440 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4567.800000 2021-02-19 03:38:46,486 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4057.800000 2021-02-19 03:38:46,845 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3459.400000 2021-02-19 03:38:47,191 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4277.800000 2021-02-19 03:38:47,236 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:47,250 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4406.800000 2021-02-19 03:38:47,444 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:47,480 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6051.700000 2021-02-19 03:38:47,670 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:48,023 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4744.900000 2021-02-19 03:38:48,085 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4567.800000 2021-02-19 03:38:48,114 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4057.800000 2021-02-19 03:38:48,461 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3459.400000 2021-02-19 03:38:48,858 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4277.800000 2021-02-19 03:38:48,884 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:48,898 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4406.800000 2021-02-19 03:38:49,094 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:49,112 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6051.700000 2021-02-19 03:38:49,289 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:49,654 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4883.400000 2021-02-19 03:38:49,707 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4630.900000 2021-02-19 03:38:49,749 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4108.000000 2021-02-19 03:38:50,117 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3459.400000 2021-02-19 03:38:50,548 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4471.700000 2021-02-19 03:38:50,559 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:50,578 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4526.700000 2021-02-19 03:38:50,720 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:50,736 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5892.800000 2021-02-19 03:38:50,894 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:51,286 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4883.400000 2021-02-19 03:38:51,369 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4630.900000 2021-02-19 03:38:51,403 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4108.000000 2021-02-19 03:38:51,717 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3574.700000 2021-02-19 03:38:52,237 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4471.700000 2021-02-19 03:38:52,269 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4526.700000 2021-02-19 03:38:52,279 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:52,348 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:52,391 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5460.700000 2021-02-19 03:38:52,513 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:52,900 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5153.200000 2021-02-19 03:38:53,003 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4712.500000 2021-02-19 03:38:53,032 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4200.200000 2021-02-19 03:38:53,338 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3735.800000 2021-02-19 03:38:53,871 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4745.800000 2021-02-19 03:38:53,930 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:53,937 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4678.800000 2021-02-19 03:38:54,038 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:54,109 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5460.700000 2021-02-19 03:38:54,147 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:54,523 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5153.200000 2021-02-19 03:38:54,638 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4712.500000 2021-02-19 03:38:54,667 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4200.200000 2021-02-19 03:38:54,977 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3735.800000 2021-02-19 03:38:55,530 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5001.500000 2021-02-19 03:38:55,582 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4871.900000 2021-02-19 03:38:55,599 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:55,690 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:55,742 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4866.600000 2021-02-19 03:38:55,782 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:56,168 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5153.200000 2021-02-19 03:38:56,308 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4712.500000 2021-02-19 03:38:56,335 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4200.200000 2021-02-19 03:38:56,627 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3870.200000 2021-02-19 03:38:57,164 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5001.500000 2021-02-19 03:38:57,240 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4871.900000 2021-02-19 03:38:57,279 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:57,316 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:57,325 | test | DEBUG | Thread-371 | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> kill_memcached():L745 2021-02-19 03:38:57,325 | test | INFO | Thread-371 | [common_lib:sleep:22] Sleep 5 seconds. Reason: Sleep for 5 seconds between continuous memc kill 2021-02-19 03:38:57,391 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4866.600000 2021-02-19 03:38:57,421 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:57,782 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5413.200000 2021-02-19 03:38:57,954 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4803.000000 2021-02-19 03:38:57,983 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4330.800000 2021-02-19 03:38:58,227 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3870.200000 2021-02-19 03:38:58,802 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5001.500000 2021-02-19 03:38:58,874 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4871.900000 2021-02-19 03:38:58,898 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:38:58,960 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:38:59,025 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4866.600000 2021-02-19 03:38:59,052 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:38:59,426 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5518.400000 2021-02-19 03:38:59,592 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4784.200000 2021-02-19 03:38:59,634 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4344.700000 2021-02-19 03:38:59,887 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3912.000000 2021-02-19 03:39:00,446 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5113.700000 2021-02-19 03:39:00,516 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4895.900000 2021-02-19 03:39:00,539 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:00,595 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:00,670 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4454.800000 2021-02-19 03:39:00,677 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:01,053 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5518.400000 2021-02-19 03:39:01,223 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4784.200000 2021-02-19 03:39:01,265 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4344.700000 2021-02-19 03:39:01,506 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3912.000000 2021-02-19 03:39:02,072 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5113.700000 2021-02-19 03:39:02,161 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4895.900000 2021-02-19 03:39:02,217 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:02,239 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:02,298 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4250.300000 2021-02-19 03:39:02,342 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:02,677 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5510.300000 2021-02-19 03:39:02,888 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4771.900000 2021-02-19 03:39:02,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4321.300000 2021-02-19 03:39:03,096 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3924.700000 2021-02-19 03:39:03,684 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5107.900000 2021-02-19 03:39:03,868 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4887.200000 2021-02-19 03:39:03,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:03,903 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:03,921 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4250.300000 2021-02-19 03:39:03,954 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:03,997 | test | DEBUG | Thread-371 | [basetestcase:check_coredump_exist:727] 172.23.110.69: No crash files found 2021-02-19 03:39:04,483 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5510.300000 2021-02-19 03:39:04,535 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4771.900000 2021-02-19 03:39:04,648 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4321.300000 2021-02-19 03:39:04,742 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3924.700000 2021-02-19 03:39:05,450 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5107.900000 2021-02-19 03:39:05,542 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:05,559 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4764.900000 2021-02-19 03:39:05,585 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:05,595 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4153.300000 2021-02-19 03:39:06,243 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4771.900000 2021-02-19 03:39:06,292 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:06,305 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4321.300000 2021-02-19 03:39:06,309 | test | DEBUG | Thread-371 | [basetestcase:check_coredump_exist:746] 172.23.110.69: No 'sanitizers.log.*' files found 2021-02-19 03:39:06,395 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3855.000000 2021-02-19 03:39:07,019 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5385.400000 2021-02-19 03:39:07,072 | test | DEBUG | Thread-371 | [basetestcase:check_coredump_exist:727] 172.23.110.64: No crash files found 2021-02-19 03:39:07,219 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5016.300000 2021-02-19 03:39:07,249 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:07,265 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:07,273 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4764.900000 2021-02-19 03:39:07,325 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4153.300000 2021-02-19 03:39:07,894 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4694.800000 2021-02-19 03:39:08,134 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:08,203 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3855.000000 2021-02-19 03:39:08,237 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4216.600000 2021-02-19 03:39:08,698 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5385.400000 2021-02-19 03:39:08,908 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5016.300000 2021-02-19 03:39:08,953 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:08,969 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4764.900000 2021-02-19 03:39:09,002 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:09,020 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4153.300000 2021-02-19 03:39:09,543 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3131.200000 2021-02-19 03:39:09,753 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:09,789 | test | DEBUG | Thread-371 | [basetestcase:check_coredump_exist:746] 172.23.110.64: No 'sanitizers.log.*' files found 2021-02-19 03:39:09,831 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2553.000000 2021-02-19 03:39:09,905 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2791.200000 2021-02-19 03:39:10,163 | test | DEBUG | Thread-371 | [basetestcase:check_coredump_exist:727] 172.23.110.65: No crash files found 2021-02-19 03:39:10,319 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5385.400000 2021-02-19 03:39:10,595 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3294.000000 2021-02-19 03:39:10,638 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:10,673 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:10,688 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3143.200000 2021-02-19 03:39:10,700 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2753.100000 2021-02-19 03:39:11,194 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3131.200000 2021-02-19 03:39:11,352 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:11,469 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2553.000000 2021-02-19 03:39:11,520 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2791.200000 2021-02-19 03:39:11,752 | test | DEBUG | Thread-371 | [basetestcase:check_coredump_exist:746] 172.23.110.65: No 'sanitizers.log.*' files found 2021-02-19 03:39:11,753 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:11,930 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3542.000000 2021-02-19 03:39:12,177 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.424000024796. 2021-02-19 03:39:12,177 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:12,224 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3294.000000 2021-02-19 03:39:12,305 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:12,336 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1345.900000 2021-02-19 03:39:12,348 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:12,380 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1527.500000 2021-02-19 03:39:12,609 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.431999921799. 2021-02-19 03:39:12,611 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:12,809 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1534.100000 2021-02-19 03:39:13,045 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.435000181198. 2021-02-19 03:39:13,046 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:13,066 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:13,134 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1232.900000 2021-02-19 03:39:13,216 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1362.500000 2021-02-19 03:39:13,502 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.456000089645. 2021-02-19 03:39:13,502 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:13,578 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1721.800000 2021-02-19 03:39:13,846 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1614.600000 2021-02-19 03:39:13,940 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.43799996376. 2021-02-19 03:39:13,940 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:13,943 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:13,982 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1345.900000 2021-02-19 03:39:14,015 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:14,036 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1527.500000 2021-02-19 03:39:14,359 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.419999837875. 2021-02-19 03:39:14,361 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:14,437 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1534.100000 2021-02-19 03:39:14,694 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:14,775 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.414000034332. 2021-02-19 03:39:14,775 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:14,832 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1232.900000 2021-02-19 03:39:14,865 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1362.500000 2021-02-19 03:39:15,181 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1721.800000 2021-02-19 03:39:15,194 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.418999910355. 2021-02-19 03:39:15,194 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:15,542 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5.700000 2021-02-19 03:39:15,595 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:15,608 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.414000034332. 2021-02-19 03:39:15,608 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:15,651 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2.900000 2021-02-19 03:39:15,667 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:15,694 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5.900000 2021-02-19 03:39:16,029 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.421000003815. 2021-02-19 03:39:16,029 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:16,088 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1534.100000 2021-02-19 03:39:16,339 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:16,466 | test | DEBUG | Thread-371 | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> _wait_warmup_completed():L3881 2021-02-19 03:39:16,466 | test | INFO | Thread-371 | [common_lib:sleep:22] Sleep 2 seconds. Reason: Warm-up not complete for GleamBookUsers0 on 172.23.110.64 2021-02-19 03:39:16,490 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 5.800000 2021-02-19 03:39:16,510 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2.700000 2021-02-19 03:39:16,806 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5.600000 2021-02-19 03:39:17,160 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5.700000 2021-02-19 03:39:17,197 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:17,338 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5.900000 2021-02-19 03:39:17,352 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:17,372 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2.900000 2021-02-19 03:39:17,691 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5.800000 2021-02-19 03:39:18,003 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:18,121 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 5.800000 2021-02-19 03:39:18,155 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2.700000 2021-02-19 03:39:18,454 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5.600000 2021-02-19 03:39:18,576 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 2.54799985886. 2021-02-19 03:39:18,576 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:18,773 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5.700000 2021-02-19 03:39:18,802 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:18,960 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5.900000 2021-02-19 03:39:18,976 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:18,987 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2.900000 2021-02-19 03:39:18,993 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.417000055313. 2021-02-19 03:39:18,994 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:19,302 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5.800000 2021-02-19 03:39:19,421 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.426000118256. 2021-02-19 03:39:19,421 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:19,609 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:19,773 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5.350000 2021-02-19 03:39:19,786 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 11.950000 2021-02-19 03:39:19,836 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.415999889374. 2021-02-19 03:39:19,838 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:20,052 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9.100000 2021-02-19 03:39:20,246 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.408999919891. 2021-02-19 03:39:20,246 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:20,374 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8.250000 2021-02-19 03:39:20,404 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:20,568 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 12.950000 2021-02-19 03:39:20,578 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:20,601 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7.250000 2021-02-19 03:39:20,651 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.404000043869. 2021-02-19 03:39:20,651 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:20,892 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 11.100000 2021-02-19 03:39:21,076 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.424999952316. 2021-02-19 03:39:21,076 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:21,201 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:21,387 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5.350000 2021-02-19 03:39:21,401 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 11.950000 2021-02-19 03:39:21,533 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.457000017166. 2021-02-19 03:39:21,535 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:21,651 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9.100000 2021-02-19 03:39:21,967 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8.250000 2021-02-19 03:39:21,979 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.444000005722. 2021-02-19 03:39:21,979 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:21,997 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:22,167 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 12.950000 2021-02-19 03:39:22,180 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:22,200 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7.250000 2021-02-19 03:39:22,423 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.444000005722. 2021-02-19 03:39:22,424 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:22,494 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 23.700000 2021-02-19 03:39:22,783 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:22,855 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.430999994278. 2021-02-19 03:39:22,855 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:22,984 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 10.450000 2021-02-19 03:39:23,006 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 22.650000 2021-02-19 03:39:23,246 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 22.100000 2021-02-19 03:39:23,282 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.425999879837. 2021-02-19 03:39:23,282 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:23,568 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 21.450000 2021-02-19 03:39:23,608 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:23,763 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.481999874115. 2021-02-19 03:39:23,765 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:23,773 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 18.350000 2021-02-19 03:39:23,789 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:23,805 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8.950000 2021-02-19 03:39:24,096 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 23.700000 2021-02-19 03:39:24,183 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.417999982834. 2021-02-19 03:39:24,184 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:24,375 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:24,588 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 10.450000 2021-02-19 03:39:24,605 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.421000003815. 2021-02-19 03:39:24,605 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:24,619 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 22.650000 2021-02-19 03:39:24,846 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 22.100000 2021-02-19 03:39:25,036 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.431999921799. 2021-02-19 03:39:25,038 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:25,190 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 21.450000 2021-02-19 03:39:25,216 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:25,410 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:25,437 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 18.350000 2021-02-19 03:39:25,440 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 172.650000 2021-02-19 03:39:25,464 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.427999973297. 2021-02-19 03:39:25,466 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:25,698 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 32.400000 2021-02-19 03:39:25,891 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.425999879837. 2021-02-19 03:39:25,891 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:26,006 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:26,200 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 10.450000 2021-02-19 03:39:26,230 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 22.650000 2021-02-19 03:39:26,348 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.457000017166. 2021-02-19 03:39:26,348 | test | DEBUG | Thread-371 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:39:26,453 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 48.100000 2021-02-19 03:39:26,779 | test | INFO | Thread-371 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.430000066757. 2021-02-19 03:39:26,783 | test | DEBUG | Thread-371 | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> crash_thread():L737 2021-02-19 03:39:26,783 | test | DEBUG | Thread-371 | [common_lib:sleep:24] Sleep 300 seconds. Reason: None 2021-02-19 03:39:26,799 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 703.050000 2021-02-19 03:39:26,854 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:27,045 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:27,059 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 26.750000 2021-02-19 03:39:27,075 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 172.650000 2021-02-19 03:39:27,306 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 32.400000 2021-02-19 03:39:27,612 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:27,809 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 16.350000 2021-02-19 03:39:27,835 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 29.350000 2021-02-19 03:39:28,052 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 48.100000 2021-02-19 03:39:28,418 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 703.050000 2021-02-19 03:39:28,463 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:28,654 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:28,677 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 26.750000 2021-02-19 03:39:28,703 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 172.650000 2021-02-19 03:39:28,895 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 32.400000 2021-02-19 03:39:29,233 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:29,421 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 182.978371 2021-02-19 03:39:29,437 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 48.851263 2021-02-19 03:39:29,653 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1003.577942 2021-02-19 03:39:30,023 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2295.669179 2021-02-19 03:39:30,065 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:30,293 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:30,328 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 172.650000 2021-02-19 03:39:30,344 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 26.750000 2021-02-19 03:39:30,519 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 38.578191 2021-02-19 03:39:30,852 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:31,052 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 182.978371 2021-02-19 03:39:31,086 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 48.851263 2021-02-19 03:39:31,292 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1003.577942 2021-02-19 03:39:31,634 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2295.669179 2021-02-19 03:39:31,674 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:31,924 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:31,957 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1070.386037 2021-02-19 03:39:31,964 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 732.845024 2021-02-19 03:39:32,150 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 38.578191 2021-02-19 03:39:32,484 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:32,693 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 727.978371 2021-02-19 03:39:32,723 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 429.951263 2021-02-19 03:39:32,911 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2398.177942 2021-02-19 03:39:33,279 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4358.269179 2021-02-19 03:39:33,305 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:33,592 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:33,596 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2334.186037 2021-02-19 03:39:33,631 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1904.145024 2021-02-19 03:39:33,776 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 106.278191 2021-02-19 03:39:34,085 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:34,295 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 727.978371 2021-02-19 03:39:34,328 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 429.951263 2021-02-19 03:39:34,519 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2398.177942 2021-02-19 03:39:34,892 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4358.269179 2021-02-19 03:39:34,905 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:35,229 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:35,249 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2334.186037 2021-02-19 03:39:35,283 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1904.145024 2021-02-19 03:39:35,424 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 106.278191 2021-02-19 03:39:35,687 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:35,898 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1661.678371 2021-02-19 03:39:35,937 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1191.151263 2021-02-19 03:39:36,135 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2398.177942 2021-02-19 03:39:36,500 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5553.269179 2021-02-19 03:39:36,509 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:36,852 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:36,867 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3675.786037 2021-02-19 03:39:36,905 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3534.145024 2021-02-19 03:39:37,023 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 578.078191 2021-02-19 03:39:37,280 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:37,507 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1661.678371 2021-02-19 03:39:37,552 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1191.151263 2021-02-19 03:39:37,746 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4262.877942 2021-02-19 03:39:38,117 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:38,131 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5553.269179 2021-02-19 03:39:38,473 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:38,506 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3675.786037 2021-02-19 03:39:38,536 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3534.145024 2021-02-19 03:39:38,635 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 578.078191 2021-02-19 03:39:38,904 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:39,108 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1661.678371 2021-02-19 03:39:39,155 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1191.151263 2021-02-19 03:39:39,355 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4262.877942 2021-02-19 03:39:39,717 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:39,760 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5672.357088 2021-02-19 03:39:40,084 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:40,158 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3675.786037 2021-02-19 03:39:40,180 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3534.145024 2021-02-19 03:39:40,257 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 578.078191 2021-02-19 03:39:40,493 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:40,723 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2938.046729 2021-02-19 03:39:40,773 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2540.913285 2021-02-19 03:39:40,954 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5098.108997 2021-02-19 03:39:41,342 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:41,380 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5672.357088 2021-02-19 03:39:41,688 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:41,769 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4195.100661 2021-02-19 03:39:41,822 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4458.010320 2021-02-19 03:39:41,869 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1741.331991 2021-02-19 03:39:42,102 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:42,325 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3863.746729 2021-02-19 03:39:42,375 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3519.213285 2021-02-19 03:39:42,555 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5551.608997 2021-02-19 03:39:42,950 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:43,016 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5352.157088 2021-02-19 03:39:43,276 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:43,387 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4402.000661 2021-02-19 03:39:43,463 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4916.210320 2021-02-19 03:39:43,490 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3206.231991 2021-02-19 03:39:43,743 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:43,950 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3863.746729 2021-02-19 03:39:43,986 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3519.213285 2021-02-19 03:39:44,160 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5551.608997 2021-02-19 03:39:44,559 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:44,657 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5352.157088 2021-02-19 03:39:44,910 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:45,012 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4402.000661 2021-02-19 03:39:45,079 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4916.210320 2021-02-19 03:39:45,115 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3206.231991 2021-02-19 03:39:45,326 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:45,562 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4417.546729 2021-02-19 03:39:45,595 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4127.613285 2021-02-19 03:39:45,765 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5510.708997 2021-02-19 03:39:46,164 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:46,273 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5352.157088 2021-02-19 03:39:46,516 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:46,631 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4370.300661 2021-02-19 03:39:46,713 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4884.010320 2021-02-19 03:39:46,723 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4322.531991 2021-02-19 03:39:46,936 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:47,181 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4417.546729 2021-02-19 03:39:47,210 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4127.613285 2021-02-19 03:39:47,374 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5510.708997 2021-02-19 03:39:47,773 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:47,884 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5226.757088 2021-02-19 03:39:48,125 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:48,259 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4370.300661 2021-02-19 03:39:48,341 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4884.010320 2021-02-19 03:39:48,354 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4322.531991 2021-02-19 03:39:48,532 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:48,792 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4417.546729 2021-02-19 03:39:48,825 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4127.613285 2021-02-19 03:39:48,980 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5510.708997 2021-02-19 03:39:49,371 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:49,486 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5255.437007 2021-02-19 03:39:49,713 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:49,881 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4418.701338 2021-02-19 03:39:49,987 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4855.465608 2021-02-19 03:39:49,993 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4801.388899 2021-02-19 03:39:50,148 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:50,395 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4439.005920 2021-02-19 03:39:50,426 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4102.105161 2021-02-19 03:39:50,575 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5521.930768 2021-02-19 03:39:51,005 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:51,084 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5255.437007 2021-02-19 03:39:51,302 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:51,523 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4418.701338 2021-02-19 03:39:51,605 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4855.465608 2021-02-19 03:39:51,667 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4801.388899 2021-02-19 03:39:51,759 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:52,007 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4439.005920 2021-02-19 03:39:52,040 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4102.105161 2021-02-19 03:39:52,174 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5521.930768 2021-02-19 03:39:52,671 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:52,753 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5242.037007 2021-02-19 03:39:52,914 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:53,154 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4409.701338 2021-02-19 03:39:53,246 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4832.465608 2021-02-19 03:39:53,306 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4937.688899 2021-02-19 03:39:53,369 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:53,608 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4413.705920 2021-02-19 03:39:53,660 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4096.105161 2021-02-19 03:39:53,775 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5467.630768 2021-02-19 03:39:54,266 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:54,365 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5242.037007 2021-02-19 03:39:54,536 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:54,788 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4409.701338 2021-02-19 03:39:54,867 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4832.465608 2021-02-19 03:39:54,924 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4937.688899 2021-02-19 03:39:54,983 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:55,230 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4413.705920 2021-02-19 03:39:55,280 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4096.105161 2021-02-19 03:39:55,413 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5467.630768 2021-02-19 03:39:55,862 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:56,017 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5214.937007 2021-02-19 03:39:56,163 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:56,403 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4386.601338 2021-02-19 03:39:56,499 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4834.765608 2021-02-19 03:39:56,588 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:56,609 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5015.788899 2021-02-19 03:39:56,832 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4359.805920 2021-02-19 03:39:56,937 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4075.605161 2021-02-19 03:39:57,025 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5407.530768 2021-02-19 03:39:57,463 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:57,619 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5214.937007 2021-02-19 03:39:57,765 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:58,019 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4386.601338 2021-02-19 03:39:58,151 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4834.765608 2021-02-19 03:39:58,213 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:58,252 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5015.788899 2021-02-19 03:39:58,441 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4359.805920 2021-02-19 03:39:58,546 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4075.605161 2021-02-19 03:39:58,648 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5407.530768 2021-02-19 03:39:59,053 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:39:59,214 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5214.937007 2021-02-19 03:39:59,351 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:39:59,631 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4373.476350 2021-02-19 03:39:59,798 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4858.174186 2021-02-19 03:39:59,825 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:39:59,872 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5024.225443 2021-02-19 03:40:00,049 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4326.136843 2021-02-19 03:40:00,157 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4075.605161 2021-02-19 03:40:00,273 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5407.530768 2021-02-19 03:40:00,664 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:00,828 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5195.129320 2021-02-19 03:40:00,957 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:01,256 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4373.476350 2021-02-19 03:40:01,453 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4858.174186 2021-02-19 03:40:01,463 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:01,503 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5024.225443 2021-02-19 03:40:01,657 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4326.136843 2021-02-19 03:40:01,796 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4110.454082 2021-02-19 03:40:01,894 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5399.956356 2021-02-19 03:40:02,250 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:02,427 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5190.529320 2021-02-19 03:40:02,562 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:02,857 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4358.976350 2021-02-19 03:40:03,096 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:03,117 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4875.974186 2021-02-19 03:40:03,134 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4949.325443 2021-02-19 03:40:03,282 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4316.836843 2021-02-19 03:40:03,423 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4108.154082 2021-02-19 03:40:03,519 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5391.556356 2021-02-19 03:40:03,864 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:04,042 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5190.529320 2021-02-19 03:40:04,188 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:04,453 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4358.976350 2021-02-19 03:40:04,717 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:04,746 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4875.974186 2021-02-19 03:40:04,760 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4949.325443 2021-02-19 03:40:04,895 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4316.836843 2021-02-19 03:40:05,052 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4108.154082 2021-02-19 03:40:05,164 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5391.556356 2021-02-19 03:40:05,516 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:05,673 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5197.029320 2021-02-19 03:40:05,809 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:06,076 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4334.376350 2021-02-19 03:40:06,334 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:06,384 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4875.974186 2021-02-19 03:40:06,395 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4949.325443 2021-02-19 03:40:06,513 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4283.836843 2021-02-19 03:40:06,683 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4097.954082 2021-02-19 03:40:06,785 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5398.256356 2021-02-19 03:40:07,161 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:07,322 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5197.029320 2021-02-19 03:40:07,405 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:07,710 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4334.376350 2021-02-19 03:40:07,950 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:08,062 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4881.474186 2021-02-19 03:40:08,073 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4842.725443 2021-02-19 03:40:08,135 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4283.836843 2021-02-19 03:40:08,306 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4097.954082 2021-02-19 03:40:08,423 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5398.256356 2021-02-19 03:40:08,780 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:08,947 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5197.029320 2021-02-19 03:40:09,006 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:09,311 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4334.376350 2021-02-19 03:40:09,596 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:09,716 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4828.368493 2021-02-19 03:40:09,737 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4749.972291 2021-02-19 03:40:09,779 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4264.834226 2021-02-19 03:40:09,986 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4057.762175 2021-02-19 03:40:10,073 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5370.292043 2021-02-19 03:40:10,413 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:10,608 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5211.704878 2021-02-19 03:40:10,657 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:10,974 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4294.733187 2021-02-19 03:40:11,265 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:11,380 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4828.368493 2021-02-19 03:40:11,414 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4749.972291 2021-02-19 03:40:11,454 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4264.834226 2021-02-19 03:40:11,640 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4057.762175 2021-02-19 03:40:11,716 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5370.292043 2021-02-19 03:40:12,109 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:12,273 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5211.704878 2021-02-19 03:40:12,329 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:12,628 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4267.933187 2021-02-19 03:40:12,907 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:13,053 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4773.568493 2021-02-19 03:40:13,096 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4702.772291 2021-02-19 03:40:13,128 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4226.534226 2021-02-19 03:40:13,290 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4045.562175 2021-02-19 03:40:13,368 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5355.892043 2021-02-19 03:40:13,769 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:13,778 | infra | INFO | pool-2-thread-42 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' completed 2021-02-19 03:40:13,779 | infra | INFO | pool-2-thread-42 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:40:13,953 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5208.404878 2021-02-19 03:40:14,000 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:14,319 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4267.933187 2021-02-19 03:40:14,562 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:14,733 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4773.568493 2021-02-19 03:40:14,795 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4702.772291 2021-02-19 03:40:14,822 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4226.534226 2021-02-19 03:40:14,984 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4045.562175 2021-02-19 03:40:15,042 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5355.892043 2021-02-19 03:40:15,467 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:15,618 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5172.904878 2021-02-19 03:40:15,664 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:16,003 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4247.633187 2021-02-19 03:40:16,219 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:16,453 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4773.568493 2021-02-19 03:40:16,496 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4690.172291 2021-02-19 03:40:16,513 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4235.634226 2021-02-19 03:40:16,696 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4037.562175 2021-02-19 03:40:16,723 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5315.392043 2021-02-19 03:40:17,167 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:17,345 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5172.904878 2021-02-19 03:40:17,351 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:17,694 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4247.633187 2021-02-19 03:40:17,874 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:18,140 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4740.468493 2021-02-19 03:40:18,206 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4690.172291 2021-02-19 03:40:18,230 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4235.634226 2021-02-19 03:40:18,384 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4037.562175 2021-02-19 03:40:18,410 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5315.392043 2021-02-19 03:40:18,845 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:19,032 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5172.904878 2021-02-19 03:40:19,052 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:19,362 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4247.633187 2021-02-19 03:40:19,482 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:19,792 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4764.541136 2021-02-19 03:40:19,927 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4719.539456 2021-02-19 03:40:19,934 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4224.161184 2021-02-19 03:40:20,052 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4019.230492 2021-02-19 03:40:20,062 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5311.206283 2021-02-19 03:40:20,483 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:20,667 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5090.662225 2021-02-19 03:40:20,691 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:21,000 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4235.461945 2021-02-19 03:40:21,105 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:21,444 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4764.541136 2021-02-19 03:40:21,615 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4224.161184 2021-02-19 03:40:21,618 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4719.539456 2021-02-19 03:40:21,720 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4019.230492 2021-02-19 03:40:21,739 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5311.206283 2021-02-19 03:40:22,096 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:22,296 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5025.562225 2021-02-19 03:40:22,354 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:22,618 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4224.761945 2021-02-19 03:40:22,723 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:23,128 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4809.041136 2021-02-19 03:40:23,256 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4734.539456 2021-02-19 03:40:23,296 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4257.861184 2021-02-19 03:40:23,371 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4005.630492 2021-02-19 03:40:23,394 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5332.906283 2021-02-19 03:40:23,709 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:23,944 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5025.562225 2021-02-19 03:40:24,009 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:24,298 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4224.761945 2021-02-19 03:40:24,346 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:24,765 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4809.041136 2021-02-19 03:40:24,887 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4734.539456 2021-02-19 03:40:24,963 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4257.861184 2021-02-19 03:40:25,028 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4005.630492 2021-02-19 03:40:25,062 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5332.906283 2021-02-19 03:40:25,341 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:25,594 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4983.240915 2021-02-19 03:40:25,641 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:25,917 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4243.364282 2021-02-19 03:40:25,964 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:26,490 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4836.881480 2021-02-19 03:40:26,618 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4280.045347 2021-02-19 03:40:26,627 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4730.859488 2021-02-19 03:40:26,694 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4019.231950 2021-02-19 03:40:26,736 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5410.333185 2021-02-19 03:40:26,982 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:27,221 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4983.240915 2021-02-19 03:40:27,250 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:27,549 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4243.364282 2021-02-19 03:40:27,619 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:28,131 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4836.881480 2021-02-19 03:40:28,279 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4280.045347 2021-02-19 03:40:28,335 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4730.859488 2021-02-19 03:40:28,401 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4019.231950 2021-02-19 03:40:28,428 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5410.333185 2021-02-19 03:40:28,595 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:28,877 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4983.240915 2021-02-19 03:40:28,884 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:29,174 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4243.364282 2021-02-19 03:40:29,250 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:29,753 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4867.040344 2021-02-19 03:40:29,947 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4339.384162 2021-02-19 03:40:29,986 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4709.720032 2021-02-19 03:40:30,051 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4075.101458 2021-02-19 03:40:30,111 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5467.326902 2021-02-19 03:40:30,220 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:30,516 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:30,526 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5015.078690 2021-02-19 03:40:30,793 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4295.202337 2021-02-19 03:40:30,871 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:31,403 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4867.040344 2021-02-19 03:40:31,618 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4339.384162 2021-02-19 03:40:31,648 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4709.720032 2021-02-19 03:40:31,726 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4075.101458 2021-02-19 03:40:31,760 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5467.326902 2021-02-19 03:40:31,829 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:32,151 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5015.078690 2021-02-19 03:40:32,161 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:32,440 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4354.502337 2021-02-19 03:40:32,522 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:33,029 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4910.740344 2021-02-19 03:40:33,266 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4354.184162 2021-02-19 03:40:33,309 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4736.020032 2021-02-19 03:40:33,391 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4122.701458 2021-02-19 03:40:33,437 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5485.126902 2021-02-19 03:40:33,509 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:33,802 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:33,821 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5058.478690 2021-02-19 03:40:34,058 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4354.502337 2021-02-19 03:40:34,135 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:34,635 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4910.740344 2021-02-19 03:40:34,891 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4354.184162 2021-02-19 03:40:34,948 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4736.020032 2021-02-19 03:40:35,085 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4122.701458 2021-02-19 03:40:35,128 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5485.126902 2021-02-19 03:40:35,144 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:35,427 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:35,453 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5144.927736 2021-02-19 03:40:35,680 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4391.867866 2021-02-19 03:40:35,760 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:36,249 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4910.740344 2021-02-19 03:40:36,520 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4366.074113 2021-02-19 03:40:36,569 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4804.087406 2021-02-19 03:40:36,782 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:36,786 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4146.410095 2021-02-19 03:40:36,799 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5469.588806 2021-02-19 03:40:37,073 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:37,125 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5144.927736 2021-02-19 03:40:37,309 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4391.867866 2021-02-19 03:40:37,368 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:37,901 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4931.482609 2021-02-19 03:40:38,206 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4366.074113 2021-02-19 03:40:38,236 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4804.087406 2021-02-19 03:40:38,426 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4146.410095 2021-02-19 03:40:38,434 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:38,453 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5469.588806 2021-02-19 03:40:38,700 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:38,770 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5144.927736 2021-02-19 03:40:38,938 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4391.867866 2021-02-19 03:40:38,977 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:39,520 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4893.382609 2021-02-19 03:40:39,867 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4328.074113 2021-02-19 03:40:39,911 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4840.787406 2021-02-19 03:40:40,055 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:40,075 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4113.910095 2021-02-19 03:40:40,098 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5474.488806 2021-02-19 03:40:40,321 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:40,398 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5177.927736 2021-02-19 03:40:40,561 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4378.667866 2021-02-19 03:40:40,598 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:41,140 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4893.382609 2021-02-19 03:40:41,493 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4328.074113 2021-02-19 03:40:41,559 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4840.787406 2021-02-19 03:40:41,690 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:41,729 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4113.910095 2021-02-19 03:40:41,760 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5474.488806 2021-02-19 03:40:41,951 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:42,033 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5177.927736 2021-02-19 03:40:42,180 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4378.667866 2021-02-19 03:40:42,203 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:42,780 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4839.282609 2021-02-19 03:40:43,125 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4320.474113 2021-02-19 03:40:43,206 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4848.587406 2021-02-19 03:40:43,344 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:43,391 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4113.710095 2021-02-19 03:40:43,405 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5492.188806 2021-02-19 03:40:43,628 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:43,686 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5191.727736 2021-02-19 03:40:43,799 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4350.967866 2021-02-19 03:40:43,828 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:44,392 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4839.282609 2021-02-19 03:40:44,772 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4320.474113 2021-02-19 03:40:44,842 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4848.587406 2021-02-19 03:40:44,970 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:45,049 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4113.710095 2021-02-19 03:40:45,072 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5492.188806 2021-02-19 03:40:45,293 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:45,384 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5191.727736 2021-02-19 03:40:45,427 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4350.967866 2021-02-19 03:40:45,443 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:45,997 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4844.764026 2021-02-19 03:40:46,404 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4320.474113 2021-02-19 03:40:46,470 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4835.561216 2021-02-19 03:40:46,654 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:46,703 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5471.780198 2021-02-19 03:40:46,713 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4128.539464 2021-02-19 03:40:46,917 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:47,059 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4336.344964 2021-02-19 03:40:47,075 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5163.171597 2021-02-19 03:40:47,132 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:47,619 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4844.764026 2021-02-19 03:40:48,063 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4296.442774 2021-02-19 03:40:48,132 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4835.561216 2021-02-19 03:40:48,276 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:48,332 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5471.780198 2021-02-19 03:40:48,364 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4128.539464 2021-02-19 03:40:48,565 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:48,706 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5163.171597 2021-02-19 03:40:48,707 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4336.344964 2021-02-19 03:40:48,757 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:49,240 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4844.764026 2021-02-19 03:40:49,697 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4314.942774 2021-02-19 03:40:49,773 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4836.161216 2021-02-19 03:40:49,904 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:49,980 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5449.980198 2021-02-19 03:40:50,005 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4130.039464 2021-02-19 03:40:50,191 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:50,339 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4336.344964 2021-02-19 03:40:50,345 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5163.171597 2021-02-19 03:40:50,400 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:50,841 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4838.164026 2021-02-19 03:40:51,319 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4314.942774 2021-02-19 03:40:51,385 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4836.161216 2021-02-19 03:40:51,520 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:51,594 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5449.980198 2021-02-19 03:40:51,624 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4130.039464 2021-02-19 03:40:51,845 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:52,019 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5200.471597 2021-02-19 03:40:52,020 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4340.444964 2021-02-19 03:40:52,058 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:52,456 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4804.464026 2021-02-19 03:40:52,941 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4270.442774 2021-02-19 03:40:53,016 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4819.161216 2021-02-19 03:40:53,124 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:53,234 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5390.180198 2021-02-19 03:40:53,263 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4122.639464 2021-02-19 03:40:53,506 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:53,663 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5195.871597 2021-02-19 03:40:53,696 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4324.544964 2021-02-19 03:40:53,707 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:54,078 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4804.464026 2021-02-19 03:40:54,566 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4270.442774 2021-02-19 03:40:54,694 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4819.161216 2021-02-19 03:40:54,818 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:54,871 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5390.180198 2021-02-19 03:40:54,894 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4122.639464 2021-02-19 03:40:55,158 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:55,335 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5195.871597 2021-02-19 03:40:55,351 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:55,368 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4324.544964 2021-02-19 03:40:55,684 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4710.884031 2021-02-19 03:40:56,194 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4270.442774 2021-02-19 03:40:56,348 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4819.161216 2021-02-19 03:40:56,469 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:56,532 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5392.347465 2021-02-19 03:40:56,542 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4083.439792 2021-02-19 03:40:56,845 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:57,023 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4300.265658 2021-02-19 03:40:57,032 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:57,036 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5205.806632 2021-02-19 03:40:57,332 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4710.884031 2021-02-19 03:40:57,841 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4250.033200 2021-02-19 03:40:57,977 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4789.147866 2021-02-19 03:40:58,168 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4083.439792 2021-02-19 03:40:58,174 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:58,230 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5392.347465 2021-02-19 03:40:58,484 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:40:58,673 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4300.265658 2021-02-19 03:40:58,687 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:40:58,697 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5205.806632 2021-02-19 03:40:58,967 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4710.884031 2021-02-19 03:40:59,476 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4207.533200 2021-02-19 03:40:59,650 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4772.847866 2021-02-19 03:40:59,832 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4129.139792 2021-02-19 03:40:59,835 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:40:59,901 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5376.447465 2021-02-19 03:41:00,121 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:00,325 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4300.265658 2021-02-19 03:41:00,351 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:00,368 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5205.806632 2021-02-19 03:41:00,582 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4748.284031 2021-02-19 03:41:01,101 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4207.533200 2021-02-19 03:41:01,290 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4772.847866 2021-02-19 03:41:01,519 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:01,520 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4129.139792 2021-02-19 03:41:01,540 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5376.447465 2021-02-19 03:41:01,762 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:01,963 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4269.165658 2021-02-19 03:41:02,009 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:02,025 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5158.106632 2021-02-19 03:41:02,213 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4748.284031 2021-02-19 03:41:02,727 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4238.333200 2021-02-19 03:41:02,927 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4796.647866 2021-02-19 03:41:03,151 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4130.339792 2021-02-19 03:41:03,164 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:03,180 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5391.047465 2021-02-19 03:41:03,437 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:03,589 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4276.165658 2021-02-19 03:41:03,677 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:03,694 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5131.506632 2021-02-19 03:41:03,869 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4752.484031 2021-02-19 03:41:04,375 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4238.333200 2021-02-19 03:41:04,549 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4796.647866 2021-02-19 03:41:04,805 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4130.339792 2021-02-19 03:41:04,806 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:04,826 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5391.047465 2021-02-19 03:41:05,058 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:05,217 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4276.165658 2021-02-19 03:41:05,290 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:05,319 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5131.506632 2021-02-19 03:41:05,502 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4814.695552 2021-02-19 03:41:06,040 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4253.788606 2021-02-19 03:41:06,158 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4818.697901 2021-02-19 03:41:06,430 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4105.334783 2021-02-19 03:41:06,438 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:06,467 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5373.806547 2021-02-19 03:41:06,660 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:06,836 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4285.482659 2021-02-19 03:41:06,907 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:06,953 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5087.758921 2021-02-19 03:41:07,117 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4814.695552 2021-02-19 03:41:07,651 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4253.788606 2021-02-19 03:41:07,790 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4818.697901 2021-02-19 03:41:08,098 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5373.806547 2021-02-19 03:41:08,117 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4105.334783 2021-02-19 03:41:08,121 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:08,272 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:08,484 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4285.482659 2021-02-19 03:41:08,562 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:08,592 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5087.758921 2021-02-19 03:41:08,753 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4814.695552 2021-02-19 03:41:09,266 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4253.788606 2021-02-19 03:41:09,413 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4818.697901 2021-02-19 03:41:09,763 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5364.606547 2021-02-19 03:41:09,765 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:09,770 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4026.634783 2021-02-19 03:41:09,904 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:10,102 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4321.182659 2021-02-19 03:41:10,171 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:10,243 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5087.758921 2021-02-19 03:41:10,377 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4810.995552 2021-02-19 03:41:10,875 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4283.088606 2021-02-19 03:41:11,036 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4843.997901 2021-02-19 03:41:11,398 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:11,418 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5364.606547 2021-02-19 03:41:11,446 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4026.634783 2021-02-19 03:41:11,523 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:11,729 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4321.182659 2021-02-19 03:41:11,786 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:11,871 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5063.358921 2021-02-19 03:41:11,994 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4810.995552 2021-02-19 03:41:12,506 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4307.188606 2021-02-19 03:41:12,664 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4860.797901 2021-02-19 03:41:13,076 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:13,092 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5379.306547 2021-02-19 03:41:13,108 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3991.434783 2021-02-19 03:41:13,176 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:13,349 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4355.282659 2021-02-19 03:41:13,457 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:13,535 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5072.158921 2021-02-19 03:41:13,619 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4897.495552 2021-02-19 03:41:14,121 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4307.188606 2021-02-19 03:41:14,276 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4860.797901 2021-02-19 03:41:14,700 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:14,734 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5379.306547 2021-02-19 03:41:14,749 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3991.434783 2021-02-19 03:41:14,802 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:14,973 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4355.282659 2021-02-19 03:41:15,075 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:15,164 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5072.158921 2021-02-19 03:41:15,256 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4897.495552 2021-02-19 03:41:15,763 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4329.322461 2021-02-19 03:41:15,891 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4896.119760 2021-02-19 03:41:16,315 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:16,434 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5379.306547 2021-02-19 03:41:16,451 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3991.434783 2021-02-19 03:41:16,454 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:16,622 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4379.129265 2021-02-19 03:41:16,739 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:16,808 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5114.962481 2021-02-19 03:41:16,868 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4911.611506 2021-02-19 03:41:17,414 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4329.322461 2021-02-19 03:41:17,539 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4896.119760 2021-02-19 03:41:17,969 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:18,078 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5426.216908 2021-02-19 03:41:18,104 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:18,112 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4012.275638 2021-02-19 03:41:18,257 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4379.129265 2021-02-19 03:41:18,351 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:18,427 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5114.962481 2021-02-19 03:41:18,483 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4911.611506 2021-02-19 03:41:19,061 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4329.322461 2021-02-19 03:41:19,198 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4896.119760 2021-02-19 03:41:19,601 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:19,750 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5490.816908 2021-02-19 03:41:19,759 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:19,773 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4053.275638 2021-02-19 03:41:19,900 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4380.729265 2021-02-19 03:41:19,982 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:20,059 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5174.762481 2021-02-19 03:41:20,125 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4906.111506 2021-02-19 03:41:20,707 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4350.122461 2021-02-19 03:41:20,836 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4896.019760 2021-02-19 03:41:21,213 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:21,415 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5490.816908 2021-02-19 03:41:21,421 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:21,437 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4053.275638 2021-02-19 03:41:21,571 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4380.729265 2021-02-19 03:41:21,615 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:21,694 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5174.762481 2021-02-19 03:41:21,742 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4906.111506 2021-02-19 03:41:22,342 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4338.022461 2021-02-19 03:41:22,459 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4888.619760 2021-02-19 03:41:22,822 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:23,071 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4074.575638 2021-02-19 03:41:23,118 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5528.816908 2021-02-19 03:41:23,125 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:23,236 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:23,265 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4362.729265 2021-02-19 03:41:23,326 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5222.862481 2021-02-19 03:41:23,369 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4834.511506 2021-02-19 03:41:23,986 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4338.022461 2021-02-19 03:41:24,079 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4888.619760 2021-02-19 03:41:24,437 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:24,726 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4074.575638 2021-02-19 03:41:24,753 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:24,773 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5528.816908 2021-02-19 03:41:24,882 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:24,913 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4362.729265 2021-02-19 03:41:24,970 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5222.862481 2021-02-19 03:41:25,017 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4834.511506 2021-02-19 03:41:25,604 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4347.000000 2021-02-19 03:41:25,691 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4871.600000 2021-02-19 03:41:26,052 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:26,369 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4074.575638 2021-02-19 03:41:26,430 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:26,453 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5528.816908 2021-02-19 03:41:26,548 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:26,582 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4359.200000 2021-02-19 03:41:26,648 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5222.600000 2021-02-19 03:41:26,671 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4816.100000 2021-02-19 03:41:27,221 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4347.000000 2021-02-19 03:41:27,319 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4871.600000 2021-02-19 03:41:27,680 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:28,005 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4104.600000 2021-02-19 03:41:28,078 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:28,094 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5525.600000 2021-02-19 03:41:28,191 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:28,221 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4359.200000 2021-02-19 03:41:28,279 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5222.600000 2021-02-19 03:41:28,325 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4816.100000 2021-02-19 03:41:28,835 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4347.000000 2021-02-19 03:41:28,934 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4871.600000 2021-02-19 03:41:29,296 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:29,657 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4124.800000 2021-02-19 03:41:29,730 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:29,750 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5548.000000 2021-02-19 03:41:29,842 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:29,891 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4384.800000 2021-02-19 03:41:29,921 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5187.400000 2021-02-19 03:41:29,960 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4825.500000 2021-02-19 03:41:30,460 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4368.600000 2021-02-19 03:41:30,556 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4835.300000 2021-02-19 03:41:30,917 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:31,288 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4124.800000 2021-02-19 03:41:31,352 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:31,404 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5548.000000 2021-02-19 03:41:31,480 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:31,556 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4384.800000 2021-02-19 03:41:31,575 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5187.400000 2021-02-19 03:41:31,625 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4825.500000 2021-02-19 03:41:32,071 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4368.600000 2021-02-19 03:41:32,186 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4835.300000 2021-02-19 03:41:32,548 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:32,920 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4104.700000 2021-02-19 03:41:33,023 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:33,049 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5586.900000 2021-02-19 03:41:33,118 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:33,191 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4414.800000 2021-02-19 03:41:33,223 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5151.400000 2021-02-19 03:41:33,244 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4862.200000 2021-02-19 03:41:33,691 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4400.900000 2021-02-19 03:41:33,801 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4841.400000 2021-02-19 03:41:34,154 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:34,575 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4104.700000 2021-02-19 03:41:34,658 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:34,717 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5586.900000 2021-02-19 03:41:34,783 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:34,854 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4414.800000 2021-02-19 03:41:34,864 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4862.200000 2021-02-19 03:41:34,894 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5151.400000 2021-02-19 03:41:35,315 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4400.900000 2021-02-19 03:41:35,424 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4841.400000 2021-02-19 03:41:35,766 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:36,177 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4051.200000 2021-02-19 03:41:36,288 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:36,344 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5586.900000 2021-02-19 03:41:36,430 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:36,528 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4427.300000 2021-02-19 03:41:36,536 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5146.400000 2021-02-19 03:41:36,548 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4895.000000 2021-02-19 03:41:36,944 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4408.600000 2021-02-19 03:41:37,059 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4819.300000 2021-02-19 03:41:37,398 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:37,811 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4051.200000 2021-02-19 03:41:37,944 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:38,007 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5629.400000 2021-02-19 03:41:38,062 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:38,168 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4427.300000 2021-02-19 03:41:38,181 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5146.400000 2021-02-19 03:41:38,210 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4895.000000 2021-02-19 03:41:38,573 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4408.600000 2021-02-19 03:41:38,667 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4819.300000 2021-02-19 03:41:39,052 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:39,484 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4051.200000 2021-02-19 03:41:39,592 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:39,647 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5644.000000 2021-02-19 03:41:39,720 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:39,812 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4392.600000 2021-02-19 03:41:39,818 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5183.100000 2021-02-19 03:41:39,842 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4883.200000 2021-02-19 03:41:40,210 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4381.400000 2021-02-19 03:41:40,293 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4819.300000 2021-02-19 03:41:40,654 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:41,121 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4020.200000 2021-02-19 03:41:41,233 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:41,326 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5644.000000 2021-02-19 03:41:41,355 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:41,469 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4392.600000 2021-02-19 03:41:41,487 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5183.100000 2021-02-19 03:41:41,509 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4883.200000 2021-02-19 03:41:41,836 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4381.400000 2021-02-19 03:41:41,934 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4840.400000 2021-02-19 03:41:42,321 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:42,730 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4023.200000 2021-02-19 03:41:42,871 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:43,010 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:43,029 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5611.400000 2021-02-19 03:41:43,108 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4381.200000 2021-02-19 03:41:43,161 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5191.200000 2021-02-19 03:41:43,170 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4873.400000 2021-02-19 03:41:43,453 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4354.300000 2021-02-19 03:41:43,549 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4830.000000 2021-02-19 03:41:43,944 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:44,374 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4023.200000 2021-02-19 03:41:44,486 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:44,648 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:44,668 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5611.400000 2021-02-19 03:41:44,746 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4381.200000 2021-02-19 03:41:44,801 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5191.200000 2021-02-19 03:41:44,819 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4873.400000 2021-02-19 03:41:45,076 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4354.300000 2021-02-19 03:41:45,176 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4830.000000 2021-02-19 03:41:45,540 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:45,977 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4041.900000 2021-02-19 03:41:46,102 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:46,266 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:46,299 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5611.400000 2021-02-19 03:41:46,375 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4381.200000 2021-02-19 03:41:46,427 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5144.800000 2021-02-19 03:41:46,446 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4827.000000 2021-02-19 03:41:46,693 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4317.200000 2021-02-19 03:41:46,802 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4852.800000 2021-02-19 03:41:47,137 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:47,586 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4041.900000 2021-02-19 03:41:47,710 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:47,891 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:47,936 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5583.900000 2021-02-19 03:41:47,997 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4354.400000 2021-02-19 03:41:48,094 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5144.800000 2021-02-19 03:41:48,127 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4827.000000 2021-02-19 03:41:48,339 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4317.200000 2021-02-19 03:41:48,417 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4852.800000 2021-02-19 03:41:48,755 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:49,197 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4041.900000 2021-02-19 03:41:49,326 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:49,536 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:49,569 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5506.597501 2021-02-19 03:41:49,615 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4358.175762 2021-02-19 03:41:49,729 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5104.146877 2021-02-19 03:41:49,762 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4826.693103 2021-02-19 03:41:49,983 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4289.591404 2021-02-19 03:41:50,059 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4864.789755 2021-02-19 03:41:50,367 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:50,861 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4035.728936 2021-02-19 03:41:50,996 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:51,141 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:51,213 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5506.597501 2021-02-19 03:41:51,285 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4358.175762 2021-02-19 03:41:51,371 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5104.146877 2021-02-19 03:41:51,407 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4826.693103 2021-02-19 03:41:51,618 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4289.591404 2021-02-19 03:41:51,684 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4864.789755 2021-02-19 03:41:51,964 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:52,486 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4038.028936 2021-02-19 03:41:52,628 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:52,772 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:52,881 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5509.197501 2021-02-19 03:41:52,951 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4328.775762 2021-02-19 03:41:53,019 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5122.146877 2021-02-19 03:41:53,033 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4816.493103 2021-02-19 03:41:53,230 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4248.191404 2021-02-19 03:41:53,296 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4877.789755 2021-02-19 03:41:53,586 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:54,117 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4038.028936 2021-02-19 03:41:54,273 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:54,411 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:54,546 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5509.197501 2021-02-19 03:41:54,582 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4328.775762 2021-02-19 03:41:54,645 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5122.146877 2021-02-19 03:41:54,709 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4816.493103 2021-02-19 03:41:54,882 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4248.191404 2021-02-19 03:41:54,941 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4877.789755 2021-02-19 03:41:55,194 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:55,746 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4023.028936 2021-02-19 03:41:55,884 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:56,028 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:56,193 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5533.697501 2021-02-19 03:41:56,227 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4344.975762 2021-02-19 03:41:56,293 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5122.146877 2021-02-19 03:41:56,377 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4816.493103 2021-02-19 03:41:56,548 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4249.091404 2021-02-19 03:41:56,575 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4909.089755 2021-02-19 03:41:56,795 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:57,368 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4023.028936 2021-02-19 03:41:57,513 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:57,664 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:57,829 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5533.697501 2021-02-19 03:41:57,862 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4344.975762 2021-02-19 03:41:57,951 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5195.646877 2021-02-19 03:41:58,036 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4833.393103 2021-02-19 03:41:58,196 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4249.091404 2021-02-19 03:41:58,211 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4909.089755 2021-02-19 03:41:58,444 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:41:58,984 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4023.028936 2021-02-19 03:41:59,164 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:41:59,276 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:41:59,453 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5533.697501 2021-02-19 03:41:59,493 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4344.975762 2021-02-19 03:41:59,589 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5206.971757 2021-02-19 03:41:59,684 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4819.459986 2021-02-19 03:41:59,848 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4257.842594 2021-02-19 03:41:59,858 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4916.062746 2021-02-19 03:42:00,065 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:00,604 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4015.133423 2021-02-19 03:42:00,805 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:00,888 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:01,085 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5553.082438 2021-02-19 03:42:01,134 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4355.245875 2021-02-19 03:42:01,233 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5206.971757 2021-02-19 03:42:01,367 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4819.459986 2021-02-19 03:42:01,473 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4257.842594 2021-02-19 03:42:01,493 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4916.062746 2021-02-19 03:42:01,664 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:02,217 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4015.133423 2021-02-19 03:42:02,428 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:02,503 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:02,704 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5504.282438 2021-02-19 03:42:02,783 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4369.445875 2021-02-19 03:42:02,871 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5173.071757 2021-02-19 03:42:02,990 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4800.759986 2021-02-19 03:42:03,121 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4903.262746 2021-02-19 03:42:03,128 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4282.842594 2021-02-19 03:42:03,272 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:03,842 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4010.533423 2021-02-19 03:42:04,045 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:04,125 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:04,345 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5504.282438 2021-02-19 03:42:04,411 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4369.445875 2021-02-19 03:42:04,484 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5173.071757 2021-02-19 03:42:04,631 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4800.759986 2021-02-19 03:42:04,749 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4903.262746 2021-02-19 03:42:04,765 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4282.842594 2021-02-19 03:42:04,892 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:05,453 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4010.533423 2021-02-19 03:42:05,650 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:05,726 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:05,986 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5416.182438 2021-02-19 03:42:06,059 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4373.545875 2021-02-19 03:42:06,118 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5133.571757 2021-02-19 03:42:06,253 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4803.759986 2021-02-19 03:42:06,384 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4903.262746 2021-02-19 03:42:06,388 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4282.842594 2021-02-19 03:42:06,513 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:07,078 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4036.233423 2021-02-19 03:42:07,293 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:07,341 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:07,604 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5416.182438 2021-02-19 03:42:07,694 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4373.545875 2021-02-19 03:42:07,759 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5133.571757 2021-02-19 03:42:07,871 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4803.759986 2021-02-19 03:42:08,016 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4291.942594 2021-02-19 03:42:08,035 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4852.862746 2021-02-19 03:42:08,141 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:08,698 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4036.233423 2021-02-19 03:42:08,940 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:08,969 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:09,253 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5416.182438 2021-02-19 03:42:09,341 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4373.545875 2021-02-19 03:42:09,390 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5133.571757 2021-02-19 03:42:09,507 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4803.759986 2021-02-19 03:42:09,671 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4311.378151 2021-02-19 03:42:09,686 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4831.942617 2021-02-19 03:42:09,776 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:10,309 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4036.233423 2021-02-19 03:42:10,558 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:10,604 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:10,888 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5452.544298 2021-02-19 03:42:10,970 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4375.484274 2021-02-19 03:42:11,032 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5079.165266 2021-02-19 03:42:11,177 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4818.946018 2021-02-19 03:42:11,305 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4311.378151 2021-02-19 03:42:11,348 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4831.942617 2021-02-19 03:42:11,401 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:11,920 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4067.646259 2021-02-19 03:42:12,180 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:12,223 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:12,489 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5491.419960 2021-02-19 03:42:12,592 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4383.453389 2021-02-19 03:42:12,644 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5033.833582 2021-02-19 03:42:12,808 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4849.734124 2021-02-19 03:42:12,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4328.054063 2021-02-19 03:42:12,990 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4813.141368 2021-02-19 03:42:13,022 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:13,539 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4109.153105 2021-02-19 03:42:13,796 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:13,825 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:14,112 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5491.419960 2021-02-19 03:42:14,213 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4383.453389 2021-02-19 03:42:14,295 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5033.833582 2021-02-19 03:42:14,457 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4849.734124 2021-02-19 03:42:14,572 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4328.054063 2021-02-19 03:42:14,608 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4813.141368 2021-02-19 03:42:14,657 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:15,157 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4109.153105 2021-02-19 03:42:15,436 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:15,447 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:15,724 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5579.019960 2021-02-19 03:42:15,834 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4358.453389 2021-02-19 03:42:15,914 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4984.533582 2021-02-19 03:42:16,081 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4838.034124 2021-02-19 03:42:16,190 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4309.654063 2021-02-19 03:42:16,236 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4783.341368 2021-02-19 03:42:16,276 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:16,779 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4116.953105 2021-02-19 03:42:17,068 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:17,082 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:17,349 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5579.019960 2021-02-19 03:42:17,470 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4358.453389 2021-02-19 03:42:17,540 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4984.533582 2021-02-19 03:42:17,691 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4838.034124 2021-02-19 03:42:17,835 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4309.654063 2021-02-19 03:42:17,897 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4783.341368 2021-02-19 03:42:17,921 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:18,397 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4116.953105 2021-02-19 03:42:18,687 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:18,713 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:18,992 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5579.019960 2021-02-19 03:42:19,101 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4358.453389 2021-02-19 03:42:19,168 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4984.533582 2021-02-19 03:42:19,301 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4838.034124 2021-02-19 03:42:19,459 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4309.654063 2021-02-19 03:42:19,529 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4783.341368 2021-02-19 03:42:19,545 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:20,032 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4091.961799 2021-02-19 03:42:20,290 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:20,322 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:20,641 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5560.927419 2021-02-19 03:42:20,727 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4327.082214 2021-02-19 03:42:20,796 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5044.211766 2021-02-19 03:42:20,911 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4840.899448 2021-02-19 03:42:21,111 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4268.928468 2021-02-19 03:42:21,151 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4769.450508 2021-02-19 03:42:21,165 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:21,642 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4091.961799 2021-02-19 03:42:21,913 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:21,960 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:22,273 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5561.276269 2021-02-19 03:42:22,348 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4322.141513 2021-02-19 03:42:22,414 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5115.810934 2021-02-19 03:42:22,543 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4873.139356 2021-02-19 03:42:22,733 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4241.863111 2021-02-19 03:42:22,779 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4760.848706 2021-02-19 03:42:22,782 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:23,243 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4042.023136 2021-02-19 03:42:23,561 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:23,615 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:23,895 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5561.276269 2021-02-19 03:42:23,967 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4322.141513 2021-02-19 03:42:24,039 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5115.810934 2021-02-19 03:42:24,194 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4873.139356 2021-02-19 03:42:24,358 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4241.863111 2021-02-19 03:42:24,423 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:24,426 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4760.848706 2021-02-19 03:42:24,867 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4042.023136 2021-02-19 03:42:25,209 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:25,275 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:25,526 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5561.276269 2021-02-19 03:42:25,599 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4357.141513 2021-02-19 03:42:25,674 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5207.810934 2021-02-19 03:42:25,815 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4931.439356 2021-02-19 03:42:25,989 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4256.363111 2021-02-19 03:42:26,056 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:26,071 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4750.848706 2021-02-19 03:42:26,497 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4027.923136 2021-02-19 03:42:26,858 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:26,888 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:27,150 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5491.576269 2021-02-19 03:42:27,256 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4357.141513 2021-02-19 03:42:27,301 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5207.810934 2021-02-19 03:42:27,451 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4931.439356 2021-02-19 03:42:27,645 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4256.363111 2021-02-19 03:42:27,687 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:27,707 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4750.848706 2021-02-19 03:42:28,105 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4027.923136 2021-02-19 03:42:28,473 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:28,529 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:28,773 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5491.576269 2021-02-19 03:42:28,897 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4357.141513 2021-02-19 03:42:28,931 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5207.810934 2021-02-19 03:42:29,101 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4931.439356 2021-02-19 03:42:29,292 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4256.363111 2021-02-19 03:42:29,315 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:29,351 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4750.848706 2021-02-19 03:42:29,742 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4004.175235 2021-02-19 03:42:30,084 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:30,144 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:30,427 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5440.491019 2021-02-19 03:42:30,526 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4393.373286 2021-02-19 03:42:30,569 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5225.953061 2021-02-19 03:42:30,739 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4929.112950 2021-02-19 03:42:30,928 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4290.512639 2021-02-19 03:42:30,957 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:30,986 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4745.636852 2021-02-19 03:42:31,357 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4004.175235 2021-02-19 03:42:31,720 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:31,776 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:32,072 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5440.491019 2021-02-19 03:42:32,150 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4393.373286 2021-02-19 03:42:32,224 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5225.953061 2021-02-19 03:42:32,381 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4910.784936 2021-02-19 03:42:32,575 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4305.902083 2021-02-19 03:42:32,592 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:32,627 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4740.339904 2021-02-19 03:42:32,973 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4019.607051 2021-02-19 03:42:33,365 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:33,388 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:33,730 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5400.666506 2021-02-19 03:42:33,780 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4389.844872 2021-02-19 03:42:33,891 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5215.385577 2021-02-19 03:42:34,016 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4910.784936 2021-02-19 03:42:34,220 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:34,239 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4305.902083 2021-02-19 03:42:34,276 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4740.339904 2021-02-19 03:42:34,604 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4019.607051 2021-02-19 03:42:35,003 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:35,013 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:35,359 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5400.666506 2021-02-19 03:42:35,417 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4389.844872 2021-02-19 03:42:35,549 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5215.385577 2021-02-19 03:42:35,667 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4872.784936 2021-02-19 03:42:35,842 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:35,880 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4293.102083 2021-02-19 03:42:35,923 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4786.039904 2021-02-19 03:42:36,233 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4020.607051 2021-02-19 03:42:36,641 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:36,664 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:36,983 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5406.866506 2021-02-19 03:42:37,071 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4337.844872 2021-02-19 03:42:37,234 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5146.685577 2021-02-19 03:42:37,309 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4872.784936 2021-02-19 03:42:37,470 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:37,509 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4293.102083 2021-02-19 03:42:37,546 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4786.039904 2021-02-19 03:42:37,864 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4020.607051 2021-02-19 03:42:38,253 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:38,266 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:38,611 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5406.866506 2021-02-19 03:42:38,687 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4337.844872 2021-02-19 03:42:38,867 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5146.685577 2021-02-19 03:42:38,956 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4872.784936 2021-02-19 03:42:39,104 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:39,141 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4293.102083 2021-02-19 03:42:39,173 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4786.039904 2021-02-19 03:42:39,506 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4020.607051 2021-02-19 03:42:39,890 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:39,917 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:40,249 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5441.946707 2021-02-19 03:42:40,357 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4337.844872 2021-02-19 03:42:40,533 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5089.931537 2021-02-19 03:42:40,586 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4874.565269 2021-02-19 03:42:40,755 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:40,776 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4273.761078 2021-02-19 03:42:40,809 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4832.432335 2021-02-19 03:42:41,125 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4066.175050 2021-02-19 03:42:41,516 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:41,552 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:41,871 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5441.946707 2021-02-19 03:42:42,000 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4278.387824 2021-02-19 03:42:42,187 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5089.931537 2021-02-19 03:42:42,220 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4874.565269 2021-02-19 03:42:42,368 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:42,404 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4273.461078 2021-02-19 03:42:42,457 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4872.632335 2021-02-19 03:42:42,747 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4068.875050 2021-02-19 03:42:43,151 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:43,170 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:43,512 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5460.546707 2021-02-19 03:42:43,621 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4242.887824 2021-02-19 03:42:43,822 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5065.131537 2021-02-19 03:42:43,851 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4845.865269 2021-02-19 03:42:43,996 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:44,039 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4273.461078 2021-02-19 03:42:44,084 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4872.632335 2021-02-19 03:42:44,369 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4068.875050 2021-02-19 03:42:44,793 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:44,809 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:45,132 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5460.546707 2021-02-19 03:42:45,243 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4242.887824 2021-02-19 03:42:45,443 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5065.131537 2021-02-19 03:42:45,482 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4845.865269 2021-02-19 03:42:45,635 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:45,667 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4291.899335 2021-02-19 03:42:45,707 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4881.960738 2021-02-19 03:42:45,992 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4061.568294 2021-02-19 03:42:46,403 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:46,463 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:46,786 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5512.032155 2021-02-19 03:42:46,878 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4243.835856 2021-02-19 03:42:47,098 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5104.099376 2021-02-19 03:42:47,124 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4836.299309 2021-02-19 03:42:47,285 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:47,305 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4291.899335 2021-02-19 03:42:47,344 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4881.960738 2021-02-19 03:42:47,640 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4061.568294 2021-02-19 03:42:48,017 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:48,094 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:48,404 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5512.032155 2021-02-19 03:42:48,536 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4243.835856 2021-02-19 03:42:48,756 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5104.099376 2021-02-19 03:42:48,785 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4836.299309 2021-02-19 03:42:48,924 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:48,948 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4291.899335 2021-02-19 03:42:48,983 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4881.960738 2021-02-19 03:42:49,266 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4061.568294 2021-02-19 03:42:49,625 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:49,700 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:50,032 | infra | INFO | pool-2-thread-25 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' completed 2021-02-19 03:42:50,032 | infra | INFO | pool-2-thread-25 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:42:50,052 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5533.381441 2021-02-19 03:42:50,174 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4278.028592 2021-02-19 03:42:50,408 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4849.194561 2021-02-19 03:42:50,430 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5138.805715 2021-02-19 03:42:50,581 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:50,615 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4313.520421 2021-02-19 03:42:50,628 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4861.655457 2021-02-19 03:42:50,895 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4055.506070 2021-02-19 03:42:51,257 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:51,322 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:51,677 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5533.381441 2021-02-19 03:42:51,809 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4278.028592 2021-02-19 03:42:52,062 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4849.194561 2021-02-19 03:42:52,069 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5138.805715 2021-02-19 03:42:52,246 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:52,253 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4313.520421 2021-02-19 03:42:52,269 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4861.655457 2021-02-19 03:42:52,499 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4069.406070 2021-02-19 03:42:52,877 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:52,947 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:53,319 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5550.081441 2021-02-19 03:42:53,431 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4303.828592 2021-02-19 03:42:53,696 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4869.594561 2021-02-19 03:42:53,720 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5166.205715 2021-02-19 03:42:53,882 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:53,914 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4310.420421 2021-02-19 03:42:53,924 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4828.255457 2021-02-19 03:42:54,134 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4069.406070 2021-02-19 03:42:54,499 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:54,575 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:54,944 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5550.081441 2021-02-19 03:42:55,061 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4303.828592 2021-02-19 03:42:55,338 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4869.594561 2021-02-19 03:42:55,348 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5166.205715 2021-02-19 03:42:55,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:55,549 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4828.255457 2021-02-19 03:42:55,572 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4310.420421 2021-02-19 03:42:55,767 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4093.865205 2021-02-19 03:42:56,127 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:56,210 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:56,559 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5524.863045 2021-02-19 03:42:56,684 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4324.704232 2021-02-19 03:42:56,990 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4900.304264 2021-02-19 03:42:57,022 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5164.950271 2021-02-19 03:42:57,187 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4809.886670 2021-02-19 03:42:57,193 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:57,220 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4306.309313 2021-02-19 03:42:57,385 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4093.865205 2021-02-19 03:42:57,750 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:57,819 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:58,171 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5524.863045 2021-02-19 03:42:58,305 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4324.704232 2021-02-19 03:42:58,621 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4900.304264 2021-02-19 03:42:58,648 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5164.950271 2021-02-19 03:42:58,834 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4809.886670 2021-02-19 03:42:58,841 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:42:58,874 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4306.309313 2021-02-19 03:42:59,022 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4093.865205 2021-02-19 03:42:59,371 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:42:59,436 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:42:59,798 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5518.167053 2021-02-19 03:42:59,986 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4317.923671 2021-02-19 03:43:00,250 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4947.843743 2021-02-19 03:43:00,296 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5169.312395 2021-02-19 03:43:00,473 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4790.859616 2021-02-19 03:43:00,492 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:43:00,515 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4284.827149 2021-02-19 03:43:00,648 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4077.252379 2021-02-19 03:43:00,976 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:01,028 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:43:01,405 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5518.167053 2021-02-19 03:43:01,609 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4317.923671 2021-02-19 03:43:01,898 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4947.843743 2021-02-19 03:43:01,959 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5169.312395 2021-02-19 03:43:02,105 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:43:02,157 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4790.859616 2021-02-19 03:43:02,203 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4284.827149 2021-02-19 03:43:02,278 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4039.552379 2021-02-19 03:43:02,579 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:02,637 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:43:03,012 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5530.967053 2021-02-19 03:43:03,223 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4333.823671 2021-02-19 03:43:03,512 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4974.443743 2021-02-19 03:43:03,625 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5169.412395 2021-02-19 03:43:03,799 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4782.759616 2021-02-19 03:43:03,799 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:43:03,848 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4298.027149 2021-02-19 03:43:03,908 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4039.552379 2021-02-19 03:43:04,213 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:04,263 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:43:04,644 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5530.967053 2021-02-19 03:43:04,844 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4333.823671 2021-02-19 03:43:05,122 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4974.443743 2021-02-19 03:43:05,243 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5169.412395 2021-02-19 03:43:05,438 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4782.759616 2021-02-19 03:43:05,444 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:43:05,473 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4298.027149 2021-02-19 03:43:05,542 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4039.552379 2021-02-19 03:43:05,835 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:05,884 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:43:06,249 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5550.396257 2021-02-19 03:43:06,461 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4365.030421 2021-02-19 03:43:06,743 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4986.456860 2021-02-19 03:43:06,907 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5196.822496 2021-02-19 03:43:07,066 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4785.822816 2021-02-19 03:43:07,104 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:43:07,137 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4336.329301 2021-02-19 03:43:07,174 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3992.025068 2021-02-19 03:43:07,451 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:07,503 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:43:07,864 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5550.396257 2021-02-19 03:43:08,122 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4365.030421 2021-02-19 03:43:08,351 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4986.456860 2021-02-19 03:43:08,530 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5196.822496 2021-02-19 03:43:08,707 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4785.822816 2021-02-19 03:43:08,736 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:43:08,796 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4336.329301 2021-02-19 03:43:08,812 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3992.025068 2021-02-19 03:43:09,094 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:09,130 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:43:09,470 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5550.396257 2021-02-19 03:43:09,729 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4412.230421 2021-02-19 03:43:09,964 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4973.256860 2021-02-19 03:43:10,194 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5249.822496 2021-02-19 03:43:10,348 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4785.822816 2021-02-19 03:43:10,380 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:43:10,454 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4387.429301 2021-02-19 03:43:10,473 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3982.225068 2021-02-19 03:43:10,733 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:10,746 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:43:11,089 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5545.496257 2021-02-19 03:43:11,348 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4412.230421 2021-02-19 03:43:11,596 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4973.256860 2021-02-19 03:43:11,816 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5249.822496 2021-02-19 03:43:11,996 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4801.422816 2021-02-19 03:43:12,005 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:43:12,095 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4387.429301 2021-02-19 03:43:12,128 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3982.225068 2021-02-19 03:43:12,348 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:12,369 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:43:12,710 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5514.196257 2021-02-19 03:43:12,957 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4409.230421 2021-02-19 03:43:13,210 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4975.856860 2021-02-19 03:43:13,440 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5287.122496 2021-02-19 03:43:13,648 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4832.422816 2021-02-19 03:43:13,674 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:43:13,772 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4399.929301 2021-02-19 03:43:13,782 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3993.025068 2021-02-19 03:43:13,973 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:13,997 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:43:14,329 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5514.196257 2021-02-19 03:43:14,573 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4409.230421 2021-02-19 03:43:14,763 | infra | INFO | pool-2-thread-12 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.23' completed 2021-02-19 03:43:14,763 | infra | INFO | pool-2-thread-12 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:43:14,763 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 29 docs from 0 to 1000000 2021-02-19 03:43:14,835 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4975.856860 2021-02-19 03:43:15,053 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5287.122496 2021-02-19 03:43:15,288 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4832.422816 2021-02-19 03:43:15,309 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:43:15,415 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4399.929301 2021-02-19 03:43:15,456 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3993.025068 2021-02-19 03:43:15,621 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:15,634 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:43:15,953 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5479.145024 2021-02-19 03:43:16,181 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4382.633630 2021-02-19 03:43:16,473 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4949.487886 2021-02-19 03:43:16,667 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5267.418015 2021-02-19 03:43:16,921 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4808.173932 2021-02-19 03:43:16,963 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:43:17,085 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4020.104581 2021-02-19 03:43:17,089 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4360.329249 2021-02-19 03:43:17,247 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:17,267 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:43:17,559 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5479.145024 2021-02-19 03:43:17,801 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4382.633630 2021-02-19 03:43:17,947 | infra | INFO | pool-2-thread-53 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.35' completed 2021-02-19 03:43:17,947 | infra | INFO | pool-2-thread-53 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:43:18,098 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4949.487886 2021-02-19 03:43:18,328 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5267.418015 2021-02-19 03:43:18,595 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4808.173932 2021-02-19 03:43:18,624 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:43:18,740 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4020.104581 2021-02-19 03:43:18,750 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4360.329249 2021-02-19 03:43:18,901 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:43:18,926 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:19,168 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5479.145024 2021-02-19 03:43:19,430 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4382.633630 2021-02-19 03:43:19,727 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4853.087886 2021-02-19 03:43:19,967 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5153.718015 2021-02-19 03:43:20,085 | infra | INFO | pool-2-thread-34 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.32' completed 2021-02-19 03:43:20,086 | infra | INFO | pool-2-thread-34 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' started 2021-02-19 03:43:20,243 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4775.273932 2021-02-19 03:43:20,259 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:43:20,377 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4360.329249 2021-02-19 03:43:20,424 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4026.404581 2021-02-19 03:43:20,515 | infra | INFO | pool-2-thread-14 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.24' completed 2021-02-19 03:43:20,515 | infra | INFO | pool-2-thread-14 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:43:20,572 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:20,614 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 375.100000 2021-02-19 03:43:20,642 | infra | INFO | pool-2-thread-37 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.33' completed 2021-02-19 03:43:20,642 | infra | INFO | pool-2-thread-37 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:43:20,793 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5442.345024 2021-02-19 03:43:21,055 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4304.133630 2021-02-19 03:43:21,410 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4853.087886 2021-02-19 03:43:21,594 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5153.718015 2021-02-19 03:43:21,881 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:43:21,885 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4775.273932 2021-02-19 03:43:22,079 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4305.129249 2021-02-19 03:43:22,132 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4026.404581 2021-02-19 03:43:22,216 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:22,312 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 375.100000 2021-02-19 03:43:22,420 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5404.245024 2021-02-19 03:43:22,710 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4238.333630 2021-02-19 03:43:23,017 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4708.087886 2021-02-19 03:43:23,233 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5015.518015 2021-02-19 03:43:23,503 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:43:23,569 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4690.273932 2021-02-19 03:43:23,740 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4264.329249 2021-02-19 03:43:23,779 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3970.504581 2021-02-19 03:43:23,851 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:23,951 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1182.500000 2021-02-19 03:43:24,066 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5404.245024 2021-02-19 03:43:24,336 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4238.333630 2021-02-19 03:43:24,654 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4708.087886 2021-02-19 03:43:24,884 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5015.518015 2021-02-19 03:43:25,176 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:43:25,236 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4690.273932 2021-02-19 03:43:25,382 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4264.329249 2021-02-19 03:43:25,437 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3970.504581 2021-02-19 03:43:25,493 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:25,637 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1182.500000 2021-02-19 03:43:25,756 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5515.700000 2021-02-19 03:43:25,984 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4103.800000 2021-02-19 03:43:26,278 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4486.400000 2021-02-19 03:43:26,516 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4849.000000 2021-02-19 03:43:26,811 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 313.200000 2021-02-19 03:43:26,867 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4538.400000 2021-02-19 03:43:27,023 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4169.000000 2021-02-19 03:43:27,085 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3810.800000 2021-02-19 03:43:27,128 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:27,299 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2615.900000 2021-02-19 03:43:27,388 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5515.700000 2021-02-19 03:43:27,628 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4103.800000 2021-02-19 03:43:27,911 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4486.400000 2021-02-19 03:43:28,127 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4849.000000 2021-02-19 03:43:28,489 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 313.200000 2021-02-19 03:43:28,532 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4538.400000 2021-02-19 03:43:28,681 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4169.000000 2021-02-19 03:43:28,737 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3810.800000 2021-02-19 03:43:28,790 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:28,947 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2615.900000 2021-02-19 03:43:29,029 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5515.700000 2021-02-19 03:43:29,256 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4103.800000 2021-02-19 03:43:29,581 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4486.400000 2021-02-19 03:43:29,782 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4679.400000 2021-02-19 03:43:30,151 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1163.000000 2021-02-19 03:43:30,187 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4254.700000 2021-02-19 03:43:30,328 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4000.900000 2021-02-19 03:43:30,391 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3810.800000 2021-02-19 03:43:30,430 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:30,586 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4326.400000 2021-02-19 03:43:30,690 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5930.100000 2021-02-19 03:43:30,888 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3948.600000 2021-02-19 03:43:31,250 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4233.900000 2021-02-19 03:43:31,440 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4679.400000 2021-02-19 03:43:31,822 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4254.700000 2021-02-19 03:43:31,825 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1163.000000 2021-02-19 03:43:32,016 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4000.900000 2021-02-19 03:43:32,068 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3588.500000 2021-02-19 03:43:32,088 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:32,207 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4326.400000 2021-02-19 03:43:32,341 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6524.500000 2021-02-19 03:43:32,526 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3737.200000 2021-02-19 03:43:32,898 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4005.500000 2021-02-19 03:43:33,063 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4480.600000 2021-02-19 03:43:33,473 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3985.700000 2021-02-19 03:43:33,492 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2334.600000 2021-02-19 03:43:33,693 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3745.200000 2021-02-19 03:43:33,756 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3395.900000 2021-02-19 03:43:33,772 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:33,851 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5795.300000 2021-02-19 03:43:33,963 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6524.500000 2021-02-19 03:43:34,184 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3737.200000 2021-02-19 03:43:34,609 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4005.500000 2021-02-19 03:43:34,719 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4480.600000 2021-02-19 03:43:35,127 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2334.600000 2021-02-19 03:43:35,141 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3985.700000 2021-02-19 03:43:35,351 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3745.200000 2021-02-19 03:43:35,460 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:35,474 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3395.900000 2021-02-19 03:43:35,535 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5795.300000 2021-02-19 03:43:35,677 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6524.500000 2021-02-19 03:43:35,822 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3594.200000 2021-02-19 03:43:36,267 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3881.500000 2021-02-19 03:43:36,390 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4323.600000 2021-02-19 03:43:36,743 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3184.000000 2021-02-19 03:43:36,775 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3825.000000 2021-02-19 03:43:37,032 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3546.500000 2021-02-19 03:43:37,131 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:37,155 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3299.900000 2021-02-19 03:43:37,210 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6607.800000 2021-02-19 03:43:37,344 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6939.900000 2021-02-19 03:43:37,457 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3594.200000 2021-02-19 03:43:37,901 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3881.500000 2021-02-19 03:43:38,029 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4323.600000 2021-02-19 03:43:38,375 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3184.000000 2021-02-19 03:43:38,410 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3825.000000 2021-02-19 03:43:38,673 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3546.500000 2021-02-19 03:43:38,776 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:38,792 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3299.900000 2021-02-19 03:43:38,848 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6607.800000 2021-02-19 03:43:38,967 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6939.900000 2021-02-19 03:43:39,088 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3594.200000 2021-02-19 03:43:39,546 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3881.500000 2021-02-19 03:43:39,684 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4203.000000 2021-02-19 03:43:40,082 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3473.200000 2021-02-19 03:43:40,105 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3779.700000 2021-02-19 03:43:40,319 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3413.400000 2021-02-19 03:43:40,453 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:40,466 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3289.500000 2021-02-19 03:43:40,509 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6725.200000 2021-02-19 03:43:40,618 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7059.400000 2021-02-19 03:43:40,720 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3483.000000 2021-02-19 03:43:41,187 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3826.900000 2021-02-19 03:43:41,352 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4203.000000 2021-02-19 03:43:41,750 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3473.200000 2021-02-19 03:43:41,753 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3779.700000 2021-02-19 03:43:41,989 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3413.400000 2021-02-19 03:43:42,088 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:42,140 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3289.500000 2021-02-19 03:43:42,167 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6725.200000 2021-02-19 03:43:42,302 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7059.400000 2021-02-19 03:43:42,348 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3466.800000 2021-02-19 03:43:42,832 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3791.000000 2021-02-19 03:43:43,003 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4148.800000 2021-02-19 03:43:43,398 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3452.600000 2021-02-19 03:43:43,407 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3778.600000 2021-02-19 03:43:43,647 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3386.900000 2021-02-19 03:43:43,734 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:43,790 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3286.800000 2021-02-19 03:43:43,828 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6686.500000 2021-02-19 03:43:43,956 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7039.300000 2021-02-19 03:43:43,997 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3466.800000 2021-02-19 03:43:44,482 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3791.000000 2021-02-19 03:43:44,653 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4148.800000 2021-02-19 03:43:45,049 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3452.600000 2021-02-19 03:43:45,062 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3778.600000 2021-02-19 03:43:45,282 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3386.900000 2021-02-19 03:43:45,441 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:45,474 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3286.800000 2021-02-19 03:43:45,486 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6686.500000 2021-02-19 03:43:45,607 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7039.300000 2021-02-19 03:43:45,648 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3459.600000 2021-02-19 03:43:46,118 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3761.500000 2021-02-19 03:43:46,270 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4132.200000 2021-02-19 03:43:46,694 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3455.600000 2021-02-19 03:43:46,697 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3768.600000 2021-02-19 03:43:46,928 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3401.100000 2021-02-19 03:43:47,096 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:47,111 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6704.600000 2021-02-19 03:43:47,128 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3302.500000 2021-02-19 03:43:47,243 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7090.600000 2021-02-19 03:43:47,305 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3459.600000 2021-02-19 03:43:47,760 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3761.500000 2021-02-19 03:43:47,890 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4132.200000 2021-02-19 03:43:48,345 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3768.600000 2021-02-19 03:43:48,364 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3455.600000 2021-02-19 03:43:48,562 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3401.100000 2021-02-19 03:43:48,789 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:48,792 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6704.600000 2021-02-19 03:43:48,838 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3302.500000 2021-02-19 03:43:48,921 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7090.600000 2021-02-19 03:43:48,961 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3459.600000 2021-02-19 03:43:49,400 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3761.500000 2021-02-19 03:43:49,517 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4132.200000 2021-02-19 03:43:49,967 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3752.700000 2021-02-19 03:43:50,012 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3461.900000 2021-02-19 03:43:50,200 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3424.600000 2021-02-19 03:43:50,450 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:50,483 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6723.400000 2021-02-19 03:43:50,506 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3297.400000 2021-02-19 03:43:50,559 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7124.000000 2021-02-19 03:43:50,644 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3470.500000 2021-02-19 03:43:51,036 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3740.900000 2021-02-19 03:43:51,151 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4130.800000 2021-02-19 03:43:51,714 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3752.700000 2021-02-19 03:43:51,747 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3461.900000 2021-02-19 03:43:51,858 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3424.600000 2021-02-19 03:43:52,125 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6723.400000 2021-02-19 03:43:52,141 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:52,209 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3297.400000 2021-02-19 03:43:52,243 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7124.000000 2021-02-19 03:43:52,309 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3445.000000 2021-02-19 03:43:52,658 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3725.100000 2021-02-19 03:43:52,796 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4138.500000 2021-02-19 03:43:53,387 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3438.100000 2021-02-19 03:43:53,390 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3725.700000 2021-02-19 03:43:53,492 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3415.600000 2021-02-19 03:43:53,763 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6667.600000 2021-02-19 03:43:53,801 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:53,868 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3334.900000 2021-02-19 03:43:53,897 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7093.800000 2021-02-19 03:43:53,954 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3445.000000 2021-02-19 03:43:54,286 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3725.100000 2021-02-19 03:43:54,447 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4138.500000 2021-02-19 03:43:55,042 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3725.700000 2021-02-19 03:43:55,046 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3438.100000 2021-02-19 03:43:55,138 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3415.600000 2021-02-19 03:43:55,431 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6667.600000 2021-02-19 03:43:55,463 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:55,510 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3334.900000 2021-02-19 03:43:55,562 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7093.800000 2021-02-19 03:43:55,589 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3445.000000 2021-02-19 03:43:55,914 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3696.200000 2021-02-19 03:43:56,088 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4109.800000 2021-02-19 03:43:56,693 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3721.200000 2021-02-19 03:43:56,694 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3388.200000 2021-02-19 03:43:56,769 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3382.100000 2021-02-19 03:43:57,059 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6565.800000 2021-02-19 03:43:57,132 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:57,194 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7020.400000 2021-02-19 03:43:57,200 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3314.900000 2021-02-19 03:43:57,211 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3403.400000 2021-02-19 03:43:57,549 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3696.200000 2021-02-19 03:43:57,703 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4109.800000 2021-02-19 03:43:58,328 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3721.200000 2021-02-19 03:43:58,342 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3388.200000 2021-02-19 03:43:58,384 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3382.100000 2021-02-19 03:43:58,691 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6565.800000 2021-02-19 03:43:58,753 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:43:58,839 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7020.400000 2021-02-19 03:43:58,851 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3314.900000 2021-02-19 03:43:58,903 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3403.400000 2021-02-19 03:43:59,181 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3696.200000 2021-02-19 03:43:59,341 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4109.800000 2021-02-19 03:43:59,967 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3727.600000 2021-02-19 03:43:59,987 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3399.900000 2021-02-19 03:44:00,032 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3405.500000 2021-02-19 03:44:00,339 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6590.300000 2021-02-19 03:44:00,403 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:00,515 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3315.500000 2021-02-19 03:44:00,538 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7020.600000 2021-02-19 03:44:00,546 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3401.500000 2021-02-19 03:44:00,812 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3703.600000 2021-02-19 03:44:00,989 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4135.000000 2021-02-19 03:44:01,617 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3727.600000 2021-02-19 03:44:01,650 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3399.900000 2021-02-19 03:44:01,677 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3405.500000 2021-02-19 03:44:01,976 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6590.300000 2021-02-19 03:44:02,033 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:02,148 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3315.500000 2021-02-19 03:44:02,196 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3401.500000 2021-02-19 03:44:02,216 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7020.600000 2021-02-19 03:44:02,486 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3736.793323 2021-02-19 03:44:02,619 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4167.934466 2021-02-19 03:44:03,279 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3735.902199 2021-02-19 03:44:03,338 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3476.620832 2021-02-19 03:44:03,338 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3474.319352 2021-02-19 03:44:03,650 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6732.670332 2021-02-19 03:44:03,732 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:03,822 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3297.056257 2021-02-19 03:44:03,868 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3455.323431 2021-02-19 03:44:03,914 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7138.919872 2021-02-19 03:44:04,138 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3736.793323 2021-02-19 03:44:04,279 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4167.934466 2021-02-19 03:44:04,930 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3735.902199 2021-02-19 03:44:04,993 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3476.620832 2021-02-19 03:44:05,013 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3474.319352 2021-02-19 03:44:05,278 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6732.670332 2021-02-19 03:44:05,390 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:05,447 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3297.056257 2021-02-19 03:44:05,509 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3455.323431 2021-02-19 03:44:05,596 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7138.919872 2021-02-19 03:44:05,776 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3786.621295 2021-02-19 03:44:05,903 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4243.301199 2021-02-19 03:44:06,569 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3682.802599 2021-02-19 03:44:06,644 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3566.813139 2021-02-19 03:44:06,658 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3578.199772 2021-02-19 03:44:06,937 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6925.515287 2021-02-19 03:44:07,052 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:07,104 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3332.432281 2021-02-19 03:44:07,178 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3542.017636 2021-02-19 03:44:07,232 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7271.565726 2021-02-19 03:44:07,413 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3786.621295 2021-02-19 03:44:07,535 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4243.301199 2021-02-19 03:44:08,220 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3682.802599 2021-02-19 03:44:08,332 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3566.813139 2021-02-19 03:44:08,349 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3578.199772 2021-02-19 03:44:08,586 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6925.515287 2021-02-19 03:44:08,760 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:08,765 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3332.432281 2021-02-19 03:44:08,869 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3542.017636 2021-02-19 03:44:08,907 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7271.565726 2021-02-19 03:44:09,078 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3786.621295 2021-02-19 03:44:09,177 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4243.301199 2021-02-19 03:44:09,869 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3638.602599 2021-02-19 03:44:09,980 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3563.413139 2021-02-19 03:44:09,987 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3593.399772 2021-02-19 03:44:10,256 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6969.315287 2021-02-19 03:44:10,436 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:10,438 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3305.032281 2021-02-19 03:44:10,556 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3586.217636 2021-02-19 03:44:10,569 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7295.465726 2021-02-19 03:44:10,732 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3778.321295 2021-02-19 03:44:10,798 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4262.501199 2021-02-19 03:44:11,506 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3638.602599 2021-02-19 03:44:11,641 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3593.399772 2021-02-19 03:44:11,648 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3563.413139 2021-02-19 03:44:11,881 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6969.315287 2021-02-19 03:44:12,082 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:12,099 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3305.032281 2021-02-19 03:44:12,233 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3586.217636 2021-02-19 03:44:12,237 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7295.465726 2021-02-19 03:44:12,391 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3735.817648 2021-02-19 03:44:12,444 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4249.827197 2021-02-19 03:44:13,140 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3606.385314 2021-02-19 03:44:13,290 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3502.347050 2021-02-19 03:44:13,308 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3534.837642 2021-02-19 03:44:13,519 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6912.651958 2021-02-19 03:44:13,729 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:13,755 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3293.715240 2021-02-19 03:44:13,891 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3542.253189 2021-02-19 03:44:13,898 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7194.785710 2021-02-19 03:44:14,062 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3735.817648 2021-02-19 03:44:14,108 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4249.827197 2021-02-19 03:44:14,786 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3606.385314 2021-02-19 03:44:14,966 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3502.347050 2021-02-19 03:44:14,971 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3534.837642 2021-02-19 03:44:15,161 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6912.651958 2021-02-19 03:44:15,380 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:15,401 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3293.715240 2021-02-19 03:44:15,584 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7194.785710 2021-02-19 03:44:15,586 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3542.253189 2021-02-19 03:44:15,759 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3690.234965 2021-02-19 03:44:15,763 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4185.934339 2021-02-19 03:44:16,476 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3643.632283 2021-02-19 03:44:16,630 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3436.383088 2021-02-19 03:44:16,673 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3454.285028 2021-02-19 03:44:16,816 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6794.354352 2021-02-19 03:44:17,026 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:17,052 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3265.758420 2021-02-19 03:44:17,280 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7090.009730 2021-02-19 03:44:17,282 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3485.888870 2021-02-19 03:44:17,415 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3690.234965 2021-02-19 03:44:17,454 | infra | INFO | pool-2-thread-42 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' completed 2021-02-19 03:44:17,454 | infra | INFO | pool-2-thread-42 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:44:17,464 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4185.934339 2021-02-19 03:44:18,108 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3643.632283 2021-02-19 03:44:18,270 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3436.383088 2021-02-19 03:44:18,312 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3454.285028 2021-02-19 03:44:18,451 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6794.354352 2021-02-19 03:44:18,766 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3265.758420 2021-02-19 03:44:18,786 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:18,946 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3485.888870 2021-02-19 03:44:18,960 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7090.009730 2021-02-19 03:44:19,076 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3690.234965 2021-02-19 03:44:19,105 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4185.934339 2021-02-19 03:44:19,766 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3665.332283 2021-02-19 03:44:19,920 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3397.483088 2021-02-19 03:44:19,970 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3404.585028 2021-02-19 03:44:20,118 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6715.054352 2021-02-19 03:44:20,417 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:20,440 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3319.858420 2021-02-19 03:44:20,601 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7061.109730 2021-02-19 03:44:20,628 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3431.188870 2021-02-19 03:44:20,736 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3715.934965 2021-02-19 03:44:20,776 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4120.934339 2021-02-19 03:44:21,460 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3665.332283 2021-02-19 03:44:21,589 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3397.483088 2021-02-19 03:44:21,630 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3404.585028 2021-02-19 03:44:21,792 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6715.054352 2021-02-19 03:44:22,065 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:22,092 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3319.858420 2021-02-19 03:44:22,278 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7061.109730 2021-02-19 03:44:22,289 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3431.188870 2021-02-19 03:44:22,392 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3763.245289 2021-02-19 03:44:22,423 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4104.273875 2021-02-19 03:44:23,085 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3703.547369 2021-02-19 03:44:23,257 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3069.628346 2021-02-19 03:44:23,266 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3414.527806 2021-02-19 03:44:23,450 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6701.347349 2021-02-19 03:44:23,700 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:23,713 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3362.419204 2021-02-19 03:44:23,927 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6973.169874 2021-02-19 03:44:23,934 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3443.829886 2021-02-19 03:44:24,040 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3763.245289 2021-02-19 03:44:24,089 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4104.273875 2021-02-19 03:44:24,697 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3703.547369 2021-02-19 03:44:24,923 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3069.628346 2021-02-19 03:44:24,937 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3414.527806 2021-02-19 03:44:25,085 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6701.347349 2021-02-19 03:44:25,342 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:25,421 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3362.419204 2021-02-19 03:44:25,598 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6973.169874 2021-02-19 03:44:25,619 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3443.829886 2021-02-19 03:44:25,687 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3830.134668 2021-02-19 03:44:25,723 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4166.044916 2021-02-19 03:44:26,322 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3708.393355 2021-02-19 03:44:26,575 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2394.973659 2021-02-19 03:44:26,585 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3432.025220 2021-02-19 03:44:26,716 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6749.527942 ############################################################ # # Step 5: Rebalance Out with Loading of docs # ############################################################ 2021-02-19 03:44:26,838 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[]_OUT=[172.23.110.69]_1613735066.79 2021-02-19 03:44:26,838 | infra | INFO | pool-1-thread-24 | [task:start_task:84] Thread 'Rebalance_task_IN=[]_OUT=[172.23.110.69]_1613735066.79' started 2021-02-19 03:44:26,862 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L899 2021-02-19 03:44:26,862 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 30 seconds. Reason: Let the rebalance begin! 2021-02-19 03:44:26,901 | test | DEBUG | pool-1-thread-24 | [task:start_rebalance:301] Removing node 172.23.110.69:8091 from cluster 2021-02-19 03:44:26,901 | test | DEBUG | pool-1-thread-24 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': u'ns_1@172.23.110.69', 'user': 'Administrator'} 2021-02-19 03:44:26,940 | test | DEBUG | pool-1-thread-24 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 03:44:26,940 | test | INFO | pool-1-thread-24 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+---------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 16.0137553513 | Cluster node | | 172.23.110.69 | kv | 7.0.0-4498-enterprise | 16.2638973044 | --- OUT ---> | | 172.23.110.65 | kv | 7.0.0-4498-enterprise | 15.8340936206 | Cluster node | +---------------+----------+-----------------------+---------------+--------------+ 2021-02-19 03:44:26,956 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 03:44:26,956 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 03:44:27,007 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:27,099 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3400.407206 2021-02-19 03:44:27,249 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3472.742674 2021-02-19 03:44:27,270 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6778.623859 2021-02-19 03:44:27,313 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3830.134668 2021-02-19 03:44:27,365 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4166.044916 2021-02-19 03:44:27,933 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3708.393355 2021-02-19 03:44:28,217 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3432.025220 2021-02-19 03:44:28,227 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2394.973659 2021-02-19 03:44:28,357 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6749.527942 2021-02-19 03:44:28,654 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:28,739 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3400.407206 2021-02-19 03:44:28,934 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3472.742674 2021-02-19 03:44:28,944 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6778.623859 2021-02-19 03:44:29,017 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3830.134668 2021-02-19 03:44:29,026 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4166.044916 2021-02-19 03:44:29,589 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3708.393355 2021-02-19 03:44:29,845 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3546.825220 2021-02-19 03:44:29,924 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1276.073659 2021-02-19 03:44:29,983 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6950.627942 2021-02-19 03:44:30,270 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:30,378 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3412.007206 2021-02-19 03:44:30,588 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3583.742674 2021-02-19 03:44:30,624 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6523.823859 2021-02-19 03:44:30,686 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4285.244916 2021-02-19 03:44:30,723 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3877.134668 2021-02-19 03:44:31,226 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3752.593355 2021-02-19 03:44:31,486 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3546.825220 2021-02-19 03:44:31,552 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1276.073659 2021-02-19 03:44:31,615 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6950.627942 2021-02-19 03:44:31,897 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:32,009 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3412.007206 2021-02-19 03:44:32,010 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.27 % 2021-02-19 03:44:32,012 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 0.270465703329 2021-02-19 03:44:32,233 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3583.742674 2021-02-19 03:44:32,256 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6523.823859 2021-02-19 03:44:32,377 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4412.444916 2021-02-19 03:44:32,401 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3931.334668 2021-02-19 03:44:32,848 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3762.993355 2021-02-19 03:44:33,115 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3654.725220 2021-02-19 03:44:33,191 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 467.073659 2021-02-19 03:44:33,250 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7165.327942 2021-02-19 03:44:33,503 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:33,644 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3407.007206 2021-02-19 03:44:33,884 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3707.242674 2021-02-19 03:44:33,901 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6432.423859 2021-02-19 03:44:34,042 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4412.444916 2021-02-19 03:44:34,069 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3931.334668 2021-02-19 03:44:34,454 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3762.993355 2021-02-19 03:44:34,753 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3654.725220 2021-02-19 03:44:34,826 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 467.073659 2021-02-19 03:44:34,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7165.327942 2021-02-19 03:44:35,132 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:35,275 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3407.007206 2021-02-19 03:44:35,552 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3707.242674 2021-02-19 03:44:35,555 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6432.423859 2021-02-19 03:44:35,707 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4412.444916 2021-02-19 03:44:35,746 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3958.000000 2021-02-19 03:44:36,072 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3785.700000 2021-02-19 03:44:36,394 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3760.500000 2021-02-19 03:44:36,463 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:44:36,536 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7347.900000 2021-02-19 03:44:36,740 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:36,898 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3401.600000 2021-02-19 03:44:37,066 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.62 % 2021-02-19 03:44:37,066 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 0.615855317605 2021-02-19 03:44:37,188 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3811.700000 2021-02-19 03:44:37,200 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6462.700000 2021-02-19 03:44:37,336 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4481.600000 2021-02-19 03:44:37,388 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3958.000000 2021-02-19 03:44:37,687 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3785.700000 2021-02-19 03:44:38,045 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3760.500000 2021-02-19 03:44:38,101 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:44:38,157 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7347.900000 2021-02-19 03:44:38,390 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:38,516 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3401.600000 2021-02-19 03:44:38,849 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3811.700000 2021-02-19 03:44:38,852 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6462.700000 2021-02-19 03:44:38,976 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4481.600000 2021-02-19 03:44:39,049 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3958.000000 2021-02-19 03:44:39,312 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3785.700000 2021-02-19 03:44:39,713 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3760.500000 2021-02-19 03:44:39,779 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:44:39,815 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7455.700000 2021-02-19 03:44:40,072 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:40,190 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3432.600000 2021-02-19 03:44:40,506 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6495.300000 2021-02-19 03:44:40,526 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3874.700000 2021-02-19 03:44:40,622 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4481.600000 2021-02-19 03:44:40,684 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3984.100000 2021-02-19 03:44:40,956 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3816.200000 2021-02-19 03:44:41,345 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3796.800000 2021-02-19 03:44:41,423 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:44:41,433 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7455.700000 2021-02-19 03:44:41,730 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:41,848 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3432.600000 2021-02-19 03:44:42,118 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.94 % 2021-02-19 03:44:42,118 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 0.944946603606 2021-02-19 03:44:42,148 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6495.300000 2021-02-19 03:44:42,177 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3874.700000 2021-02-19 03:44:42,263 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4481.600000 2021-02-19 03:44:42,319 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3978.900000 2021-02-19 03:44:42,578 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3887.100000 2021-02-19 03:44:42,953 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3821.700000 2021-02-19 03:44:43,071 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:44:43,079 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7521.800000 2021-02-19 03:44:43,339 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:43,467 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3446.000000 2021-02-19 03:44:43,767 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6469.500000 2021-02-19 03:44:43,812 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3896.100000 2021-02-19 03:44:43,917 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4453.700000 2021-02-19 03:44:43,982 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3978.900000 2021-02-19 03:44:44,211 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3887.100000 2021-02-19 03:44:44,644 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3821.700000 2021-02-19 03:44:44,717 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7521.800000 2021-02-19 03:44:44,763 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:44:44,974 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:45,104 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3446.000000 2021-02-19 03:44:45,411 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6469.500000 2021-02-19 03:44:45,450 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3896.100000 2021-02-19 03:44:45,551 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4453.700000 2021-02-19 03:44:45,619 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3978.900000 2021-02-19 03:44:45,864 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3966.100000 2021-02-19 03:44:46,275 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3849.900000 2021-02-19 03:44:46,355 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7579.400000 2021-02-19 03:44:46,400 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:44:46,595 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:46,717 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3447.500000 2021-02-19 03:44:47,033 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6440.500000 2021-02-19 03:44:47,072 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3922.700000 2021-02-19 03:44:47,158 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 1.29 % 2021-02-19 03:44:47,158 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 1.29033621788 2021-02-19 03:44:47,196 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4403.300000 2021-02-19 03:44:47,249 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3982.000000 2021-02-19 03:44:47,476 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3966.100000 2021-02-19 03:44:47,927 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3849.900000 2021-02-19 03:44:47,996 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7579.400000 2021-02-19 03:44:48,051 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:44:48,207 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:48,348 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3447.500000 2021-02-19 03:44:48,677 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6440.500000 2021-02-19 03:44:48,713 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3922.700000 2021-02-19 03:44:48,839 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4403.300000 2021-02-19 03:44:48,901 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3982.000000 2021-02-19 03:44:49,121 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3966.100000 2021-02-19 03:44:49,582 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3849.900000 2021-02-19 03:44:49,660 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7579.400000 2021-02-19 03:44:49,723 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:44:49,828 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:49,974 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3384.100000 2021-02-19 03:44:50,338 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6438.700000 2021-02-19 03:44:50,346 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3917.400000 2021-02-19 03:44:50,476 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4400.300000 2021-02-19 03:44:50,530 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3947.800000 2021-02-19 03:44:50,757 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4022.700000 2021-02-19 03:44:51,209 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3863.800000 2021-02-19 03:44:51,318 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7577.900000 2021-02-19 03:44:51,369 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:44:51,460 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:51,611 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3384.100000 2021-02-19 03:44:51,977 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6438.700000 2021-02-19 03:44:51,992 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3917.400000 2021-02-19 03:44:52,118 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4400.300000 2021-02-19 03:44:52,167 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3947.800000 2021-02-19 03:44:52,226 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 1.64 % 2021-02-19 03:44:52,226 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 1.63572583216 2021-02-19 03:44:52,384 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4033.200000 2021-02-19 03:44:52,852 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3826.000000 2021-02-19 03:44:52,959 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7475.500000 2021-02-19 03:44:52,993 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:44:53,075 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:53,270 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3334.800000 2021-02-19 03:44:53,592 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6433.600000 2021-02-19 03:44:53,615 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3876.100000 2021-02-19 03:44:53,762 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4367.800000 2021-02-19 03:44:53,796 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3954.300000 2021-02-19 03:44:54,029 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4033.200000 2021-02-19 03:44:54,476 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3826.000000 2021-02-19 03:44:54,618 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7475.500000 2021-02-19 03:44:54,683 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:44:54,723 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:54,900 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3334.800000 2021-02-19 03:44:55,259 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6433.600000 2021-02-19 03:44:55,272 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3876.100000 2021-02-19 03:44:55,426 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4367.800000 2021-02-19 03:44:55,437 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3954.300000 2021-02-19 03:44:55,677 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4033.200000 2021-02-19 03:44:56,118 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3766.400000 2021-02-19 03:44:56,265 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7412.400000 2021-02-19 03:44:56,341 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:44:56,365 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:56,565 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3322.700000 2021-02-19 03:44:56,934 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 1.98 % 2021-02-19 03:44:56,940 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3815.500000 2021-02-19 03:44:56,950 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6387.200000 2021-02-19 03:44:56,951 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:44:56,951 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:44:57,088 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3946.000000 2021-02-19 03:44:57,088 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4395.700000 2021-02-19 03:44:57,279 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 2.01 % 2021-02-19 03:44:57,279 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 2.00718259418 2021-02-19 03:44:57,305 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4008.800000 2021-02-19 03:44:57,765 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3766.400000 2021-02-19 03:44:57,923 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7412.400000 2021-02-19 03:44:57,983 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:44:58,010 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:58,190 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3322.700000 2021-02-19 03:44:58,585 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6387.200000 2021-02-19 03:44:58,609 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3815.500000 2021-02-19 03:44:58,740 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4395.700000 2021-02-19 03:44:58,776 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3946.000000 2021-02-19 03:44:58,951 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4008.800000 2021-02-19 03:44:59,407 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3683.800000 2021-02-19 03:44:59,565 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7412.400000 2021-02-19 03:44:59,634 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:44:59,644 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:44:59,848 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3371.300000 2021-02-19 03:45:00,244 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6360.000000 2021-02-19 03:45:00,250 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3732.700000 2021-02-19 03:45:00,381 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4390.300000 2021-02-19 03:45:00,428 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3919.100000 2021-02-19 03:45:00,579 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3949.400000 2021-02-19 03:45:01,036 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3683.800000 2021-02-19 03:45:01,203 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7310.600000 2021-02-19 03:45:01,265 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:01,279 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:01,496 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3371.300000 2021-02-19 03:45:01,891 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6360.000000 2021-02-19 03:45:01,910 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3732.700000 2021-02-19 03:45:02,019 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4390.300000 2021-02-19 03:45:02,058 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3919.100000 2021-02-19 03:45:02,233 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3949.400000 2021-02-19 03:45:02,331 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 2.36 % 2021-02-19 03:45:02,331 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 2.36235376847 2021-02-19 03:45:02,680 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3660.400000 2021-02-19 03:45:02,884 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7342.200000 2021-02-19 03:45:02,903 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:02,921 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:03,141 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3393.100000 2021-02-19 03:45:03,523 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6331.900000 2021-02-19 03:45:03,552 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3714.700000 2021-02-19 03:45:03,648 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4423.600000 2021-02-19 03:45:03,687 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3904.900000 2021-02-19 03:45:03,851 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3861.800000 2021-02-19 03:45:04,319 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3660.400000 2021-02-19 03:45:04,569 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:04,584 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7342.200000 2021-02-19 03:45:04,598 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:04,779 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3393.100000 2021-02-19 03:45:05,177 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6331.900000 2021-02-19 03:45:05,207 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3714.700000 2021-02-19 03:45:05,286 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4423.600000 2021-02-19 03:45:05,334 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3904.900000 2021-02-19 03:45:05,484 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3861.800000 2021-02-19 03:45:06,003 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3677.800000 2021-02-19 03:45:06,211 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:06,234 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7341.200000 2021-02-19 03:45:06,249 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:06,420 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3430.500000 2021-02-19 03:45:06,822 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6329.300000 2021-02-19 03:45:06,878 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3717.300000 2021-02-19 03:45:06,977 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 2.67 % 2021-02-19 03:45:06,983 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4415.300000 2021-02-19 03:45:06,990 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3896.100000 2021-02-19 03:45:06,996 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:45:06,996 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:45:07,107 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3811.600000 2021-02-19 03:45:07,371 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 2.69 % 2021-02-19 03:45:07,371 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 2.69144505448 2021-02-19 03:45:07,651 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3677.800000 2021-02-19 03:45:07,910 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:07,921 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:07,923 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7341.200000 2021-02-19 03:45:08,075 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3430.500000 2021-02-19 03:45:08,476 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6329.300000 2021-02-19 03:45:08,512 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3717.300000 2021-02-19 03:45:08,657 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4415.300000 2021-02-19 03:45:08,667 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3896.100000 2021-02-19 03:45:08,759 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3811.600000 2021-02-19 03:45:09,292 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3677.800000 2021-02-19 03:45:09,565 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:09,569 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7341.200000 2021-02-19 03:45:09,575 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:09,706 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3430.500000 2021-02-19 03:45:10,117 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6290.562891 2021-02-19 03:45:10,134 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3750.418694 2021-02-19 03:45:10,315 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4424.805659 2021-02-19 03:45:10,325 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3928.910789 2021-02-19 03:45:10,384 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3783.605799 2021-02-19 03:45:10,964 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3720.329883 2021-02-19 03:45:11,214 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:11,242 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:11,252 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7369.055914 2021-02-19 03:45:11,349 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3409.747590 2021-02-19 03:45:11,801 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3750.418694 2021-02-19 03:45:11,812 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6290.562891 2021-02-19 03:45:11,986 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3928.910789 2021-02-19 03:45:11,999 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4424.805659 2021-02-19 03:45:12,030 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3783.605799 2021-02-19 03:45:12,411 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 3.00 % 2021-02-19 03:45:12,411 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 2.99772120659 2021-02-19 03:45:12,605 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3735.829883 2021-02-19 03:45:12,871 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:12,898 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7356.355914 2021-02-19 03:45:12,923 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:13,030 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3435.847590 2021-02-19 03:45:13,479 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3758.518694 2021-02-19 03:45:13,479 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6210.262891 2021-02-19 03:45:13,632 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3913.510789 2021-02-19 03:45:13,648 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4397.905659 2021-02-19 03:45:13,684 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3836.705799 2021-02-19 03:45:14,266 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3735.829883 2021-02-19 03:45:14,515 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:14,582 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7356.355914 2021-02-19 03:45:14,594 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:14,710 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3435.847590 2021-02-19 03:45:15,125 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6210.262891 2021-02-19 03:45:15,131 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3758.518694 2021-02-19 03:45:15,306 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4397.905659 2021-02-19 03:45:15,312 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3913.510789 2021-02-19 03:45:15,335 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3836.705799 2021-02-19 03:45:15,947 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3673.529883 2021-02-19 03:45:16,134 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:16,219 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:16,255 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7272.955914 2021-02-19 03:45:16,341 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3412.547590 2021-02-19 03:45:16,759 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6102.962891 2021-02-19 03:45:16,776 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3738.618694 2021-02-19 03:45:16,992 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3911.610789 2021-02-19 03:45:16,997 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3865.305799 2021-02-19 03:45:17,002 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4376.805659 2021-02-19 03:45:17,012 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 3.26 % 2021-02-19 03:45:17,025 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:45:17,025 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:45:17,460 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 3.29 % 2021-02-19 03:45:17,460 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 3.29097652536 2021-02-19 03:45:17,595 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3673.529883 2021-02-19 03:45:17,772 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:17,858 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:17,897 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7272.955914 2021-02-19 03:45:17,970 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3412.547590 2021-02-19 03:45:18,404 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6102.962891 2021-02-19 03:45:18,423 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3738.618694 2021-02-19 03:45:18,644 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3911.610789 2021-02-19 03:45:18,678 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3865.305799 2021-02-19 03:45:18,698 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4376.805659 2021-02-19 03:45:19,243 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3673.529883 2021-02-19 03:45:19,428 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:19,496 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:19,535 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7272.955914 2021-02-19 03:45:19,604 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3412.547590 2021-02-19 03:45:20,065 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6056.620657 2021-02-19 03:45:20,086 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3724.091033 2021-02-19 03:45:20,283 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3923.657726 2021-02-19 03:45:20,319 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3922.053483 2021-02-19 03:45:20,342 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4335.043155 2021-02-19 03:45:20,861 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3621.156045 2021-02-19 03:45:21,111 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:21,144 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:21,184 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7235.125140 2021-02-19 03:45:21,263 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3426.717614 2021-02-19 03:45:21,707 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6056.620657 2021-02-19 03:45:21,723 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3724.091033 2021-02-19 03:45:21,930 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3923.657726 2021-02-19 03:45:21,973 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4335.043155 2021-02-19 03:45:21,976 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3922.053483 2021-02-19 03:45:22,512 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3588.256045 2021-02-19 03:45:22,519 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 3.58 % 2021-02-19 03:45:22,519 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 3.58423184414 2021-02-19 03:45:22,766 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:22,805 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:22,851 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7197.225140 2021-02-19 03:45:22,898 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3418.217614 2021-02-19 03:45:23,332 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6120.920657 2021-02-19 03:45:23,375 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3723.091033 2021-02-19 03:45:23,568 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3962.957726 2021-02-19 03:45:23,612 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4320.943155 2021-02-19 03:45:23,634 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3903.953483 2021-02-19 03:45:24,154 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3588.256045 2021-02-19 03:45:24,394 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:24,427 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:24,515 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7197.225140 2021-02-19 03:45:24,529 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3418.217614 2021-02-19 03:45:24,977 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6120.920657 2021-02-19 03:45:25,017 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3723.091033 2021-02-19 03:45:25,204 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3962.957726 2021-02-19 03:45:25,253 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4320.943155 2021-02-19 03:45:25,283 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3903.953483 2021-02-19 03:45:25,795 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3630.913059 2021-02-19 03:45:26,040 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:26,072 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:26,141 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7243.489344 2021-02-19 03:45:26,180 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3421.714219 2021-02-19 03:45:26,622 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6229.458150 2021-02-19 03:45:26,674 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3752.899071 2021-02-19 03:45:26,864 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3979.576648 2021-02-19 03:45:26,926 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4303.097323 2021-02-19 03:45:26,943 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3903.707751 2021-02-19 03:45:27,035 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 3.82 % 2021-02-19 03:45:27,049 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:45:27,049 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:45:27,438 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3630.913059 2021-02-19 03:45:27,569 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 3.88 % 2021-02-19 03:45:27,571 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 3.87748716291 2021-02-19 03:45:27,700 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:27,720 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:27,790 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7243.489344 2021-02-19 03:45:27,872 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3421.714219 2021-02-19 03:45:28,263 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6229.458150 2021-02-19 03:45:28,316 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3752.899071 2021-02-19 03:45:28,509 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3979.576648 2021-02-19 03:45:28,592 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4303.097323 2021-02-19 03:45:28,601 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3903.707751 2021-02-19 03:45:29,094 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3630.913059 2021-02-19 03:45:29,369 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:29,382 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:29,437 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7267.505939 2021-02-19 03:45:29,519 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3421.714219 2021-02-19 03:45:29,891 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6378.032857 2021-02-19 03:45:29,960 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3783.746255 2021-02-19 03:45:30,165 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3971.130695 2021-02-19 03:45:30,232 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4322.385230 2021-02-19 03:45:30,255 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3871.783311 2021-02-19 03:45:30,743 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3685.307344 2021-02-19 03:45:31,028 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:31,029 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:31,096 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7267.505939 2021-02-19 03:45:31,164 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3432.302042 2021-02-19 03:45:31,526 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6378.032857 2021-02-19 03:45:31,591 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3783.746255 2021-02-19 03:45:31,799 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3971.130695 2021-02-19 03:45:31,851 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4322.385230 2021-02-19 03:45:31,907 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3871.783311 2021-02-19 03:45:32,367 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3715.707344 2021-02-19 03:45:32,619 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 4.17 % 2021-02-19 03:45:32,619 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 4.17074248169 2021-02-19 03:45:32,653 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:32,726 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:32,743 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7237.405939 2021-02-19 03:45:32,816 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3428.802042 2021-02-19 03:45:33,157 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6404.432857 2021-02-19 03:45:33,219 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3780.446255 2021-02-19 03:45:33,503 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3919.430695 2021-02-19 03:45:33,510 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4317.585230 2021-02-19 03:45:33,552 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3870.583311 2021-02-19 03:45:33,983 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3715.707344 2021-02-19 03:45:34,292 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:34,368 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:34,381 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7237.405939 2021-02-19 03:45:34,448 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3428.802042 2021-02-19 03:45:34,799 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6404.432857 2021-02-19 03:45:34,862 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3780.446255 2021-02-19 03:45:35,188 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3919.430695 2021-02-19 03:45:35,190 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4317.585230 2021-02-19 03:45:35,210 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3870.583311 2021-02-19 03:45:35,638 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3715.707344 2021-02-19 03:45:35,927 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:36,009 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7222.354955 2021-02-19 03:45:36,028 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:36,105 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3438.924015 2021-02-19 03:45:36,484 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6418.679239 2021-02-19 03:45:36,502 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3762.703565 2021-02-19 03:45:36,857 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3850.845167 2021-02-19 03:45:36,858 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4322.684542 2021-02-19 03:45:36,881 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3912.081828 2021-02-19 03:45:37,065 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 4.44 % 2021-02-19 03:45:37,078 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:45:37,078 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:45:37,278 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3722.703810 2021-02-19 03:45:37,556 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:37,677 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7222.354955 2021-02-19 03:45:37,680 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:37,690 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 4.48 % 2021-02-19 03:45:37,691 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 4.47706959597 2021-02-19 03:45:37,750 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3438.924015 2021-02-19 03:45:38,141 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6418.679239 2021-02-19 03:45:38,151 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3762.703565 2021-02-19 03:45:38,522 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3850.845167 2021-02-19 03:45:38,542 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3912.081828 2021-02-19 03:45:38,546 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4322.684542 2021-02-19 03:45:38,961 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3722.703810 2021-02-19 03:45:39,167 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:39,341 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:39,359 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7222.354955 2021-02-19 03:45:39,397 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3438.924015 2021-02-19 03:45:39,779 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6362.378351 2021-02-19 03:45:39,802 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3745.567350 2021-02-19 03:45:40,200 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3925.131464 2021-02-19 03:45:40,214 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4358.240510 2021-02-19 03:45:40,243 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3836.032217 2021-02-19 03:45:40,621 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3694.330342 2021-02-19 03:45:40,801 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:41,016 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7212.449649 2021-02-19 03:45:41,020 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:41,055 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3442.947881 2021-02-19 03:45:41,436 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6362.378351 2021-02-19 03:45:41,444 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3745.567350 2021-02-19 03:45:41,859 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3925.131464 2021-02-19 03:45:41,865 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4358.240510 2021-02-19 03:45:41,887 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3836.032217 2021-02-19 03:45:42,260 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3694.330342 2021-02-19 03:45:42,446 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:42,676 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7296.569317 2021-02-19 03:45:42,694 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:42,703 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3464.453618 2021-02-19 03:45:42,746 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 4.91 % 2021-02-19 03:45:42,746 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 4.91369419 2021-02-19 03:45:43,105 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6376.097100 2021-02-19 03:45:43,128 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3751.713962 2021-02-19 03:45:43,496 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3980.027527 2021-02-19 03:45:43,506 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4356.678167 2021-02-19 03:45:43,530 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3834.260180 2021-02-19 03:45:43,890 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3693.688167 2021-02-19 03:45:44,084 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:44,351 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:44,368 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7296.569317 2021-02-19 03:45:44,390 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3464.453618 2021-02-19 03:45:44,753 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6376.097100 2021-02-19 03:45:44,785 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3751.713962 2021-02-19 03:45:45,154 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4356.678167 2021-02-19 03:45:45,176 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3980.027527 2021-02-19 03:45:45,190 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3834.260180 2021-02-19 03:45:45,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3693.688167 2021-02-19 03:45:45,700 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:45,990 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:46,039 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3449.835040 2021-02-19 03:45:46,043 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7317.756097 2021-02-19 03:45:46,381 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6382.313224 2021-02-19 03:45:46,436 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3751.848614 2021-02-19 03:45:46,780 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4350.124687 2021-02-19 03:45:46,826 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3978.857471 2021-02-19 03:45:46,844 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3829.544056 2021-02-19 03:45:47,095 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 5.27 % 2021-02-19 03:45:47,115 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:45:47,115 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:45:47,125 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3680.334687 2021-02-19 03:45:47,321 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:47,618 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:47,674 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7317.756097 2021-02-19 03:45:47,707 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3449.835040 2021-02-19 03:45:47,808 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 5.32 % 2021-02-19 03:45:47,808 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 5.32425163629 2021-02-19 03:45:48,012 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6382.313224 2021-02-19 03:45:48,073 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3751.848614 2021-02-19 03:45:48,410 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4350.124687 2021-02-19 03:45:48,457 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3978.857471 2021-02-19 03:45:48,492 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3829.544056 2021-02-19 03:45:48,766 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3680.334687 2021-02-19 03:45:48,950 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:49,263 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:49,299 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7317.756097 2021-02-19 03:45:49,371 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3449.835040 2021-02-19 03:45:49,668 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6382.313224 2021-02-19 03:45:49,763 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3751.848614 2021-02-19 03:45:50,042 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4219.855824 2021-02-19 03:45:50,131 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3951.165225 2021-02-19 03:45:50,140 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3888.223880 2021-02-19 03:45:50,401 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3663.041230 2021-02-19 03:45:50,582 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:50,928 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:50,944 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7275.860445 2021-02-19 03:45:51,019 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3427.531129 2021-02-19 03:45:51,293 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6351.697480 2021-02-19 03:45:51,407 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3722.147133 2021-02-19 03:45:51,703 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4219.855824 2021-02-19 03:45:51,779 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3951.165225 2021-02-19 03:45:51,796 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3888.223880 2021-02-19 03:45:52,039 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3663.041230 2021-02-19 03:45:52,221 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:52,569 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:52,581 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7194.372216 2021-02-19 03:45:52,661 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3414.411785 2021-02-19 03:45:52,855 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 5.73 % 2021-02-19 03:45:52,855 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 5.73480908258 2021-02-19 03:45:52,914 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6301.930122 2021-02-19 03:45:53,063 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3706.344427 2021-02-19 03:45:53,351 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4192.964374 2021-02-19 03:45:53,460 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3933.262358 2021-02-19 03:45:53,503 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3909.981007 2021-02-19 03:45:53,668 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3642.012963 2021-02-19 03:45:53,839 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:54,220 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7194.372216 2021-02-19 03:45:54,240 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:54,296 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3414.411785 2021-02-19 03:45:54,562 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6301.930122 2021-02-19 03:45:54,707 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3706.344427 2021-02-19 03:45:55,000 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4192.964374 2021-02-19 03:45:55,107 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3933.262358 2021-02-19 03:45:55,148 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3909.981007 2021-02-19 03:45:55,321 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3642.012963 2021-02-19 03:45:55,459 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:55,871 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7125.972216 2021-02-19 03:45:55,910 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:55,946 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3438.111785 2021-02-19 03:45:56,198 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6214.730122 2021-02-19 03:45:56,338 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3678.744427 2021-02-19 03:45:56,687 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4164.364374 2021-02-19 03:45:56,740 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3947.462358 2021-02-19 03:45:56,838 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3936.581007 2021-02-19 03:45:56,970 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3622.112963 2021-02-19 03:45:57,079 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:57,134 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 6.09 % 2021-02-19 03:45:57,150 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:45:57,150 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:45:57,505 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7125.972216 2021-02-19 03:45:57,561 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:57,601 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3438.111785 2021-02-19 03:45:57,811 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6214.730122 2021-02-19 03:45:57,921 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 6.15 % 2021-02-19 03:45:57,921 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 6.14536652886 2021-02-19 03:45:57,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3678.744427 2021-02-19 03:45:58,328 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4164.364374 2021-02-19 03:45:58,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3947.462358 2021-02-19 03:45:58,473 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3936.581007 2021-02-19 03:45:58,592 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3622.112963 2021-02-19 03:45:58,733 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:45:59,138 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7125.972216 2021-02-19 03:45:59,194 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:45:59,236 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3438.111785 2021-02-19 03:45:59,437 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6190.900472 2021-02-19 03:45:59,630 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3678.744427 2021-02-19 03:45:59,951 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4263.384177 2021-02-19 03:46:00,002 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3989.720134 2021-02-19 03:46:00,124 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3877.469344 2021-02-19 03:46:00,224 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3672.426280 2021-02-19 03:46:00,385 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:00,825 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7179.785476 2021-02-19 03:46:00,842 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:00,907 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3491.332355 2021-02-19 03:46:01,101 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6190.900472 2021-02-19 03:46:01,273 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3706.843187 2021-02-19 03:46:01,591 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4263.384177 2021-02-19 03:46:01,641 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3989.720134 2021-02-19 03:46:01,776 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3877.469344 2021-02-19 03:46:01,842 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3672.426280 2021-02-19 03:46:01,990 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:02,450 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7260.754037 2021-02-19 03:46:02,506 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:02,543 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3514.245963 2021-02-19 03:46:02,743 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6189.649081 2021-02-19 03:46:02,911 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3733.699281 2021-02-19 03:46:02,993 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 6.57 % 2021-02-19 03:46:02,993 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 6.56894480848 2021-02-19 03:46:03,240 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4334.837970 2021-02-19 03:46:03,283 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4001.926938 2021-02-19 03:46:03,447 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3853.684253 2021-02-19 03:46:03,516 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3721.096723 2021-02-19 03:46:03,676 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:04,088 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7260.754037 2021-02-19 03:46:04,150 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:04,184 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3514.245963 2021-02-19 03:46:04,382 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6189.649081 2021-02-19 03:46:04,548 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3733.699281 2021-02-19 03:46:04,862 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4334.837970 2021-02-19 03:46:04,927 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4001.926938 2021-02-19 03:46:05,101 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3853.684253 2021-02-19 03:46:05,164 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3721.096723 2021-02-19 03:46:05,329 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:05,747 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7260.754037 2021-02-19 03:46:05,815 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:05,901 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3500.818728 2021-02-19 03:46:06,016 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6255.452418 2021-02-19 03:46:06,198 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3805.739954 2021-02-19 03:46:06,494 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4417.902761 2021-02-19 03:46:06,594 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3995.339107 2021-02-19 03:46:06,782 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3844.323307 2021-02-19 03:46:06,788 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3798.844590 2021-02-19 03:46:06,980 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:07,171 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 6.92 % 2021-02-19 03:46:07,187 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:46:07,188 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:46:07,382 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7374.326382 2021-02-19 03:46:07,447 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:07,575 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3500.818728 2021-02-19 03:46:07,634 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6255.452418 2021-02-19 03:46:07,822 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3805.739954 2021-02-19 03:46:08,051 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 6.98 % 2021-02-19 03:46:08,051 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 6.97950225477 2021-02-19 03:46:08,130 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4417.902761 2021-02-19 03:46:08,243 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3995.339107 2021-02-19 03:46:08,411 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3844.323307 2021-02-19 03:46:08,450 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3798.844590 2021-02-19 03:46:08,601 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:09,104 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7374.326382 2021-02-19 03:46:09,161 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:09,292 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3500.818728 2021-02-19 03:46:09,292 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6255.452418 2021-02-19 03:46:09,466 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3781.822259 2021-02-19 03:46:09,786 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4417.902761 2021-02-19 03:46:09,900 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3922.226741 2021-02-19 03:46:10,073 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3844.054587 2021-02-19 03:46:10,105 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3760.720645 2021-02-19 03:46:10,266 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:10,747 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7358.005251 2021-02-19 03:46:10,802 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:10,921 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3435.974926 2021-02-19 03:46:10,964 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6229.633601 2021-02-19 03:46:11,121 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3781.822259 2021-02-19 03:46:11,438 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4405.016513 2021-02-19 03:46:11,516 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3922.226741 2021-02-19 03:46:11,690 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3844.054587 2021-02-19 03:46:11,763 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3760.720645 2021-02-19 03:46:11,905 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:12,404 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7281.305251 2021-02-19 03:46:12,453 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:12,596 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3401.374926 2021-02-19 03:46:12,637 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6186.733601 2021-02-19 03:46:12,755 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3727.122259 2021-02-19 03:46:13,082 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4365.716513 2021-02-19 03:46:13,098 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 7.41 % 2021-02-19 03:46:13,098 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 7.40635802933 2021-02-19 03:46:13,196 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3901.726741 2021-02-19 03:46:13,348 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3826.754587 2021-02-19 03:46:13,400 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3684.820645 2021-02-19 03:46:13,549 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:14,061 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7281.305251 2021-02-19 03:46:14,104 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:14,246 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3401.374926 2021-02-19 03:46:14,286 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6186.733601 2021-02-19 03:46:14,400 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3727.122259 2021-02-19 03:46:14,714 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4365.716513 2021-02-19 03:46:14,858 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3901.726741 2021-02-19 03:46:14,993 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3826.754587 2021-02-19 03:46:15,046 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3684.820645 2021-02-19 03:46:15,187 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:15,724 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7281.305251 2021-02-19 03:46:15,765 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:15,888 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3401.559694 2021-02-19 03:46:15,956 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6123.517008 2021-02-19 03:46:16,036 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3629.624392 2021-02-19 03:46:16,345 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4307.524110 2021-02-19 03:46:16,505 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3893.621060 2021-02-19 03:46:16,648 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3776.243704 2021-02-19 03:46:16,729 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3564.624793 2021-02-19 03:46:16,851 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:17,217 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 7.74 % 2021-02-19 03:46:17,233 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:46:17,233 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:46:17,377 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7157.127608 2021-02-19 03:46:17,427 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:17,575 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3401.559694 2021-02-19 03:46:17,605 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6123.517008 2021-02-19 03:46:17,691 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3629.624392 2021-02-19 03:46:17,990 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4307.524110 2021-02-19 03:46:18,161 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 7.82 % 2021-02-19 03:46:18,161 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 7.81691547562 2021-02-19 03:46:18,171 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3893.621060 2021-02-19 03:46:18,290 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3776.243704 2021-02-19 03:46:18,392 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3564.624793 2021-02-19 03:46:18,494 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:19,072 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7157.127608 2021-02-19 03:46:19,128 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:19,221 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3401.559694 2021-02-19 03:46:19,262 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6123.517008 2021-02-19 03:46:19,338 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3629.624392 2021-02-19 03:46:19,661 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4307.524110 2021-02-19 03:46:19,823 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3946.406488 2021-02-19 03:46:19,917 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3712.028172 2021-02-19 03:46:20,036 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3545.852014 2021-02-19 03:46:20,131 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:20,742 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7086.694702 2021-02-19 03:46:20,760 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:20,905 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3419.857533 2021-02-19 03:46:20,921 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6136.986744 2021-02-19 03:46:20,969 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3621.842807 2021-02-19 03:46:21,326 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4315.472388 2021-02-19 03:46:21,451 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3946.406488 2021-02-19 03:46:21,565 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3712.028172 2021-02-19 03:46:21,668 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3545.852014 2021-02-19 03:46:21,763 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:22,388 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7032.060555 2021-02-19 03:46:22,417 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:22,555 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3427.101715 2021-02-19 03:46:22,571 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6168.557516 2021-02-19 03:46:22,624 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3630.654482 2021-02-19 03:46:22,960 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4340.385423 2021-02-19 03:46:23,073 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3952.978379 2021-02-19 03:46:23,206 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3664.540207 2021-02-19 03:46:23,207 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.18 % 2021-02-19 03:46:23,207 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 8.18184269148 2021-02-19 03:46:23,311 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3564.069248 2021-02-19 03:46:23,398 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:24,042 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7032.060555 2021-02-19 03:46:24,065 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:24,200 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3427.101715 2021-02-19 03:46:24,214 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6168.557516 2021-02-19 03:46:24,262 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3630.654482 2021-02-19 03:46:24,625 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4340.385423 2021-02-19 03:46:24,730 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3952.978379 2021-02-19 03:46:24,854 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3664.540207 2021-02-19 03:46:24,948 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3564.069248 2021-02-19 03:46:25,051 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:25,690 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7032.060555 2021-02-19 03:46:25,703 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:25,907 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3427.414427 2021-02-19 03:46:25,914 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3681.901944 2021-02-19 03:46:25,933 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6212.076018 2021-02-19 03:46:26,263 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4390.183239 2021-02-19 03:46:26,359 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3963.558635 2021-02-19 03:46:26,503 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3665.800862 2021-02-19 03:46:26,586 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3638.298250 2021-02-19 03:46:26,684 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:27,246 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.53 % 2021-02-19 03:46:27,259 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:46:27,259 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:46:27,346 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7061.121921 2021-02-19 03:46:27,371 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:27,591 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3681.901944 2021-02-19 03:46:27,605 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6212.076018 2021-02-19 03:46:27,611 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3427.414427 2021-02-19 03:46:27,882 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4390.183239 2021-02-19 03:46:28,007 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3963.558635 2021-02-19 03:46:28,187 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3665.800862 2021-02-19 03:46:28,233 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3638.298250 2021-02-19 03:46:28,252 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.63 % 2021-02-19 03:46:28,252 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 8.6250222754 2021-02-19 03:46:28,309 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:28,986 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7061.121921 2021-02-19 03:46:29,009 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:29,233 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3681.901944 2021-02-19 03:46:29,267 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3427.414427 2021-02-19 03:46:29,269 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6212.076018 2021-02-19 03:46:29,546 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4390.183239 2021-02-19 03:46:29,683 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3963.558635 2021-02-19 03:46:29,828 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3738.100862 2021-02-19 03:46:29,871 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3675.598250 2021-02-19 03:46:29,944 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:30,642 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:30,645 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7133.221921 2021-02-19 03:46:30,907 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3704.401944 2021-02-19 03:46:30,940 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6290.576018 2021-02-19 03:46:30,963 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3420.614427 2021-02-19 03:46:31,186 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4391.783239 2021-02-19 03:46:31,367 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3995.558635 2021-02-19 03:46:31,519 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3738.100862 2021-02-19 03:46:31,539 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3675.598250 2021-02-19 03:46:31,568 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:32,273 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:32,290 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7250.537140 2021-02-19 03:46:32,582 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3722.785947 2021-02-19 03:46:32,588 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6317.845382 2021-02-19 03:46:32,601 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3424.827747 2021-02-19 03:46:32,842 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4393.657919 2021-02-19 03:46:33,002 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4018.924199 2021-02-19 03:46:33,197 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3709.977536 2021-02-19 03:46:33,204 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:33,213 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3813.506954 2021-02-19 03:46:33,316 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.05 % 2021-02-19 03:46:33,316 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 9.0453612817 2021-02-19 03:46:33,917 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:33,924 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7250.537140 2021-02-19 03:46:34,234 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6317.845382 2021-02-19 03:46:34,250 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3722.785947 2021-02-19 03:46:34,279 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3424.827747 2021-02-19 03:46:34,477 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4393.657919 2021-02-19 03:46:34,651 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4018.924199 2021-02-19 03:46:34,839 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3709.977536 2021-02-19 03:46:34,868 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:34,907 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3813.506954 2021-02-19 03:46:35,582 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:35,598 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7250.537140 2021-02-19 03:46:35,973 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3687.995678 2021-02-19 03:46:35,999 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3419.657503 2021-02-19 03:46:35,999 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6277.840136 2021-02-19 03:46:36,142 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4368.387715 2021-02-19 03:46:36,296 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4015.237455 2021-02-19 03:46:36,496 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3693.596519 2021-02-19 03:46:36,517 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:36,555 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3867.618127 2021-02-19 03:46:37,250 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7258.881072 2021-02-19 03:46:37,252 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:37,273 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.38 % 2021-02-19 03:46:37,288 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:46:37,288 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:46:37,621 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3687.995678 2021-02-19 03:46:37,710 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6277.840136 2021-02-19 03:46:37,720 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3419.657503 2021-02-19 03:46:37,792 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4368.387715 2021-02-19 03:46:37,930 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4015.237455 2021-02-19 03:46:38,151 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3693.596519 2021-02-19 03:46:38,165 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:38,200 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3867.618127 2021-02-19 03:46:38,361 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.50 % 2021-02-19 03:46:38,361 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 9.49500663435 2021-02-19 03:46:38,891 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:38,918 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7258.881072 2021-02-19 03:46:39,279 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3687.995678 2021-02-19 03:46:39,440 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6147.041733 2021-02-19 03:46:39,441 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3423.229068 2021-02-19 03:46:39,463 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4331.527971 2021-02-19 03:46:39,562 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4015.237455 2021-02-19 03:46:39,783 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3693.596519 2021-02-19 03:46:39,809 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:39,832 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3890.038255 2021-02-19 03:46:40,532 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:40,568 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7192.518772 2021-02-19 03:46:40,931 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3663.847595 2021-02-19 03:46:41,125 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3423.229068 2021-02-19 03:46:41,138 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4331.527971 2021-02-19 03:46:41,144 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6147.041733 2021-02-19 03:46:41,200 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3969.645602 2021-02-19 03:46:41,438 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3647.894442 2021-02-19 03:46:41,461 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:41,463 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3890.038255 2021-02-19 03:46:42,154 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:42,197 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7192.518772 2021-02-19 03:46:42,563 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3634.651917 2021-02-19 03:46:42,835 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3403.671565 2021-02-19 03:46:42,858 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4293.940256 2021-02-19 03:46:42,859 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3916.108147 2021-02-19 03:46:42,877 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6075.401597 2021-02-19 03:46:43,062 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3596.297923 2021-02-19 03:46:43,111 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:43,147 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3871.520128 2021-02-19 03:46:43,417 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.92 % 2021-02-19 03:46:43,417 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 9.91857206134 2021-02-19 03:46:43,842 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:43,880 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7064.937700 2021-02-19 03:46:44,190 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3634.651917 2021-02-19 03:46:44,526 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3403.671565 2021-02-19 03:46:44,551 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3916.108147 2021-02-19 03:46:44,555 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6075.401597 2021-02-19 03:46:44,569 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4293.940256 2021-02-19 03:46:44,736 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:44,743 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3596.297923 2021-02-19 03:46:44,802 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3871.520128 2021-02-19 03:46:45,464 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:45,510 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6975.437700 2021-02-19 03:46:45,829 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3621.251917 2021-02-19 03:46:46,233 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3879.608147 2021-02-19 03:46:46,266 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4280.040256 2021-02-19 03:46:46,290 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3405.171565 2021-02-19 03:46:46,305 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6047.501597 2021-02-19 03:46:46,437 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3555.997923 2021-02-19 03:46:46,448 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:46,466 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3830.120128 2021-02-19 03:46:47,085 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:47,145 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6975.437700 2021-02-19 03:46:47,301 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 10.00 % 2021-02-19 03:46:47,315 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:46:47,315 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:46:47,450 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3621.251917 2021-02-19 03:46:47,888 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3879.608147 2021-02-19 03:46:47,917 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4280.040256 2021-02-19 03:46:47,934 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3405.171565 2021-02-19 03:46:47,948 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6047.501597 2021-02-19 03:46:48,084 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3555.997923 2021-02-19 03:46:48,108 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:48,108 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3830.120128 2021-02-19 03:46:48,463 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 10.00 % 2021-02-19 03:46:48,463 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 10.0 2021-02-19 03:46:48,714 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:48,775 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6975.437700 2021-02-19 03:46:49,072 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3621.251917 2021-02-19 03:46:49,549 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3867.772917 2021-02-19 03:46:49,598 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4280.040256 2021-02-19 03:46:49,602 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3405.171565 2021-02-19 03:46:49,614 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6047.501597 2021-02-19 03:46:49,769 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3555.997923 2021-02-19 03:46:49,779 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:49,786 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3830.120128 2021-02-19 03:46:50,332 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:50,398 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6947.417468 2021-02-19 03:46:50,687 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3595.306571 2021-02-19 03:46:51,219 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3867.772917 2021-02-19 03:46:51,240 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4274.050160 2021-02-19 03:46:51,282 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6102.987179 2021-02-19 03:46:51,292 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3431.069872 2021-02-19 03:46:51,428 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3552.596635 2021-02-19 03:46:51,450 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:51,467 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3824.771314 2021-02-19 03:46:51,971 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:52,020 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6947.417468 2021-02-19 03:46:52,319 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3625.206571 2021-02-19 03:46:52,871 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3881.772917 2021-02-19 03:46:52,894 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4256.950160 2021-02-19 03:46:52,990 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6156.187179 2021-02-19 03:46:53,035 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3465.569872 2021-02-19 03:46:53,101 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3571.896635 2021-02-19 03:46:53,121 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:53,131 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3873.071314 2021-02-19 03:46:53,516 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 10.00 % 2021-02-19 03:46:53,516 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 10.0 2021-02-19 03:46:53,631 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:53,664 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6997.517468 2021-02-19 03:46:54,002 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3625.206571 2021-02-19 03:46:54,510 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3881.772917 2021-02-19 03:46:54,542 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4256.950160 2021-02-19 03:46:54,650 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6156.187179 2021-02-19 03:46:54,710 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3465.569872 2021-02-19 03:46:54,759 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3571.896635 2021-02-19 03:46:54,785 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:54,819 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3873.071314 2021-02-19 03:46:55,282 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:55,303 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6997.517468 2021-02-19 03:46:55,640 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3625.206571 2021-02-19 03:46:56,161 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3918.772917 2021-02-19 03:46:56,188 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4205.250160 2021-02-19 03:46:56,302 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6219.887179 2021-02-19 03:46:56,411 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3614.396635 2021-02-19 03:46:56,418 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:56,418 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3464.569872 2021-02-19 03:46:56,506 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3955.571314 2021-02-19 03:46:56,900 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:56,937 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7107.617468 2021-02-19 03:46:57,267 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3694.906571 2021-02-19 03:46:57,328 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 10.15 % 2021-02-19 03:46:57,345 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:46:57,345 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:46:57,825 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3918.772917 2021-02-19 03:46:57,871 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4205.250160 2021-02-19 03:46:57,959 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6219.887179 2021-02-19 03:46:58,069 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3464.569872 2021-02-19 03:46:58,069 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:58,094 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3614.396635 2021-02-19 03:46:58,174 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3955.571314 2021-02-19 03:46:58,545 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:46:58,569 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 10.30 % 2021-02-19 03:46:58,569 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 10.3030368788 2021-02-19 03:46:58,635 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7107.617468 2021-02-19 03:46:58,878 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3694.906571 2021-02-19 03:46:59,460 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3899.900000 2021-02-19 03:46:59,500 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4151.200000 2021-02-19 03:46:59,609 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6219.887179 2021-02-19 03:46:59,710 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3464.569872 2021-02-19 03:46:59,742 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3614.396635 2021-02-19 03:46:59,742 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:46:59,831 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3955.571314 2021-02-19 03:47:00,154 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:00,276 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7137.700000 2021-02-19 03:47:00,519 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3730.300000 2021-02-19 03:47:01,111 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3899.900000 2021-02-19 03:47:01,138 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4151.200000 2021-02-19 03:47:01,279 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6253.700000 2021-02-19 03:47:01,372 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3254.100000 2021-02-19 03:47:01,427 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3642.300000 2021-02-19 03:47:01,436 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:01,499 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3950.100000 2021-02-19 03:47:01,765 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:01,930 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7137.700000 2021-02-19 03:47:02,141 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3730.300000 2021-02-19 03:47:02,752 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3898.500000 2021-02-19 03:47:02,778 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4106.500000 2021-02-19 03:47:02,930 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6298.600000 2021-02-19 03:47:03,062 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2939.100000 2021-02-19 03:47:03,076 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:03,105 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3662.400000 2021-02-19 03:47:03,153 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3912.400000 2021-02-19 03:47:03,394 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:03,562 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7138.000000 2021-02-19 03:47:03,625 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 10.71 % 2021-02-19 03:47:03,627 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 10.7103423112 2021-02-19 03:47:03,773 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3722.800000 2021-02-19 03:47:04,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3898.500000 2021-02-19 03:47:04,405 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4106.500000 2021-02-19 03:47:04,582 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6298.600000 2021-02-19 03:47:04,713 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:04,762 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2939.100000 2021-02-19 03:47:04,792 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3662.400000 2021-02-19 03:47:04,802 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3912.400000 2021-02-19 03:47:05,039 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:05,184 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7138.000000 2021-02-19 03:47:05,413 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3722.800000 2021-02-19 03:47:05,996 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3890.900000 2021-02-19 03:47:06,032 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4123.100000 2021-02-19 03:47:06,201 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6337.300000 2021-02-19 03:47:06,371 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:06,398 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2522.100000 2021-02-19 03:47:06,437 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3848.500000 2021-02-19 03:47:06,457 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3684.800000 2021-02-19 03:47:06,644 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:06,839 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7129.300000 2021-02-19 03:47:07,052 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3694.800000 2021-02-19 03:47:07,361 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 11.05 % 2021-02-19 03:47:07,377 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:47:07,378 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:47:07,621 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3890.900000 2021-02-19 03:47:07,674 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4123.100000 2021-02-19 03:47:07,862 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6337.300000 2021-02-19 03:47:08,003 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:08,029 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2522.100000 2021-02-19 03:47:08,138 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3848.500000 2021-02-19 03:47:08,144 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3684.800000 2021-02-19 03:47:08,265 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:08,493 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7129.300000 2021-02-19 03:47:08,681 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 11.13 % 2021-02-19 03:47:08,681 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 11.1339333314 2021-02-19 03:47:08,690 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3694.800000 2021-02-19 03:47:09,257 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3890.900000 2021-02-19 03:47:09,311 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4123.100000 2021-02-19 03:47:09,503 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6433.200000 2021-02-19 03:47:09,648 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:09,704 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2522.100000 2021-02-19 03:47:09,792 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3684.800000 2021-02-19 03:47:09,801 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3848.500000 2021-02-19 03:47:09,895 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:10,148 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7278.500000 2021-02-19 03:47:10,326 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3746.400000 2021-02-19 03:47:10,881 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3950.800000 2021-02-19 03:47:10,934 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4240.500000 2021-02-19 03:47:11,130 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6433.200000 2021-02-19 03:47:11,323 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:11,378 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2217.100000 2021-02-19 03:47:11,428 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3898.700000 2021-02-19 03:47:11,482 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3773.700000 2021-02-19 03:47:11,515 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:11,776 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7278.500000 2021-02-19 03:47:11,950 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3746.400000 2021-02-19 03:47:12,517 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4006.400000 2021-02-19 03:47:12,569 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4346.100000 2021-02-19 03:47:12,773 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6482.100000 2021-02-19 03:47:12,979 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:13,046 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2083.300000 2021-02-19 03:47:13,066 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3959.900000 2021-02-19 03:47:13,122 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3851.800000 2021-02-19 03:47:13,151 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:13,384 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7438.700000 2021-02-19 03:47:13,585 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3805.600000 2021-02-19 03:47:13,726 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 11.59 % 2021-02-19 03:47:13,726 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 11.5901082676 2021-02-19 03:47:14,167 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4006.400000 2021-02-19 03:47:14,216 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4346.100000 2021-02-19 03:47:14,407 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6482.100000 2021-02-19 03:47:14,601 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:14,704 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2083.300000 2021-02-19 03:47:14,711 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3959.900000 2021-02-19 03:47:14,759 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3851.800000 2021-02-19 03:47:14,773 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:15,015 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7438.700000 2021-02-19 03:47:15,223 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3805.600000 2021-02-19 03:47:15,834 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4006.400000 2021-02-19 03:47:15,849 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4427.500000 2021-02-19 03:47:16,029 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6555.700000 2021-02-19 03:47:16,226 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:16,358 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2032.600000 2021-02-19 03:47:16,380 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4061.300000 2021-02-19 03:47:16,404 | infra | INFO | pool-2-thread-25 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' completed 2021-02-19 03:47:16,404 | infra | INFO | pool-2-thread-25 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:47:16,470 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3923.400000 2021-02-19 03:47:16,477 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:16,631 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7589.100000 2021-02-19 03:47:16,836 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3864.300000 2021-02-19 03:47:17,394 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 11.82 % 2021-02-19 03:47:17,411 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:47:17,411 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:47:17,463 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4045.100000 2021-02-19 03:47:17,489 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4427.500000 2021-02-19 03:47:17,667 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6555.700000 2021-02-19 03:47:17,871 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:18,020 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2032.600000 2021-02-19 03:47:18,052 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4061.300000 2021-02-19 03:47:18,107 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3923.400000 2021-02-19 03:47:18,117 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:18,283 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7589.100000 2021-02-19 03:47:18,467 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3864.300000 2021-02-19 03:47:18,769 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 11.99 % 2021-02-19 03:47:18,769 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 11.9941234645 2021-02-19 03:47:19,124 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4045.100000 2021-02-19 03:47:19,134 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4427.500000 2021-02-19 03:47:19,312 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6555.700000 2021-02-19 03:47:19,482 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:19,651 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2032.600000 2021-02-19 03:47:19,711 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4061.300000 2021-02-19 03:47:19,769 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3923.400000 2021-02-19 03:47:19,802 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:19,928 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7682.321224 2021-02-19 03:47:20,099 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3754.549345 2021-02-19 03:47:20,766 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4111.878986 2021-02-19 03:47:20,775 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4464.148096 2021-02-19 03:47:20,941 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6572.739628 2021-02-19 03:47:21,085 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:21,266 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1867.853464 2021-02-19 03:47:21,351 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4078.992902 2021-02-19 03:47:21,440 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3949.301570 2021-02-19 03:47:21,474 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:21,573 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7682.321224 2021-02-19 03:47:21,714 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3754.549345 2021-02-19 03:47:22,411 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4177.578986 2021-02-19 03:47:22,434 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4518.448096 2021-02-19 03:47:22,585 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6577.339628 2021-02-19 03:47:22,698 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:22,956 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1802.453464 2021-02-19 03:47:22,994 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4109.592902 2021-02-19 03:47:23,095 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:23,119 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3998.401570 2021-02-19 03:47:23,224 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7748.521224 2021-02-19 03:47:23,334 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3265.949345 2021-02-19 03:47:23,809 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 12.43 % 2021-02-19 03:47:23,811 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 12.4340128129 2021-02-19 03:47:24,032 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4177.578986 2021-02-19 03:47:24,085 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4518.448096 2021-02-19 03:47:24,224 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6577.339628 2021-02-19 03:47:24,302 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:24,507 | infra | INFO | pool-2-thread-15 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' completed 2021-02-19 03:47:24,507 | infra | INFO | pool-2-thread-15 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:47:24,661 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1802.453464 2021-02-19 03:47:24,727 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4109.592902 2021-02-19 03:47:24,752 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:24,825 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3998.401570 2021-02-19 03:47:24,898 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7748.521224 2021-02-19 03:47:24,971 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3265.949345 2021-02-19 03:47:25,677 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4177.578986 2021-02-19 03:47:25,742 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4518.448096 2021-02-19 03:47:25,865 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6494.539628 2021-02-19 03:47:25,934 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:26,302 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1919.053464 2021-02-19 03:47:26,430 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4121.192902 2021-02-19 03:47:26,444 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:26,480 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4030.501570 2021-02-19 03:47:26,528 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7808.121224 2021-02-19 03:47:26,615 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2413.849345 2021-02-19 03:47:27,312 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4264.078986 2021-02-19 03:47:27,369 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4576.048096 2021-02-19 03:47:27,423 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 12.79 % 2021-02-19 03:47:27,437 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:47:27,437 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:47:27,494 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6494.539628 2021-02-19 03:47:27,545 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:27,920 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1919.053464 2021-02-19 03:47:28,046 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:28,065 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4121.192902 2021-02-19 03:47:28,108 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4030.501570 2021-02-19 03:47:28,161 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7808.121224 2021-02-19 03:47:28,263 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2413.849345 2021-02-19 03:47:28,851 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 12.87 % 2021-02-19 03:47:28,851 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 12.8739149019 2021-02-19 03:47:28,930 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4264.078986 2021-02-19 03:47:29,015 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4576.048096 2021-02-19 03:47:29,147 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6494.539628 2021-02-19 03:47:29,184 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:29,546 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2044.284105 2021-02-19 03:47:29,668 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:29,701 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4121.192902 2021-02-19 03:47:29,792 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4030.501570 2021-02-19 03:47:29,849 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7808.121224 2021-02-19 03:47:29,926 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1245.000000 2021-02-19 03:47:30,552 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4297.130929 2021-02-19 03:47:30,638 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4667.279274 2021-02-19 03:47:30,792 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6399.731930 2021-02-19 03:47:30,835 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:31,167 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2044.284105 2021-02-19 03:47:31,276 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:31,336 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4121.607222 2021-02-19 03:47:31,428 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4047.203441 2021-02-19 03:47:31,540 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7823.483385 2021-02-19 03:47:31,607 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1245.000000 2021-02-19 03:47:32,219 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4297.130929 2021-02-19 03:47:32,313 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4741.679274 2021-02-19 03:47:32,463 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6410.831930 2021-02-19 03:47:32,469 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:32,809 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2242.084105 2021-02-19 03:47:32,914 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:32,976 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4144.107222 2021-02-19 03:47:33,062 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4054.803441 2021-02-19 03:47:33,187 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7888.983385 2021-02-19 03:47:33,247 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 442.000000 2021-02-19 03:47:33,845 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4315.730929 2021-02-19 03:47:33,891 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 13.40 % 2021-02-19 03:47:33,891 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 13.4017744757 2021-02-19 03:47:33,961 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4741.679274 2021-02-19 03:47:34,118 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6410.831930 2021-02-19 03:47:34,121 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:34,427 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2242.084105 2021-02-19 03:47:34,529 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:34,618 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4144.107222 2021-02-19 03:47:34,684 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4054.803441 2021-02-19 03:47:34,819 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7888.983385 2021-02-19 03:47:34,878 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 442.000000 2021-02-19 03:47:35,473 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4323.330929 2021-02-19 03:47:35,607 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4798.679274 2021-02-19 03:47:35,746 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6410.831930 2021-02-19 03:47:35,782 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:36,049 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2183.984105 2021-02-19 03:47:36,206 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:36,296 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4166.207222 2021-02-19 03:47:36,342 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4082.603441 2021-02-19 03:47:36,507 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7952.483385 2021-02-19 03:47:36,542 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:47:37,128 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4323.330929 2021-02-19 03:47:37,252 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4798.679274 2021-02-19 03:47:37,378 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6574.131930 2021-02-19 03:47:37,395 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:37,456 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 13.73 % 2021-02-19 03:47:37,467 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:47:37,467 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:47:37,726 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2183.984105 2021-02-19 03:47:37,872 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:37,933 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4166.207222 2021-02-19 03:47:37,973 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4082.603441 2021-02-19 03:47:38,138 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7952.483385 2021-02-19 03:47:38,173 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:47:38,763 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4323.330929 2021-02-19 03:47:38,891 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4798.679274 2021-02-19 03:47:38,947 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 13.86 % 2021-02-19 03:47:38,947 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 13.8579366713 2021-02-19 03:47:38,996 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6574.131930 2021-02-19 03:47:39,019 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:39,352 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2183.984105 2021-02-19 03:47:39,502 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:39,561 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4271.200000 2021-02-19 03:47:39,621 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4082.603441 2021-02-19 03:47:39,775 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7952.483385 2021-02-19 03:47:39,832 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:47:40,398 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4307.800000 2021-02-19 03:47:40,509 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4814.800000 2021-02-19 03:47:40,644 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6729.400000 2021-02-19 03:47:40,687 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:41,006 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1995.000000 2021-02-19 03:47:41,131 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:41,197 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4271.200000 2021-02-19 03:47:41,260 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4109.600000 2021-02-19 03:47:41,436 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8023.300000 2021-02-19 03:47:41,505 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:47:42,049 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4307.800000 2021-02-19 03:47:42,148 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4814.800000 2021-02-19 03:47:42,301 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6795.900000 2021-02-19 03:47:42,335 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:42,671 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1862.600000 2021-02-19 03:47:42,766 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:42,808 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4325.300000 2021-02-19 03:47:42,898 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4089.900000 2021-02-19 03:47:43,082 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8014.000000 2021-02-19 03:47:43,171 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:47:43,667 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4292.200000 2021-02-19 03:47:43,779 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4816.200000 2021-02-19 03:47:43,934 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6795.900000 2021-02-19 03:47:43,976 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:44,009 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 14.32 % 2021-02-19 03:47:44,009 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 14.3238931675 2021-02-19 03:47:44,321 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1862.600000 2021-02-19 03:47:44,365 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:44,454 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4325.300000 2021-02-19 03:47:44,529 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4089.900000 2021-02-19 03:47:44,697 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8014.000000 2021-02-19 03:47:44,798 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:47:45,312 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4292.200000 2021-02-19 03:47:45,421 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4816.200000 2021-02-19 03:47:45,579 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6764.400000 2021-02-19 03:47:45,585 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:45,983 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1886.600000 2021-02-19 03:47:45,999 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:46,101 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4355.900000 2021-02-19 03:47:46,167 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4036.800000 2021-02-19 03:47:46,341 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7951.700000 2021-02-19 03:47:46,444 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:47:46,940 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4262.900000 2021-02-19 03:47:47,069 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4823.000000 2021-02-19 03:47:47,272 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6764.400000 2021-02-19 03:47:47,280 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:47,486 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 14.66 % 2021-02-19 03:47:47,500 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:47:47,500 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:47:47,648 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1886.600000 2021-02-19 03:47:47,687 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:47,782 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4355.900000 2021-02-19 03:47:47,825 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4036.800000 2021-02-19 03:47:47,967 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7951.700000 2021-02-19 03:47:48,065 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:47:48,576 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4262.900000 2021-02-19 03:47:48,753 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4823.000000 2021-02-19 03:47:48,895 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6764.400000 2021-02-19 03:47:48,915 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:49,049 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 14.82 % 2021-02-19 03:47:49,049 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 14.8191688253 2021-02-19 03:47:49,309 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1886.600000 2021-02-19 03:47:49,332 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:49,453 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4303.500000 2021-02-19 03:47:49,507 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4001.700000 2021-02-19 03:47:49,595 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7894.900000 2021-02-19 03:47:49,691 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:47:49,813 | infra | INFO | pool-2-thread-12 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' completed 2021-02-19 03:47:49,813 | infra | INFO | pool-2-thread-12 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:47:50,214 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4293.200000 2021-02-19 03:47:50,371 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4864.500000 2021-02-19 03:47:50,509 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6791.400000 2021-02-19 03:47:50,539 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:50,786 | infra | INFO | pool-2-thread-14 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 03:47:50,786 | infra | INFO | pool-2-thread-14 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:47:50,934 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1802.100000 2021-02-19 03:47:50,953 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:51,075 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4303.500000 2021-02-19 03:47:51,151 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4001.700000 2021-02-19 03:47:51,217 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7894.900000 2021-02-19 03:47:51,319 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:47:51,836 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4293.200000 2021-02-19 03:47:51,990 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4864.500000 2021-02-19 03:47:52,125 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6791.400000 2021-02-19 03:47:52,153 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:52,589 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:52,602 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1738.700000 2021-02-19 03:47:52,711 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4288.000000 2021-02-19 03:47:52,789 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3995.700000 2021-02-19 03:47:52,890 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7794.000000 2021-02-19 03:47:52,964 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:47:53,474 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4343.500000 2021-02-19 03:47:53,612 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4891.100000 2021-02-19 03:47:53,766 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:53,769 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6793.100000 2021-02-19 03:47:54,091 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 15.27 % 2021-02-19 03:47:54,091 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 15.2720917476 2021-02-19 03:47:54,193 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:54,217 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1738.700000 2021-02-19 03:47:54,322 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4288.000000 2021-02-19 03:47:54,413 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3995.700000 2021-02-19 03:47:54,510 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7794.000000 2021-02-19 03:47:54,569 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:47:55,078 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4343.500000 2021-02-19 03:47:55,250 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4891.100000 2021-02-19 03:47:55,391 | infra | INFO | pool-2-thread-34 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' completed 2021-02-19 03:47:55,391 | infra | INFO | pool-2-thread-34 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:47:55,395 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6793.100000 2021-02-19 03:47:55,398 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:47:55,786 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:55,825 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1738.700000 2021-02-19 03:47:55,959 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4344.700000 2021-02-19 03:47:56,062 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3708.900000 2021-02-19 03:47:56,203 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7415.600000 2021-02-19 03:47:56,210 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:47:56,684 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4409.100000 2021-02-19 03:47:56,869 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4961.900000 2021-02-19 03:47:57,022 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6894.300000 2021-02-19 03:47:57,028 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 328.400000 2021-02-19 03:47:57,397 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:57,436 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1651.000000 2021-02-19 03:47:57,513 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 15.58 % 2021-02-19 03:47:57,525 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:47:57,525 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:47:57,588 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4344.700000 2021-02-19 03:47:57,680 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3708.900000 2021-02-19 03:47:57,839 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:47:57,848 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7415.600000 2021-02-19 03:47:58,303 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4409.100000 2021-02-19 03:47:58,506 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4961.900000 2021-02-19 03:47:58,658 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6894.300000 2021-02-19 03:47:58,668 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 328.400000 2021-02-19 03:47:59,000 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:47:59,065 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1651.000000 2021-02-19 03:47:59,127 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 15.77 % 2021-02-19 03:47:59,128 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 15.7706066787 2021-02-19 03:47:59,209 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4344.700000 2021-02-19 03:47:59,385 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3708.900000 2021-02-19 03:47:59,466 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:47:59,506 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6152.600000 2021-02-19 03:47:59,911 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4422.500000 2021-02-19 03:48:00,154 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5053.500000 2021-02-19 03:48:00,275 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7072.400000 2021-02-19 03:48:00,282 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1276.100000 2021-02-19 03:48:00,595 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:00,719 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1606.000000 2021-02-19 03:48:00,854 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4513.300000 2021-02-19 03:48:01,065 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2793.000000 2021-02-19 03:48:01,085 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:01,168 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6152.600000 2021-02-19 03:48:01,530 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4422.500000 2021-02-19 03:48:01,773 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5053.500000 2021-02-19 03:48:01,907 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1276.100000 2021-02-19 03:48:01,934 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7072.400000 2021-02-19 03:48:02,211 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:02,364 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1836.600000 2021-02-19 03:48:02,469 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4655.600000 2021-02-19 03:48:02,732 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1511.300000 2021-02-19 03:48:02,743 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:02,831 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4306.900000 2021-02-19 03:48:03,157 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4485.300000 2021-02-19 03:48:03,391 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5233.500000 2021-02-19 03:48:03,519 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2638.900000 2021-02-19 03:48:03,573 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7400.200000 2021-02-19 03:48:03,822 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:04,000 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1836.600000 2021-02-19 03:48:04,076 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4655.600000 2021-02-19 03:48:04,180 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 16.31 % 2021-02-19 03:48:04,180 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 16.3082478125 2021-02-19 03:48:04,367 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1511.300000 2021-02-19 03:48:04,378 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:04,480 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4306.900000 2021-02-19 03:48:04,766 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4485.300000 2021-02-19 03:48:05,042 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5233.500000 2021-02-19 03:48:05,121 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2638.900000 2021-02-19 03:48:05,223 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7400.200000 2021-02-19 03:48:05,428 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:05,617 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2028.216126 2021-02-19 03:48:05,697 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4655.600000 2021-02-19 03:48:05,986 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 477.300000 2021-02-19 03:48:06,013 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:06,118 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2391.423565 2021-02-19 03:48:06,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4557.870245 2021-02-19 03:48:06,654 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5425.400399 2021-02-19 03:48:06,757 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3737.958812 2021-02-19 03:48:06,857 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7633.930404 2021-02-19 03:48:07,035 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:07,252 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2028.216126 2021-02-19 03:48:07,339 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4744.624863 2021-02-19 03:48:07,536 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 16.68 % 2021-02-19 03:48:07,548 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:48:07,548 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:48:07,641 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 477.300000 2021-02-19 03:48:07,647 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:07,737 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2391.423565 2021-02-19 03:48:08,002 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4557.870245 2021-02-19 03:48:08,273 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5425.400399 2021-02-19 03:48:08,384 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3737.958812 2021-02-19 03:48:08,489 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7633.930404 2021-02-19 03:48:08,644 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:08,874 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2028.216126 2021-02-19 03:48:08,983 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4744.624863 2021-02-19 03:48:09,220 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 16.82 % 2021-02-19 03:48:09,220 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 16.823086553 2021-02-19 03:48:09,273 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 477.300000 2021-02-19 03:48:09,283 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:09,381 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1029.123565 2021-02-19 03:48:09,634 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4665.070245 2021-02-19 03:48:09,927 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5576.500399 2021-02-19 03:48:10,019 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4219.458812 2021-02-19 03:48:10,127 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7750.930404 2021-02-19 03:48:10,257 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:10,499 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1997.716126 2021-02-19 03:48:10,628 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4750.224863 2021-02-19 03:48:10,901 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 56.500000 2021-02-19 03:48:10,915 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:11,010 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1029.123565 2021-02-19 03:48:11,255 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4665.070245 2021-02-19 03:48:11,598 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5576.500399 2021-02-19 03:48:11,677 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4219.458812 2021-02-19 03:48:11,759 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7750.930404 2021-02-19 03:48:11,865 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:12,155 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1997.716126 2021-02-19 03:48:12,247 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4750.224863 2021-02-19 03:48:12,536 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:12,582 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:12,677 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 317.623565 2021-02-19 03:48:12,869 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4687.170245 2021-02-19 03:48:13,243 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5629.400399 2021-02-19 03:48:13,306 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4276.658812 2021-02-19 03:48:13,390 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7767.930404 2021-02-19 03:48:13,476 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:13,780 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1938.716126 2021-02-19 03:48:13,875 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4790.824863 2021-02-19 03:48:14,150 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:14,217 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:14,272 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 17.36 % 2021-02-19 03:48:14,273 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 17.3639669601 2021-02-19 03:48:14,308 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 317.623565 2021-02-19 03:48:14,486 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4687.170245 2021-02-19 03:48:14,871 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5629.400399 2021-02-19 03:48:14,940 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4276.658812 2021-02-19 03:48:15,032 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7767.930404 2021-02-19 03:48:15,082 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:15,411 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1938.716126 2021-02-19 03:48:15,503 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4806.298348 2021-02-19 03:48:15,772 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:15,845 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:15,947 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:16,105 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4692.337506 2021-02-19 03:48:16,502 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5605.163245 2021-02-19 03:48:16,549 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4277.242063 2021-02-19 03:48:16,687 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7784.394291 2021-02-19 03:48:16,740 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:17,039 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1945.694342 2021-02-19 03:48:17,109 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4806.298348 2021-02-19 03:48:17,415 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:17,490 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:17,559 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 17.69 % 2021-02-19 03:48:17,573 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:48:17,573 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:48:17,598 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:17,714 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4692.337506 2021-02-19 03:48:18,137 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5605.163245 2021-02-19 03:48:18,178 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4277.242063 2021-02-19 03:48:18,309 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7784.394291 2021-02-19 03:48:18,348 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:18,645 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1945.694342 2021-02-19 03:48:18,730 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4806.298348 2021-02-19 03:48:19,051 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:19,108 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:19,230 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:19,321 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 17.88 % 2021-02-19 03:48:19,321 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 17.8755154651 2021-02-19 03:48:19,351 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4692.337506 2021-02-19 03:48:19,760 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5605.163245 2021-02-19 03:48:19,803 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4277.242063 2021-02-19 03:48:19,990 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7756.094291 2021-02-19 03:48:19,997 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:20,278 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1875.294342 2021-02-19 03:48:20,365 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4866.298348 2021-02-19 03:48:20,678 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:20,721 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:20,855 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:20,957 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4681.537506 2021-02-19 03:48:21,401 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5567.163245 2021-02-19 03:48:21,447 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4277.942063 2021-02-19 03:48:21,621 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:21,641 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7756.094291 2021-02-19 03:48:21,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1875.294342 2021-02-19 03:48:21,993 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4866.298348 2021-02-19 03:48:22,325 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:22,351 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:22,477 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:22,571 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4703.137506 2021-02-19 03:48:23,049 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5586.663245 2021-02-19 03:48:23,076 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4294.742063 2021-02-19 03:48:23,259 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:23,273 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7713.594291 2021-02-19 03:48:23,535 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1902.894342 2021-02-19 03:48:23,628 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4879.598348 2021-02-19 03:48:23,953 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:23,984 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:24,095 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:24,191 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4703.137506 2021-02-19 03:48:24,384 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 18.33 % 2021-02-19 03:48:24,384 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 18.3251863736 2021-02-19 03:48:24,667 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5586.663245 2021-02-19 03:48:24,707 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4294.742063 2021-02-19 03:48:24,878 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:24,895 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7713.594291 2021-02-19 03:48:25,178 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1902.894342 2021-02-19 03:48:25,243 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4879.598348 2021-02-19 03:48:25,565 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:25,598 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:25,723 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:25,838 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4703.137506 2021-02-19 03:48:26,299 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5645.600000 2021-02-19 03:48:26,316 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4279.800000 2021-02-19 03:48:26,476 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:26,506 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7658.100000 2021-02-19 03:48:26,789 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1853.900000 2021-02-19 03:48:26,868 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4937.500000 2021-02-19 03:48:27,184 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:27,240 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:27,349 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:27,473 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4732.400000 2021-02-19 03:48:27,588 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 18.65 % 2021-02-19 03:48:27,604 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:48:27,605 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:48:27,917 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5645.600000 2021-02-19 03:48:27,944 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4279.800000 2021-02-19 03:48:28,078 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:28,128 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7658.100000 2021-02-19 03:48:28,407 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1853.900000 2021-02-19 03:48:28,490 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4937.500000 2021-02-19 03:48:28,790 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:28,855 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:28,980 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:29,099 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4732.400000 2021-02-19 03:48:29,424 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 18.83 % 2021-02-19 03:48:29,424 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 18.8270297618 2021-02-19 03:48:29,532 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5659.450500 2021-02-19 03:48:29,559 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4274.830028 2021-02-19 03:48:29,678 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:29,773 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7658.100000 2021-02-19 03:48:30,030 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1776.853099 2021-02-19 03:48:30,107 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4917.050500 2021-02-19 03:48:30,417 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:30,483 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:30,605 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:30,730 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4731.775850 2021-02-19 03:48:31,157 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5659.450500 2021-02-19 03:48:31,187 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4274.830028 2021-02-19 03:48:31,302 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:31,417 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7687.566014 2021-02-19 03:48:31,654 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1776.853099 2021-02-19 03:48:31,736 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4917.050500 2021-02-19 03:48:32,030 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:32,095 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:32,226 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:32,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4733.875850 2021-02-19 03:48:32,779 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5673.450500 2021-02-19 03:48:32,861 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4257.030028 2021-02-19 03:48:32,954 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:33,049 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7720.066014 2021-02-19 03:48:33,308 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1786.253099 2021-02-19 03:48:33,384 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4904.050500 2021-02-19 03:48:33,648 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:33,710 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:33,842 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:33,999 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4733.875850 2021-02-19 03:48:34,405 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5673.450500 2021-02-19 03:48:34,463 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 19.31 % 2021-02-19 03:48:34,463 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 19.3125493406 2021-02-19 03:48:34,483 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4257.030028 2021-02-19 03:48:34,561 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:34,665 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7720.066014 2021-02-19 03:48:34,950 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1786.253099 2021-02-19 03:48:35,035 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4904.050500 2021-02-19 03:48:35,309 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:35,427 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:35,503 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:35,641 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4739.175850 2021-02-19 03:48:36,032 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5659.750500 2021-02-19 03:48:36,119 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4271.430028 2021-02-19 03:48:36,164 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:36,276 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7781.366014 2021-02-19 03:48:36,589 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1860.753099 2021-02-19 03:48:36,671 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4874.450500 2021-02-19 03:48:36,910 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:37,026 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:37,111 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:37,273 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4739.175850 2021-02-19 03:48:37,618 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 19.59 % 2021-02-19 03:48:37,632 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:48:37,632 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:48:37,647 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5659.750500 2021-02-19 03:48:37,727 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4271.430028 2021-02-19 03:48:37,767 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:37,888 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7781.366014 2021-02-19 03:48:38,219 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1860.753099 2021-02-19 03:48:38,303 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4874.450500 2021-02-19 03:48:38,540 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:38,642 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:38,743 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:38,894 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4739.175850 2021-02-19 03:48:39,283 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5659.750500 2021-02-19 03:48:39,342 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4271.430028 2021-02-19 03:48:39,417 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:39,526 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 19.76 % 2021-02-19 03:48:39,528 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 19.7556015191 2021-02-19 03:48:39,529 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7761.325970 2021-02-19 03:48:39,848 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1860.753099 2021-02-19 03:48:39,931 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4882.252621 2021-02-19 03:48:40,150 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:40,276 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:40,372 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:40,500 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4803.549900 2021-02-19 03:48:40,907 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5664.551421 2021-02-19 03:48:40,967 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4264.567227 2021-02-19 03:48:41,036 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:41,177 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7761.325970 2021-02-19 03:48:41,494 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1814.228291 2021-02-19 03:48:41,553 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4882.252621 2021-02-19 03:48:41,750 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:41,897 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:41,994 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:42,131 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4803.549900 2021-02-19 03:48:42,528 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5660.451421 2021-02-19 03:48:42,595 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4261.867227 2021-02-19 03:48:42,654 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:42,811 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7685.225970 2021-02-19 03:48:43,128 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2056.928291 2021-02-19 03:48:43,164 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4890.952621 2021-02-19 03:48:43,375 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:43,515 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:43,611 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:43,757 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4845.049900 2021-02-19 03:48:44,167 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5660.451421 2021-02-19 03:48:44,221 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4261.867227 2021-02-19 03:48:44,265 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:44,444 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7685.225970 2021-02-19 03:48:44,569 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 20.00 % 2021-02-19 03:48:44,569 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 20.0 2021-02-19 03:48:44,737 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2056.928291 2021-02-19 03:48:44,767 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4890.952621 2021-02-19 03:48:44,980 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:45,118 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:45,272 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:45,408 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4845.049900 2021-02-19 03:48:45,825 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5660.451421 2021-02-19 03:48:45,874 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:45,894 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4261.867227 2021-02-19 03:48:46,085 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7592.914344 2021-02-19 03:48:46,388 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2543.078831 2021-02-19 03:48:46,401 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4883.908434 2021-02-19 03:48:46,601 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:46,733 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:46,917 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:47,046 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4862.018058 2021-02-19 03:48:47,454 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5630.422575 2021-02-19 03:48:47,520 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:47,539 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4256.460715 2021-02-19 03:48:47,651 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 20.00 % 2021-02-19 03:48:47,668 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:48:47,668 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:48:47,721 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7592.914344 2021-02-19 03:48:48,036 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2543.078831 2021-02-19 03:48:48,039 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4883.908434 2021-02-19 03:48:48,227 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:48,348 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:48,533 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:48,661 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4862.018058 2021-02-19 03:48:49,109 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5630.422575 2021-02-19 03:48:49,141 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:49,165 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4256.460715 2021-02-19 03:48:49,355 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7592.914344 2021-02-19 03:48:49,625 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 20.00 % 2021-02-19 03:48:49,625 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 20.0 2021-02-19 03:48:49,680 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2485.150539 2021-02-19 03:48:49,703 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4869.055813 2021-02-19 03:48:49,851 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:49,970 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:50,190 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:50,295 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4780.168158 2021-02-19 03:48:50,746 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5570.471155 2021-02-19 03:48:50,765 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:50,786 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4284.593488 2021-02-19 03:48:50,977 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7613.788374 2021-02-19 03:48:51,301 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2485.150539 2021-02-19 03:48:51,329 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4869.055813 2021-02-19 03:48:51,466 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:51,573 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:51,802 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:51,898 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4780.168158 2021-02-19 03:48:52,381 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5498.771155 2021-02-19 03:48:52,420 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:52,431 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4350.093488 2021-02-19 03:48:52,592 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7686.588374 2021-02-19 03:48:52,913 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3520.850539 2021-02-19 03:48:52,953 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4838.755813 2021-02-19 03:48:53,089 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:53,177 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:53,443 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:53,526 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4668.768158 2021-02-19 03:48:53,996 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5498.771155 2021-02-19 03:48:54,019 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:54,092 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4350.093488 2021-02-19 03:48:54,209 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7686.588374 2021-02-19 03:48:54,526 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3520.850539 2021-02-19 03:48:54,571 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4838.755813 2021-02-19 03:48:54,691 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:54,694 | test | DEBUG | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 20.14 % 2021-02-19 03:48:54,694 | test | INFO | pool-1-thread-24 | [task:check:330] Rebalance - status: running, progress: 20.1400917803 2021-02-19 03:48:54,789 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:55,053 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:55,142 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4668.768158 2021-02-19 03:48:55,628 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5431.920948 2021-02-19 03:48:55,638 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:55,697 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4350.093488 2021-02-19 03:48:55,838 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7686.588374 2021-02-19 03:48:56,128 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4286.585971 2021-02-19 03:48:56,217 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4693.252535 2021-02-19 03:48:56,338 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:56,418 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:56,690 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:56,767 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4569.548935 2021-02-19 03:48:57,257 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:57,276 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5431.920948 2021-02-19 03:48:57,325 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4388.853915 2021-02-19 03:48:57,471 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7741.343556 2021-02-19 03:48:57,670 | test | INFO | MainThread | [rest_client:rebalance_reached:108] Rebalance reached >20.0% in 240.77699995 seconds 2021-02-19 03:48:57,680 | test | DEBUG | MainThread | [rest_client:diag_eval:1363] /diag/eval status on 172.23.110.64:8091: 1 content: true command: ns_orchestrator:needs_rebalance() 2021-02-19 03:48:57,680 | test | INFO | MainThread | [Magma:abort_rebalance:912] Abort rebalance 2021-02-19 03:48:57,736 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4286.585971 2021-02-19 03:48:57,851 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4693.252535 2021-02-19 03:48:57,950 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:58,049 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:58,131 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L914 2021-02-19 03:48:58,131 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 60 seconds. Reason: Sleep after error introduction 2021-02-19 03:48:58,289 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:58,387 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4569.548935 2021-02-19 03:48:58,844 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:48:58,898 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5431.920948 2021-02-19 03:48:58,934 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4388.853915 2021-02-19 03:48:59,066 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7741.343556 2021-02-19 03:48:59,323 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4286.585971 2021-02-19 03:48:59,476 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4145.552535 2021-02-19 03:48:59,542 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:48:59,667 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:48:59,730 | test | ERROR | pool-1-thread-24 | [rest_client:_rebalance_status_and_progress:1494] {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 03:48:59,757 | test | INFO | pool-1-thread-24 | [rest_client:print_UI_logs:2599] Latest logs from UI on 172.23.110.64: 2021-02-19 03:48:59,757 | test | ERROR | pool-1-thread-24 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_orchestrator', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735338681L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:48:58.681Z', u'text': u'Rebalance exited with reason {mover_crashed,\n {unexpected_exit,\n {\'EXIT\',<0.26424.29>,\n {{{badmatch,{error,closed}},\n [{mc_client_binary,cmd_vocal_recv,5,\n [{file,"src/mc_client_binary.erl"},\n {line,158}]},\n {mc_client_binary,\n wait_for_seqno_persistence,3,\n [{file,"src/mc_client_binary.erl"},\n {line,763}]},\n {ns_memcached,\n \'-wait_for_seqno_persistence/3-fun-0-\',3,\n [{file,"src/ns_memcached.erl"},\n {line,1392}]},\n {ns_memcached,\n \'-perform_very_long_call/3-fun-0-\',2,\n [{file,"src/ns_memcached.erl"},\n {line,324}]},\n {ns_memcached_sockets_pool,\n \'-executing_on_socket/3-fun-0-\',3,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,92}]},\n {async,\'-async_init/4-fun-1-\',3,\n [{file,"src/async.erl"},{line,197}]}]},\n {gen_server,call,\n [{\'janitor_agent-GleamBookUsers2\',\n \'ns_1@172.23.110.64\'},\n {if_rebalance,<0.23877.29>,\n {update_vbucket_state,844,active,\n undefined,undefined,\n [[\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.69\'],\n [\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.65\']]}},\n infinity]}}}}}.\nRebalance Operation Id = ea1f39781a815ea09c266d346bcac5a9'} 2021-02-19 03:48:59,757 | test | ERROR | pool-1-thread-24 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735338655L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:48:58.655Z', u'text': u"Control connection to memcached on 'ns_1@172.23.110.64' disconnected. Check logs for details."} 2021-02-19 03:48:59,759 | test | ERROR | pool-1-thread-24 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_log', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735338651L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:48:58.651Z', u'text': u"Service 'memcached' exited with status 137. Restarting. Messages:\nWARNING: Logging before InitGoogleLogging() is written to STDERR\nW0219 03:39:08.641069 35950 HazptrDomain.h:671] Using the default inline executor for asynchronous reclamation may be susceptible to deadlock if the current thread happens to hold a resource needed by the deleter of a reclaimable object"} 2021-02-19 03:48:59,759 | test | ERROR | pool-1-thread-24 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735338651L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:48:58.651Z', u'text': u'Worker <0.26198.29> (for action {move,{844,\n [\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.69\'],\n [\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.65\'],\n []}}) exited with reason {unexpected_exit,\n {\'EXIT\',\n <0.26424.29>,\n {{{badmatch,\n {error,\n closed}},\n [{mc_client_binary,\n cmd_vocal_recv,\n 5,\n [{file,\n "src/mc_client_binary.erl"},\n {line,\n 158}]},\n {mc_client_binary,\n wait_for_seqno_persistence,\n 3,\n [{file,\n "src/mc_client_binary.erl"},\n {line,\n 763}]},\n {ns_memcached,\n \'-wait_for_seqno_persistence/3-fun-0-\',\n 3,\n [{file,\n "src/ns_memcached.erl"},\n {line,\n 1392}]},\n {ns_memcached,\n \'-perform_very_long_call/3-fun-0-\',\n 2,\n [{file,\n "src/ns_memcached.erl"},\n {line,\n 324}]},\n {ns_memcached_sockets_pool,\n \'-executing_on_socket/3-fun-0-\',\n 3,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,\n 92}]},\n {async,\n \'-async_init/4-fun-1-\',\n 3,\n [{file,\n "src/async.erl"},\n {line,\n 197}]}]},\n {gen_server,\n call,\n [{\'janitor_agent-GleamBookUsers2\',\n \'ns_1@172.23.110.64\'},\n {if_rebalance,\n <0.23877.29>,\n {update_vbucket_state,\n 844,\n active,\n undefined,\n undefined,\n [[\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.69\'],\n [\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.65\']]}},\n infinity]}}}}'} 2021-02-19 03:48:59,759 | test | ERROR | pool-1-thread-24 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613735331952L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:48:51.952Z', u'text': u'Shutting down bucket "GleamBookUsers1" on \'ns_1@172.23.110.69\' for deletion'} 2021-02-19 03:48:59,759 | test | ERROR | pool-1-thread-24 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735331503L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:48:51.503Z', u'text': u'Bucket "GleamBookUsers2" rebalance does not seem to be swap rebalance'} 2021-02-19 03:48:59,759 | test | ERROR | pool-1-thread-24 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_rebalancer', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735331385L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:48:51.385Z', u'text': u'Started rebalancing bucket GleamBookUsers2'} 2021-02-19 03:48:59,759 | test | ERROR | pool-1-thread-24 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613735214282L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:46:54.282Z', u'text': u'Shutting down bucket "GleamBookUsers0" on \'ns_1@172.23.110.69\' for deletion'} 2021-02-19 03:48:59,759 | test | ERROR | pool-1-thread-24 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735213852L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:46:53.852Z', u'text': u'Bucket "GleamBookUsers1" rebalance does not seem to be swap rebalance'} 2021-02-19 03:48:59,759 | test | ERROR | pool-1-thread-24 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_rebalancer', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735213718L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:46:53.718Z', u'text': u'Started rebalancing bucket GleamBookUsers1'} 2021-02-19 03:48:59,759 | test | ERROR | pool-1-thread-24 | [task:call:242] Rebalance Failed: {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 03:48:59,885 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:48:59,986 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4560.248935 2021-02-19 03:49:00,526 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5430.420948 2021-02-19 03:49:00,549 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4416.853915 2021-02-19 03:49:00,691 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7698.043556 2021-02-19 03:49:00,842 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:00,974 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4286.585971 2021-02-19 03:49:01,108 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4145.552535 2021-02-19 03:49:01,168 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:01,299 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:01,506 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:01,612 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4560.248935 2021-02-19 03:49:02,145 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5430.420948 2021-02-19 03:49:02,167 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4416.853915 2021-02-19 03:49:02,305 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5106.943556 2021-02-19 03:49:02,450 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:02,576 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2140.285971 2021-02-19 03:49:02,724 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2543.652535 2021-02-19 03:49:02,825 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:02,904 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:03,096 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:03,229 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3044.248935 2021-02-19 03:49:03,766 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2935.053915 2021-02-19 03:49:03,793 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3607.620948 2021-02-19 03:49:03,901 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5106.943556 2021-02-19 03:49:04,046 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:04,223 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2140.285971 2021-02-19 03:49:04,380 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2543.652535 2021-02-19 03:49:04,427 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:04,500 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:04,701 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:04,851 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3044.248935 2021-02-19 03:49:05,394 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2935.053915 2021-02-19 03:49:05,433 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3607.620948 2021-02-19 03:49:05,510 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3817.056924 2021-02-19 03:49:05,634 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:05,821 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2140.285971 2021-02-19 03:49:05,990 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1388.715630 2021-02-19 03:49:06,013 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:06,094 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:06,299 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:06,473 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2323.326645 2021-02-19 03:49:06,992 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2210.256874 2021-02-19 03:49:07,026 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2745.807320 2021-02-19 03:49:07,107 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3817.056924 2021-02-19 03:49:07,244 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:07,407 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1146.590568 2021-02-19 03:49:07,585 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1388.715630 2021-02-19 03:49:07,598 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:07,686 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:07,904 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:08,121 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2323.326645 2021-02-19 03:49:08,680 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2745.807320 2021-02-19 03:49:08,684 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2210.256874 2021-02-19 03:49:08,782 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3817.056924 2021-02-19 03:49:08,875 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:09,013 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1146.590568 2021-02-19 03:49:09,227 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1388.715630 2021-02-19 03:49:09,232 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:09,302 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:09,510 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:09,707 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2323.326645 2021-02-19 03:49:10,279 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1013.756290 2021-02-19 03:49:10,311 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 809.712680 2021-02-19 03:49:10,390 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1391.186946 2021-02-19 03:49:10,480 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:10,602 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1146.590568 2021-02-19 03:49:10,865 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:10,884 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 334.906516 2021-02-19 03:49:10,921 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:11,121 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:11,348 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 874.875555 2021-02-19 03:49:11,907 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1013.756290 2021-02-19 03:49:11,937 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 809.712680 2021-02-19 03:49:12,062 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1391.186946 2021-02-19 03:49:12,108 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:12,176 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1146.590568 2021-02-19 03:49:12,494 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 334.906516 2021-02-19 03:49:12,530 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:12,598 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:12,700 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:12,941 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 874.875555 2021-02-19 03:49:13,507 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1013.756290 2021-02-19 03:49:13,549 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 809.712680 2021-02-19 03:49:13,671 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1391.186946 2021-02-19 03:49:13,723 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:13,743 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1146.590568 2021-02-19 03:49:14,068 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 334.906516 2021-02-19 03:49:14,183 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:14,269 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:14,303 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:14,543 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 874.875555 2021-02-19 03:49:15,125 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1013.756290 2021-02-19 03:49:15,197 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 809.712680 2021-02-19 03:49:15,269 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1391.186946 2021-02-19 03:49:15,323 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:15,345 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1146.590568 2021-02-19 03:49:15,684 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 15.190885 2021-02-19 03:49:15,799 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:15,894 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:15,927 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:16,119 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 85.148911 2021-02-19 03:49:16,703 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 85.048971 2021-02-19 03:49:16,799 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 73.655807 2021-02-19 03:49:16,877 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 116.630022 2021-02-19 03:49:16,927 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:16,956 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:49:17,273 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 15.190885 2021-02-19 03:49:17,415 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:17,509 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:17,595 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:17,740 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 85.148911 2021-02-19 03:49:18,312 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 85.048971 2021-02-19 03:49:18,437 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 73.655807 2021-02-19 03:49:18,496 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 116.630022 2021-02-19 03:49:18,530 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:18,566 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:49:18,862 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 15.190885 2021-02-19 03:49:18,996 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:19,096 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:19,180 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:19,318 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 85.148911 2021-02-19 03:49:19,894 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 85.048971 2021-02-19 03:49:20,066 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:49:20,101 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:20,127 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:49:20,144 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:49:20,437 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:49:20,575 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:20,700 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:20,766 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:20,907 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:49:21,476 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.100060 2021-02-19 03:49:21,671 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:49:21,694 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:21,730 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:49:21,742 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:49:22,013 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:49:22,147 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:22,329 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:22,385 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:22,494 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:49:23,066 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1.100060 2021-02-19 03:49:23,279 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:49:23,292 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:23,321 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:49:23,334 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:49:23,621 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:49:23,750 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:23,917 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:23,974 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:24,075 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:49:24,653 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1.100060 2021-02-19 03:49:24,872 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:49:24,882 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:24,914 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:49:24,926 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:49:25,206 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:49:25,348 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:25,513 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:25,555 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:25,671 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.100070 2021-02-19 03:49:26,243 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 253.076444 2021-02-19 03:49:26,476 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 146.202342 2021-02-19 03:49:26,486 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:26,548 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:49:26,562 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.400280 2021-02-19 03:49:26,823 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:49:26,964 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:27,098 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:27,174 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:27,301 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.100070 2021-02-19 03:49:27,857 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 253.076444 2021-02-19 03:49:28,063 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:28,079 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 146.202342 2021-02-19 03:49:28,141 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:49:28,177 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.400280 2021-02-19 03:49:28,430 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:49:28,561 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:28,690 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:28,770 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:28,901 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.100070 2021-02-19 03:49:29,450 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1409.276383 2021-02-19 03:49:29,641 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:29,677 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 762.102342 2021-02-19 03:49:29,733 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:49:29,792 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.400280 2021-02-19 03:49:30,038 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:49:30,148 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:30,302 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:30,378 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:30,516 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 151.400070 2021-02-19 03:49:31,032 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1409.276383 2021-02-19 03:49:31,240 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:31,302 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 762.102342 2021-02-19 03:49:31,331 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 03:49:31,403 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 410.900280 2021-02-19 03:49:31,627 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:49:31,740 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:31,901 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:31,986 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:32,128 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 151.400070 2021-02-19 03:49:32,673 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3097.376383 2021-02-19 03:49:32,878 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:32,921 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1740.902342 2021-02-19 03:49:32,993 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 124.800000 2021-02-19 03:49:33,020 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1449.800280 2021-02-19 03:49:33,211 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.700000 2021-02-19 03:49:33,326 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:33,502 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:33,607 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:33,730 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 651.600070 2021-02-19 03:49:34,279 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3097.376383 2021-02-19 03:49:34,460 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:34,539 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1740.902342 2021-02-19 03:49:34,588 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 124.800000 2021-02-19 03:49:34,625 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1449.800280 2021-02-19 03:49:34,809 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.700000 2021-02-19 03:49:34,917 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:35,096 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:35,203 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:35,354 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 651.600070 2021-02-19 03:49:35,882 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3097.376383 2021-02-19 03:49:36,032 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:36,134 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2847.600000 2021-02-19 03:49:36,194 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 871.400000 2021-02-19 03:49:36,232 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3250.100000 2021-02-19 03:49:36,410 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 383.900000 2021-02-19 03:49:36,522 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:36,707 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:36,806 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:36,944 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1614.800000 2021-02-19 03:49:37,471 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4808.800000 2021-02-19 03:49:37,641 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:37,723 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2847.600000 2021-02-19 03:49:37,795 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 871.400000 2021-02-19 03:49:37,835 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3250.100000 2021-02-19 03:49:38,028 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 383.900000 2021-02-19 03:49:38,138 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:38,309 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:38,392 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:38,525 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1614.800000 2021-02-19 03:49:39,073 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4808.800000 2021-02-19 03:49:39,252 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:39,348 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2847.600000 2021-02-19 03:49:39,395 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 871.400000 2021-02-19 03:49:39,434 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5389.949650 2021-02-19 03:49:39,651 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1443.240659 2021-02-19 03:49:39,747 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:39,910 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:40,009 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:40,130 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2936.626873 2021-02-19 03:49:40,670 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5564.188312 2021-02-19 03:49:40,851 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:40,967 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3682.549151 2021-02-19 03:49:40,997 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 871.400000 2021-02-19 03:49:41,039 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5389.949650 2021-02-19 03:49:41,267 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1443.240659 2021-02-19 03:49:41,369 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:41,503 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:41,615 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:41,723 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2936.626873 2021-02-19 03:49:42,306 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5725.388312 2021-02-19 03:49:42,424 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:42,548 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4205.149151 2021-02-19 03:49:42,588 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2855.700000 2021-02-19 03:49:42,638 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6989.849650 2021-02-19 03:49:42,871 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2982.740659 2021-02-19 03:49:42,996 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:43,109 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:43,206 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:43,322 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4003.626873 2021-02-19 03:49:43,900 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5725.388312 2021-02-19 03:49:44,000 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:44,153 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4205.149151 2021-02-19 03:49:44,197 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2855.700000 2021-02-19 03:49:44,232 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6989.849650 2021-02-19 03:49:44,510 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2982.740659 2021-02-19 03:49:44,625 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:44,698 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:44,802 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:44,917 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4003.626873 2021-02-19 03:49:45,532 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5585.088312 2021-02-19 03:49:45,621 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:45,766 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4205.149151 2021-02-19 03:49:45,795 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2855.700000 2021-02-19 03:49:45,825 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6989.849650 2021-02-19 03:49:46,118 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4215.040659 2021-02-19 03:49:46,253 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:46,302 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:46,394 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:46,516 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4590.326873 2021-02-19 03:49:47,121 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5585.088312 2021-02-19 03:49:47,236 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:47,394 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4217.900000 2021-02-19 03:49:47,410 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4438.149151 2021-02-19 03:49:47,430 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7753.949650 2021-02-19 03:49:47,707 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4215.040659 2021-02-19 03:49:47,855 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:47,905 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:47,993 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:48,115 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4590.326873 2021-02-19 03:49:48,727 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5585.088312 2021-02-19 03:49:48,844 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:48,986 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4217.900000 2021-02-19 03:49:49,036 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4438.149151 2021-02-19 03:49:49,049 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7753.949650 2021-02-19 03:49:49,313 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4215.040659 2021-02-19 03:49:49,459 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:49,519 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:49,591 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:49,710 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4678.543866 2021-02-19 03:49:50,309 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5496.517688 2021-02-19 03:49:50,441 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:50,601 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4217.900000 2021-02-19 03:49:50,663 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4454.353295 2021-02-19 03:49:50,683 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7862.934067 2021-02-19 03:49:50,895 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4694.746095 2021-02-19 03:49:51,062 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:51,109 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:51,184 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:51,318 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4678.543866 2021-02-19 03:49:51,901 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5496.517688 2021-02-19 03:49:52,005 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:52,203 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4217.900000 2021-02-19 03:49:52,292 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4451.553295 2021-02-19 03:49:52,315 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7925.334067 2021-02-19 03:49:52,520 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4801.846095 2021-02-19 03:49:52,687 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:52,762 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:52,828 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:52,913 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4668.143866 2021-02-19 03:49:53,490 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5460.617688 2021-02-19 03:49:53,572 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:53,792 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4319.100000 2021-02-19 03:49:53,911 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4451.553295 2021-02-19 03:49:53,931 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7925.334067 2021-02-19 03:49:54,131 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4801.846095 2021-02-19 03:49:54,326 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:54,371 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:54,428 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:54,520 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4668.143866 2021-02-19 03:49:55,111 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5460.617688 2021-02-19 03:49:55,144 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:55,381 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4319.100000 2021-02-19 03:49:55,519 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4462.953295 2021-02-19 03:49:55,539 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8104.534067 2021-02-19 03:49:55,730 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4822.046095 2021-02-19 03:49:55,920 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:55,976 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:56,039 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:56,124 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4669.343866 2021-02-19 03:49:56,733 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5455.217688 2021-02-19 03:49:56,740 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:57,003 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4417.800000 2021-02-19 03:49:57,137 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4462.953295 2021-02-19 03:49:57,154 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8104.534067 2021-02-19 03:49:57,335 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4822.046095 2021-02-19 03:49:57,507 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:57,563 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:57,634 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:57,717 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4669.343866 2021-02-19 03:49:58,151 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.64:8091 2021-02-19 03:49:58,151 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 03:49:58,168 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.64:8091 is running 2021-02-19 03:49:58,170 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:49:58,325 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:58,342 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5455.217688 2021-02-19 03:49:58,576 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4417.800000 2021-02-19 03:49:58,627 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.458000183105. 2021-02-19 03:49:58,628 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:49:58,755 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8104.534067 2021-02-19 03:49:58,770 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4462.953295 2021-02-19 03:49:58,923 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4822.046095 2021-02-19 03:49:59,071 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.443000078201. 2021-02-19 03:49:59,071 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:49:59,122 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:49:59,207 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:49:59,243 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:49:59,312 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4669.343866 2021-02-19 03:49:59,513 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.442999839783. 2021-02-19 03:49:59,513 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:49:59,905 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:49:59,938 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5455.217688 2021-02-19 03:49:59,986 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.473000049591. 2021-02-19 03:49:59,986 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:50:00,161 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4417.800000 2021-02-19 03:50:00,365 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8075.793653 2021-02-19 03:50:00,375 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4533.090910 2021-02-19 03:50:00,424 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.43799996376. 2021-02-19 03:50:00,424 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:50:00,520 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4837.409851 2021-02-19 03:50:00,762 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:00,855 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:00,855 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:50:00,875 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.450000047684. 2021-02-19 03:50:00,875 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:50:00,910 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4660.407648 2021-02-19 03:50:01,325 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.450000047684. 2021-02-19 03:50:01,326 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:50:01,469 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:01,529 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5500.755521 2021-02-19 03:50:01,733 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4417.800000 2021-02-19 03:50:01,776 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.450000047684. 2021-02-19 03:50:01,776 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:50:01,969 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8075.793653 2021-02-19 03:50:02,000 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4533.090910 2021-02-19 03:50:02,111 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4837.409851 2021-02-19 03:50:02,239 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.462000131607. 2021-02-19 03:50:02,240 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:50:02,394 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:02,497 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:02,513 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:50:02,571 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4644.907648 2021-02-19 03:50:02,670 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.430000066757. 2021-02-19 03:50:02,690 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.65:8091 2021-02-19 03:50:02,690 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 03:50:02,709 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.65:8091 is running 2021-02-19 03:50:02,710 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:50:03,088 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:03,147 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.43799996376. 2021-02-19 03:50:03,147 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:50:03,184 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5536.955521 2021-02-19 03:50:03,348 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4398.300000 2021-02-19 03:50:03,591 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.444000005722. 2021-02-19 03:50:03,591 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:50:03,617 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7986.993653 2021-02-19 03:50:03,688 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4560.990910 2021-02-19 03:50:03,756 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4812.009851 2021-02-19 03:50:04,009 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.417999982834. 2021-02-19 03:50:04,009 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:50:04,039 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:04,207 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:04,230 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:50:04,239 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4644.907648 2021-02-19 03:50:04,436 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.427000045776. 2021-02-19 03:50:04,436 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:50:04,713 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:04,829 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5536.955521 2021-02-19 03:50:04,892 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.456999778748. 2021-02-19 03:50:04,892 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:50:04,979 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4398.300000 2021-02-19 03:50:05,269 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7986.993653 2021-02-19 03:50:05,345 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4560.990910 2021-02-19 03:50:05,357 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.464000225067. 2021-02-19 03:50:05,357 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:50:05,424 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4812.009851 2021-02-19 03:50:05,710 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:05,802 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.444999933243. 2021-02-19 03:50:05,802 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:50:05,905 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:05,911 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:50:05,926 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4644.907648 2021-02-19 03:50:06,232 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.430000066757. 2021-02-19 03:50:06,232 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:50:06,358 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:06,493 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5569.455521 2021-02-19 03:50:06,605 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4363.200000 2021-02-19 03:50:06,670 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.43799996376. 2021-02-19 03:50:06,671 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:50:06,937 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7859.093653 2021-02-19 03:50:06,999 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4587.890910 2021-02-19 03:50:07,072 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4809.409851 2021-02-19 03:50:07,128 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.457000017166. 2021-02-19 03:50:07,128 | test | INFO | MainThread | [Magma:abort_rebalance:927] Restarting Rebalance after killing at 20 2021-02-19 03:50:07,174 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[]_OUT=[172.23.110.69]_1613735407.13 2021-02-19 03:50:07,174 | infra | INFO | pool-1-thread-25 | [task:start_task:84] Thread 'Rebalance_task_IN=[]_OUT=[172.23.110.69]_1613735407.13' started 2021-02-19 03:50:07,191 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L932 2021-02-19 03:50:07,191 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 120 seconds. Reason: Let the rebalance begin after abort 2021-02-19 03:50:07,217 | test | DEBUG | pool-1-thread-25 | [task:start_rebalance:301] Removing node 172.23.110.69:8091 from cluster 2021-02-19 03:50:07,217 | test | DEBUG | pool-1-thread-25 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': u'ns_1@172.23.110.69', 'user': 'Administrator'} 2021-02-19 03:50:07,256 | test | DEBUG | pool-1-thread-25 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 03:50:07,263 | test | INFO | pool-1-thread-25 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+---------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 13.8359114389 | Cluster node | | 172.23.110.69 | kv | 7.0.0-4498-enterprise | 11.7775874896 | --- OUT ---> | | 172.23.110.65 | kv | 7.0.0-4498-enterprise | 14.1354583905 | Cluster node | +---------------+----------+-----------------------+---------------+--------------+ 2021-02-19 03:50:07,276 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 03:50:07,278 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 03:50:07,361 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:07,614 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:50:07,618 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:07,628 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4614.607648 2021-02-19 03:50:07,992 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:08,170 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5569.455521 2021-02-19 03:50:08,253 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4363.200000 2021-02-19 03:50:08,634 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7859.093653 2021-02-19 03:50:08,698 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4587.890910 2021-02-19 03:50:08,720 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4809.409851 2021-02-19 03:50:09,002 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:09,289 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:50:09,312 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4614.607648 2021-02-19 03:50:09,325 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:09,632 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:09,864 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5569.455521 2021-02-19 03:50:09,910 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4363.200000 2021-02-19 03:50:10,299 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7830.900000 2021-02-19 03:50:10,408 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4537.200000 2021-02-19 03:50:10,418 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4723.900000 2021-02-19 03:50:10,651 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:10,940 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:50:10,967 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4582.000000 2021-02-19 03:50:10,982 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:11,283 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:11,543 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5551.600000 2021-02-19 03:50:11,563 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4363.200000 2021-02-19 03:50:11,964 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7830.900000 2021-02-19 03:50:12,089 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4537.200000 2021-02-19 03:50:12,102 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4723.900000 2021-02-19 03:50:12,282 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:12,316 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 20.26 % 2021-02-19 03:50:12,318 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 20.2585618814 2021-02-19 03:50:12,565 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:50:12,588 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4562.000000 2021-02-19 03:50:12,598 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:12,891 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:13,176 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5548.800000 2021-02-19 03:50:13,197 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4346.100000 2021-02-19 03:50:13,578 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7809.000000 2021-02-19 03:50:13,733 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4495.000000 2021-02-19 03:50:13,750 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4520.000000 2021-02-19 03:50:13,890 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:14,203 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4562.000000 2021-02-19 03:50:14,223 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:50:14,263 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:14,489 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:14,809 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5548.800000 2021-02-19 03:50:14,818 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4346.100000 2021-02-19 03:50:15,203 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7809.000000 2021-02-19 03:50:15,367 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4495.000000 2021-02-19 03:50:15,381 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4520.000000 2021-02-19 03:50:15,507 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:15,835 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4562.000000 2021-02-19 03:50:15,855 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:50:15,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:16,105 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:16,441 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5543.500000 2021-02-19 03:50:16,450 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4354.800000 2021-02-19 03:50:16,858 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7752.600000 2021-02-19 03:50:17,003 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4450.900000 2021-02-19 03:50:17,019 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4068.400000 2021-02-19 03:50:17,140 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:17,352 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 20.66 % 2021-02-19 03:50:17,352 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 20.6565951851 2021-02-19 03:50:17,469 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4587.400000 2021-02-19 03:50:17,479 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:50:17,513 | infra | INFO | pool-2-thread-64 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' completed 2021-02-19 03:50:17,515 | infra | INFO | pool-2-thread-64 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:50:17,530 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:17,720 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:18,061 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5543.500000 2021-02-19 03:50:18,073 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4354.800000 2021-02-19 03:50:18,490 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7752.600000 2021-02-19 03:50:18,650 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4450.900000 2021-02-19 03:50:18,674 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4068.400000 2021-02-19 03:50:18,785 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:19,101 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4587.400000 2021-02-19 03:50:19,117 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:50:19,160 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:19,342 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:19,697 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5562.200000 2021-02-19 03:50:19,720 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4354.800000 2021-02-19 03:50:20,131 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7779.100000 2021-02-19 03:50:20,315 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3309.700000 2021-02-19 03:50:20,323 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4460.500000 2021-02-19 03:50:20,444 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:20,737 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4652.900000 2021-02-19 03:50:20,747 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 15.900000 2021-02-19 03:50:20,806 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:20,960 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:21,332 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4354.800000 2021-02-19 03:50:21,380 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5562.200000 2021-02-19 03:50:21,769 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7779.100000 2021-02-19 03:50:21,976 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4460.500000 2021-02-19 03:50:22,003 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3309.700000 2021-02-19 03:50:22,112 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:22,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4692.200000 2021-02-19 03:50:22,394 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 434.600000 2021-02-19 03:50:22,400 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 21.12 % 2021-02-19 03:50:22,401 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 21.1158257785 2021-02-19 03:50:22,450 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:22,589 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:22,947 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4391.500000 2021-02-19 03:50:23,006 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5602.900000 2021-02-19 03:50:23,400 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7893.800000 2021-02-19 03:50:23,611 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4453.800000 2021-02-19 03:50:23,655 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2556.300000 2021-02-19 03:50:23,766 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:24,020 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4692.200000 2021-02-19 03:50:24,039 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 434.600000 2021-02-19 03:50:24,081 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:24,210 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:24,571 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4391.500000 2021-02-19 03:50:24,644 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5602.900000 2021-02-19 03:50:25,035 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7893.800000 2021-02-19 03:50:25,243 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4453.800000 2021-02-19 03:50:25,292 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2556.300000 2021-02-19 03:50:25,423 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:25,655 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4675.000000 2021-02-19 03:50:25,661 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1254.500000 2021-02-19 03:50:25,713 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:25,815 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:26,223 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4416.100000 2021-02-19 03:50:26,276 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5624.300000 2021-02-19 03:50:26,683 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8045.500000 2021-02-19 03:50:26,885 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4413.200000 2021-02-19 03:50:26,923 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2000.800000 2021-02-19 03:50:27,056 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:27,289 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4675.000000 2021-02-19 03:50:27,301 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1254.500000 2021-02-19 03:50:27,329 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:27,441 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:27,444 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 21.55 % 2021-02-19 03:50:27,444 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 21.5477618476 2021-02-19 03:50:27,858 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4416.100000 2021-02-19 03:50:27,940 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5624.300000 2021-02-19 03:50:28,313 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8045.500000 2021-02-19 03:50:28,506 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4413.200000 2021-02-19 03:50:28,556 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2000.800000 2021-02-19 03:50:28,700 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:28,930 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1254.500000 2021-02-19 03:50:28,967 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4675.000000 2021-02-19 03:50:28,971 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:29,118 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:29,474 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4416.100000 2021-02-19 03:50:29,576 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5610.159105 2021-02-19 03:50:29,943 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8045.500000 2021-02-19 03:50:30,161 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4304.074328 2021-02-19 03:50:30,186 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1687.063890 2021-02-19 03:50:30,344 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:30,568 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2670.325102 2021-02-19 03:50:30,621 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:30,644 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4621.015553 2021-02-19 03:50:30,750 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:31,127 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4416.100000 2021-02-19 03:50:31,217 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5610.159105 2021-02-19 03:50:31,562 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8163.078873 2021-02-19 03:50:31,789 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4304.074328 2021-02-19 03:50:31,815 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1687.063890 2021-02-19 03:50:31,973 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:32,196 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2670.325102 2021-02-19 03:50:32,236 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:32,269 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4572.815553 2021-02-19 03:50:32,365 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:32,486 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 21.96 % 2021-02-19 03:50:32,486 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 21.9594284735 2021-02-19 03:50:32,766 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4369.300000 2021-02-19 03:50:32,888 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5585.759105 2021-02-19 03:50:33,219 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8176.078873 2021-02-19 03:50:33,424 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4198.474328 2021-02-19 03:50:33,480 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1499.563890 2021-02-19 03:50:33,627 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:33,806 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3677.925102 2021-02-19 03:50:33,885 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:33,937 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4572.815553 2021-02-19 03:50:33,990 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:34,371 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4369.300000 2021-02-19 03:50:34,539 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5585.759105 2021-02-19 03:50:34,832 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8176.078873 2021-02-19 03:50:35,056 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4198.474328 2021-02-19 03:50:35,105 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1499.563890 2021-02-19 03:50:35,246 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:35,414 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3677.925102 2021-02-19 03:50:35,507 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:35,559 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4541.615553 2021-02-19 03:50:35,608 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:35,997 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4369.300000 2021-02-19 03:50:36,174 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5570.459105 2021-02-19 03:50:36,470 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8202.278873 2021-02-19 03:50:36,694 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4138.474328 2021-02-19 03:50:36,750 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1327.063890 2021-02-19 03:50:36,858 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:37,053 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4299.825102 2021-02-19 03:50:37,128 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:37,190 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4541.615553 2021-02-19 03:50:37,224 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:37,530 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 22.39 % 2021-02-19 03:50:37,530 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 22.3914481826 2021-02-19 03:50:37,602 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4323.800000 2021-02-19 03:50:37,825 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5570.459105 2021-02-19 03:50:38,082 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8202.278873 2021-02-19 03:50:38,325 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4138.474328 2021-02-19 03:50:38,391 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1327.063890 2021-02-19 03:50:38,482 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:38,687 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4299.825102 2021-02-19 03:50:38,759 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:38,816 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4541.615553 2021-02-19 03:50:38,849 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:39,223 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4323.800000 2021-02-19 03:50:39,450 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5542.209821 2021-02-19 03:50:39,724 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8188.305756 2021-02-19 03:50:39,976 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4138.474328 2021-02-19 03:50:40,019 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1327.063890 2021-02-19 03:50:40,101 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:40,361 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4301.276494 2021-02-19 03:50:40,418 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:40,469 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4523.965032 2021-02-19 03:50:40,473 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:40,819 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4323.800000 2021-02-19 03:50:41,072 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5542.209821 2021-02-19 03:50:41,355 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8188.305756 2021-02-19 03:50:41,599 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4140.828261 2021-02-19 03:50:41,644 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1314.322094 2021-02-19 03:50:41,714 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:42,000 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4301.276494 2021-02-19 03:50:42,046 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:42,105 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:42,131 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4523.965032 2021-02-19 03:50:42,433 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4302.000000 2021-02-19 03:50:42,578 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 22.81 % 2021-02-19 03:50:42,578 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 22.806418929 2021-02-19 03:50:42,694 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5528.809821 2021-02-19 03:50:42,997 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8244.505756 2021-02-19 03:50:43,217 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4170.728261 2021-02-19 03:50:43,282 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1397.922094 2021-02-19 03:50:43,345 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:43,630 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4307.676494 2021-02-19 03:50:43,671 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:43,739 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:43,765 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4537.765032 2021-02-19 03:50:44,056 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4302.000000 2021-02-19 03:50:44,349 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5528.809821 2021-02-19 03:50:44,634 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8244.505756 2021-02-19 03:50:44,851 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4170.728261 2021-02-19 03:50:44,907 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1397.922094 2021-02-19 03:50:44,994 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:45,276 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4307.676494 2021-02-19 03:50:45,312 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:45,404 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4537.765032 2021-02-19 03:50:45,408 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:45,671 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4283.600000 2021-02-19 03:50:45,960 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5528.809821 2021-02-19 03:50:46,262 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8274.905756 2021-02-19 03:50:46,507 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4173.228261 2021-02-19 03:50:46,598 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1565.822094 2021-02-19 03:50:46,605 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:46,894 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4267.076494 2021-02-19 03:50:46,944 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:47,025 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:47,049 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4558.365032 2021-02-19 03:50:47,269 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4283.600000 2021-02-19 03:50:47,601 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5523.509821 2021-02-19 03:50:47,614 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 23.20 % 2021-02-19 03:50:47,615 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 23.1975107916 2021-02-19 03:50:47,915 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8274.905756 2021-02-19 03:50:48,164 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4173.228261 2021-02-19 03:50:48,220 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1565.822094 2021-02-19 03:50:48,282 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:48,552 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4267.076494 2021-02-19 03:50:48,605 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:48,641 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:48,750 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4558.365032 2021-02-19 03:50:48,862 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4283.600000 2021-02-19 03:50:49,226 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5523.509821 2021-02-19 03:50:49,579 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8344.300000 2021-02-19 03:50:49,805 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4173.228261 2021-02-19 03:50:49,868 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1565.822094 2021-02-19 03:50:49,908 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:50,171 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4249.000000 2021-02-19 03:50:50,232 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:50,259 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:50,384 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4586.500000 2021-02-19 03:50:50,479 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4283.600000 2021-02-19 03:50:50,851 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5553.200000 2021-02-19 03:50:51,204 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8344.300000 2021-02-19 03:50:51,437 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4160.400000 2021-02-19 03:50:51,490 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1535.700000 2021-02-19 03:50:51,519 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:51,790 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4249.000000 2021-02-19 03:50:51,846 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:51,871 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:52,019 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4586.500000 2021-02-19 03:50:52,088 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4283.600000 2021-02-19 03:50:52,492 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5587.300000 2021-02-19 03:50:52,655 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 23.59 % 2021-02-19 03:50:52,655 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 23.5921842147 2021-02-19 03:50:52,838 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8353.700000 2021-02-19 03:50:53,073 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4113.400000 2021-02-19 03:50:53,122 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1639.500000 2021-02-19 03:50:53,170 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:53,456 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4224.200000 2021-02-19 03:50:53,474 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:53,487 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:53,625 | infra | INFO | pool-2-thread-55 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' completed 2021-02-19 03:50:53,625 | infra | INFO | pool-2-thread-55 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:50:53,634 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4589.900000 2021-02-19 03:50:53,707 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4294.800000 2021-02-19 03:50:54,107 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5587.300000 2021-02-19 03:50:54,480 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8353.700000 2021-02-19 03:50:54,714 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4113.400000 2021-02-19 03:50:54,769 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1639.500000 2021-02-19 03:50:54,802 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:55,082 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4224.200000 2021-02-19 03:50:55,108 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:55,119 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:55,256 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4589.900000 2021-02-19 03:50:55,338 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4294.800000 2021-02-19 03:50:55,769 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5614.964626 2021-02-19 03:50:56,105 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8393.150315 2021-02-19 03:50:56,345 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4095.426765 2021-02-19 03:50:56,388 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1677.843633 2021-02-19 03:50:56,426 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:56,697 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4241.456007 2021-02-19 03:50:56,744 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:56,766 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:56,881 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4638.263078 2021-02-19 03:50:56,971 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4304.203436 2021-02-19 03:50:57,391 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5614.964626 2021-02-19 03:50:57,717 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 23.99 % 2021-02-19 03:50:57,717 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 23.9868855179 2021-02-19 03:50:57,736 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8393.150315 2021-02-19 03:50:57,996 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4095.426765 2021-02-19 03:50:58,062 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1677.843633 2021-02-19 03:50:58,089 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:58,319 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4241.456007 2021-02-19 03:50:58,349 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:50:58,403 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:50:58,535 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4638.263078 2021-02-19 03:50:58,588 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4304.203436 2021-02-19 03:50:58,997 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5614.964626 2021-02-19 03:50:59,342 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8393.150315 2021-02-19 03:50:59,632 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4068.226765 2021-02-19 03:50:59,687 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1685.343633 2021-02-19 03:50:59,717 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:50:59,957 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4241.456007 2021-02-19 03:50:59,970 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:00,013 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:00,154 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4643.763078 2021-02-19 03:51:00,210 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4304.203436 2021-02-19 03:51:00,634 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5547.964626 2021-02-19 03:51:00,963 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8335.950315 2021-02-19 03:51:01,286 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4068.226765 2021-02-19 03:51:01,339 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1685.343633 2021-02-19 03:51:01,401 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:01,569 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:01,588 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4751.456007 2021-02-19 03:51:01,654 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:01,796 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4643.763078 2021-02-19 03:51:01,845 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4304.203436 2021-02-19 03:51:02,256 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5482.464626 2021-02-19 03:51:02,576 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8297.950315 2021-02-19 03:51:02,762 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 24.37 % 2021-02-19 03:51:02,762 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 24.3712854994 2021-02-19 03:51:02,930 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4088.326765 2021-02-19 03:51:02,992 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1689.243633 2021-02-19 03:51:03,023 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:03,210 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:03,223 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5654.856007 2021-02-19 03:51:03,285 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:03,457 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4642.863078 2021-02-19 03:51:03,476 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4323.403436 2021-02-19 03:51:03,894 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5482.464626 2021-02-19 03:51:04,203 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8297.950315 2021-02-19 03:51:04,569 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4088.326765 2021-02-19 03:51:04,644 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1689.243633 2021-02-19 03:51:04,674 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:04,842 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:04,868 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5654.856007 2021-02-19 03:51:04,924 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:05,076 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4642.863078 2021-02-19 03:51:05,101 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4323.403436 2021-02-19 03:51:05,506 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5435.574417 2021-02-19 03:51:05,838 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8297.950315 2021-02-19 03:51:06,198 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4091.377200 2021-02-19 03:51:06,286 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1635.686743 2021-02-19 03:51:06,299 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:06,477 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:06,512 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6917.885932 2021-02-19 03:51:06,559 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:06,710 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4578.052668 2021-02-19 03:51:06,732 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4345.825713 2021-02-19 03:51:07,157 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5435.574417 2021-02-19 03:51:07,490 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8208.333183 2021-02-19 03:51:07,806 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 24.74 % 2021-02-19 03:51:07,808 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 24.7420242787 2021-02-19 03:51:07,890 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4091.377200 2021-02-19 03:51:07,947 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:07,987 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1635.686743 2021-02-19 03:51:08,101 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:08,170 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6917.885932 2021-02-19 03:51:08,201 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:08,371 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4345.825713 2021-02-19 03:51:08,381 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4578.052668 2021-02-19 03:51:08,779 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5435.574417 2021-02-19 03:51:09,112 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8208.333183 2021-02-19 03:51:09,563 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4097.077200 2021-02-19 03:51:09,651 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:09,668 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1553.386743 2021-02-19 03:51:09,743 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:09,803 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7690.585932 2021-02-19 03:51:09,828 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:10,015 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4345.825713 2021-02-19 03:51:10,038 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4578.052668 2021-02-19 03:51:10,407 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5457.074417 2021-02-19 03:51:10,737 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8164.533183 2021-02-19 03:51:11,188 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4097.077200 2021-02-19 03:51:11,288 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:11,321 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1553.386743 2021-02-19 03:51:11,369 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:11,516 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7690.585932 2021-02-19 03:51:11,519 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:11,645 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4345.825713 2021-02-19 03:51:11,670 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4517.352668 2021-02-19 03:51:12,023 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5457.074417 2021-02-19 03:51:12,377 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8115.733183 2021-02-19 03:51:12,825 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4075.377200 2021-02-19 03:51:12,858 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 25.16 % 2021-02-19 03:51:12,858 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 25.1570229051 2021-02-19 03:51:12,911 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:12,974 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1540.286743 2021-02-19 03:51:12,984 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:13,157 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8090.085932 2021-02-19 03:51:13,168 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:13,276 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4300.225713 2021-02-19 03:51:13,299 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4459.252668 2021-02-19 03:51:13,667 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5453.274417 2021-02-19 03:51:13,983 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8115.733183 2021-02-19 03:51:14,448 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4075.377200 2021-02-19 03:51:14,556 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:14,625 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1540.286743 2021-02-19 03:51:14,638 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:14,796 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8090.085932 2021-02-19 03:51:14,813 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:14,921 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4300.225713 2021-02-19 03:51:14,931 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4459.252668 2021-02-19 03:51:15,286 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5453.274417 2021-02-19 03:51:15,657 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8050.300000 2021-02-19 03:51:16,078 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4075.377200 2021-02-19 03:51:16,226 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:16,266 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:16,296 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1629.700000 2021-02-19 03:51:16,434 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8079.300000 2021-02-19 03:51:16,447 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:16,532 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4222.100000 2021-02-19 03:51:16,559 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4397.700000 2021-02-19 03:51:16,934 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5438.100000 2021-02-19 03:51:17,266 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8050.300000 2021-02-19 03:51:17,711 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4037.300000 2021-02-19 03:51:17,871 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:17,884 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:17,934 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 25.53 % 2021-02-19 03:51:17,934 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 25.5277616844 2021-02-19 03:51:17,951 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1629.700000 2021-02-19 03:51:18,115 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:18,125 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8079.300000 2021-02-19 03:51:18,147 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4222.100000 2021-02-19 03:51:18,198 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4397.700000 2021-02-19 03:51:18,562 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5438.100000 2021-02-19 03:51:18,911 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8050.300000 2021-02-19 03:51:19,319 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4037.300000 2021-02-19 03:51:19,493 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:19,502 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:19,592 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1613.200000 2021-02-19 03:51:19,746 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:19,785 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8053.800000 2021-02-19 03:51:19,805 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4222.100000 2021-02-19 03:51:19,828 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4397.700000 2021-02-19 03:51:20,190 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5440.700000 2021-02-19 03:51:20,529 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7995.900000 2021-02-19 03:51:20,931 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4025.000000 2021-02-19 03:51:21,127 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:21,141 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:21,233 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1613.200000 2021-02-19 03:51:21,377 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:21,415 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8053.800000 2021-02-19 03:51:21,434 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4222.100000 2021-02-19 03:51:21,453 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4367.500000 2021-02-19 03:51:21,816 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5440.700000 2021-02-19 03:51:22,151 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7995.900000 2021-02-19 03:51:22,545 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4013.400000 2021-02-19 03:51:22,760 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:22,770 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:22,878 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1603.600000 2021-02-19 03:51:22,983 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 25.90 % 2021-02-19 03:51:22,983 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 25.8987500238 2021-02-19 03:51:22,993 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:23,059 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8029.000000 2021-02-19 03:51:23,065 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4194.900000 2021-02-19 03:51:23,115 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4378.800000 2021-02-19 03:51:23,467 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5448.700000 2021-02-19 03:51:23,773 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7966.700000 2021-02-19 03:51:24,161 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4013.400000 2021-02-19 03:51:24,388 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:24,451 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:24,497 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1603.600000 2021-02-19 03:51:24,601 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:24,711 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8029.000000 2021-02-19 03:51:24,717 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4194.900000 2021-02-19 03:51:24,785 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4378.800000 2021-02-19 03:51:25,114 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5448.700000 2021-02-19 03:51:25,384 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7966.700000 2021-02-19 03:51:25,779 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4023.200000 2021-02-19 03:51:26,072 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:26,101 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:26,148 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1503.200000 2021-02-19 03:51:26,237 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:26,357 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4207.900000 2021-02-19 03:51:26,371 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8005.400000 2021-02-19 03:51:26,436 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4414.100000 2021-02-19 03:51:26,747 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5435.300000 2021-02-19 03:51:27,006 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7962.400000 2021-02-19 03:51:27,397 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4023.200000 2021-02-19 03:51:27,713 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:27,733 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:27,767 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1503.200000 2021-02-19 03:51:27,898 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:27,976 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4207.900000 2021-02-19 03:51:28,005 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8005.400000 2021-02-19 03:51:28,033 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 26.29 % 2021-02-19 03:51:28,035 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 26.2863983658 2021-02-19 03:51:28,069 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4414.100000 2021-02-19 03:51:28,358 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5435.300000 2021-02-19 03:51:28,615 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7962.400000 2021-02-19 03:51:29,016 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4023.200000 2021-02-19 03:51:29,371 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:29,407 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:29,457 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1434.822431 2021-02-19 03:51:29,566 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:29,617 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4207.900000 2021-02-19 03:51:29,676 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7999.333507 2021-02-19 03:51:29,726 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4410.718792 2021-02-19 03:51:29,969 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5435.300000 2021-02-19 03:51:30,246 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7960.642103 2021-02-19 03:51:30,628 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4013.966613 2021-02-19 03:51:30,986 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:31,085 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1434.822431 2021-02-19 03:51:31,098 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:31,239 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:31,260 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4207.900000 2021-02-19 03:51:31,306 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7999.333507 2021-02-19 03:51:31,351 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4410.718792 2021-02-19 03:51:31,578 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5418.581128 2021-02-19 03:51:31,869 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7960.642103 2021-02-19 03:51:32,243 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4013.966613 2021-02-19 03:51:32,588 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:32,726 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:32,740 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1419.822431 2021-02-19 03:51:32,890 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4202.000000 2021-02-19 03:51:32,913 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:32,937 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7972.633507 2021-02-19 03:51:33,029 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4413.818792 2021-02-19 03:51:33,082 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 26.67 % 2021-02-19 03:51:33,082 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 26.6707983473 2021-02-19 03:51:33,200 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5390.981128 2021-02-19 03:51:33,486 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7965.142103 2021-02-19 03:51:33,855 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4008.366613 2021-02-19 03:51:34,203 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:34,371 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:34,407 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1419.822431 2021-02-19 03:51:34,545 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4202.000000 2021-02-19 03:51:34,555 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:34,605 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7972.633507 2021-02-19 03:51:34,667 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4413.818792 2021-02-19 03:51:34,823 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5390.981128 2021-02-19 03:51:35,125 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7965.142103 2021-02-19 03:51:35,473 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4005.166613 2021-02-19 03:51:35,798 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:36,028 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:36,042 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1419.822431 2021-02-19 03:51:36,191 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:36,213 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4227.600000 2021-02-19 03:51:36,246 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8004.533507 2021-02-19 03:51:36,328 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4413.218792 2021-02-19 03:51:36,466 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5371.881128 2021-02-19 03:51:36,757 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7998.742103 2021-02-19 03:51:37,096 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4005.166613 2021-02-19 03:51:37,395 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:37,644 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:37,703 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1503.522431 2021-02-19 03:51:37,799 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:37,835 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4227.600000 2021-02-19 03:51:37,881 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8004.533507 2021-02-19 03:51:37,986 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4413.218792 2021-02-19 03:51:38,125 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5371.881128 2021-02-19 03:51:38,131 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 27.07 % 2021-02-19 03:51:38,131 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 27.068803771 2021-02-19 03:51:38,371 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7998.742103 2021-02-19 03:51:38,736 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4005.166613 2021-02-19 03:51:39,017 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:39,263 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:39,342 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1503.522431 2021-02-19 03:51:39,418 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:39,473 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4227.600000 2021-02-19 03:51:39,507 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8028.969067 2021-02-19 03:51:39,625 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4489.452925 2021-02-19 03:51:39,756 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5356.578188 2021-02-19 03:51:39,984 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7998.742103 2021-02-19 03:51:40,023 | infra | INFO | pool-2-thread-39 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.33' completed 2021-02-19 03:51:40,023 | infra | INFO | pool-2-thread-39 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:51:40,384 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4014.234253 2021-02-19 03:51:40,625 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:40,936 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:41,032 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1455.814621 2021-02-19 03:51:41,049 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:41,105 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4227.600000 2021-02-19 03:51:41,135 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8028.969067 2021-02-19 03:51:41,256 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4489.452925 2021-02-19 03:51:41,380 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5356.578188 2021-02-19 03:51:41,628 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8064.071007 2021-02-19 03:51:42,006 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4014.234253 2021-02-19 03:51:42,246 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:42,572 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:42,681 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:42,703 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1511.414621 2021-02-19 03:51:42,743 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4235.500000 2021-02-19 03:51:42,769 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8070.469067 2021-02-19 03:51:42,888 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4505.452925 2021-02-19 03:51:43,013 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5341.878188 2021-02-19 03:51:43,176 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 27.44 % 2021-02-19 03:51:43,176 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 27.4362105498 2021-02-19 03:51:43,233 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8094.971007 2021-02-19 03:51:43,621 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4089.034253 2021-02-19 03:51:43,852 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:44,200 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:44,315 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:44,355 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1511.414621 2021-02-19 03:51:44,397 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4235.500000 2021-02-19 03:51:44,440 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8070.469067 2021-02-19 03:51:44,565 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4505.452925 2021-02-19 03:51:44,640 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5341.878188 2021-02-19 03:51:44,877 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8094.971007 2021-02-19 03:51:45,239 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4089.034253 2021-02-19 03:51:45,420 | infra | INFO | pool-2-thread-27 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.31' completed 2021-02-19 03:51:45,420 | infra | INFO | pool-2-thread-27 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:51:45,461 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:45,845 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:45,957 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:46,052 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4235.500000 2021-02-19 03:51:46,079 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1511.414621 2021-02-19 03:51:46,117 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8070.469067 2021-02-19 03:51:46,190 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4506.752925 2021-02-19 03:51:46,262 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5313.078188 2021-02-19 03:51:46,519 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8075.871007 2021-02-19 03:51:46,869 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4483.134253 2021-02-19 03:51:47,069 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:47,483 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:47,621 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:47,709 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4150.900000 2021-02-19 03:51:47,752 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8059.369067 2021-02-19 03:51:47,765 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1481.314621 2021-02-19 03:51:47,848 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4506.752925 2021-02-19 03:51:47,940 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5313.078188 2021-02-19 03:51:48,164 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8075.871007 2021-02-19 03:51:48,214 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 27.80 % 2021-02-19 03:51:48,214 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 27.8035615686 2021-02-19 03:51:48,493 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4483.134253 2021-02-19 03:51:48,677 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:49,161 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:49,292 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:49,349 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4150.900000 2021-02-19 03:51:49,395 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1456.936551 2021-02-19 03:51:49,404 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7949.674292 2021-02-19 03:51:49,490 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4353.112684 2021-02-19 03:51:49,605 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5220.006642 2021-02-19 03:51:49,795 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7927.168411 2021-02-19 03:51:50,121 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5337.659118 2021-02-19 03:51:50,147 | infra | INFO | pool-2-thread-16 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.26' completed 2021-02-19 03:51:50,148 | infra | INFO | pool-2-thread-16 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:51:50,290 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:50,828 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:50,967 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:51,006 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4150.900000 2021-02-19 03:51:51,062 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1456.936551 2021-02-19 03:51:51,068 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7949.674292 2021-02-19 03:51:51,141 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4353.112684 2021-02-19 03:51:51,286 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5220.006642 2021-02-19 03:51:51,414 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7927.168411 2021-02-19 03:51:51,739 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5337.659118 2021-02-19 03:51:51,892 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:52,476 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:52,601 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:52,651 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3965.600000 2021-02-19 03:51:52,716 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7780.874292 2021-02-19 03:51:52,740 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1465.736551 2021-02-19 03:51:52,828 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4173.912684 2021-02-19 03:51:52,921 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5051.306642 2021-02-19 03:51:53,059 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7723.668411 2021-02-19 03:51:53,282 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 28.12 % 2021-02-19 03:51:53,282 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 28.1234322597 2021-02-19 03:51:53,362 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6366.259118 2021-02-19 03:51:53,529 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:54,085 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:54,230 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:54,305 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3965.600000 2021-02-19 03:51:54,352 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7780.874292 2021-02-19 03:51:54,407 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1465.736551 2021-02-19 03:51:54,459 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4173.912684 2021-02-19 03:51:54,555 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5051.306642 2021-02-19 03:51:54,710 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7723.668411 2021-02-19 03:51:54,994 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6366.259118 2021-02-19 03:51:55,144 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:55,740 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:55,867 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:55,937 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3965.600000 2021-02-19 03:51:56,026 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7780.874292 2021-02-19 03:51:56,086 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1465.736551 2021-02-19 03:51:56,118 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4173.912684 2021-02-19 03:51:56,197 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4902.306642 2021-02-19 03:51:56,362 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7545.168411 2021-02-19 03:51:56,644 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7078.159118 2021-02-19 03:51:56,763 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:57,355 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:57,494 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:57,516 | infra | INFO | pool-2-thread-13 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.24' completed 2021-02-19 03:51:57,516 | infra | INFO | pool-2-thread-13 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:51:57,516 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 15 docs from 0 to 1000000 2021-02-19 03:51:57,517 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 19 docs from 0 to 1000000 2021-02-19 03:51:57,517 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 33 docs from 0 to 1000000 2021-02-19 03:51:57,517 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 12 docs from 0 to 1000000 2021-02-19 03:51:57,517 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 5 docs from 0 to 1000000 2021-02-19 03:51:57,572 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3765.000000 2021-02-19 03:51:57,674 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7534.074292 2021-02-19 03:51:57,759 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1544.636551 2021-02-19 03:51:57,763 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4003.312684 2021-02-19 03:51:57,865 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4902.306642 2021-02-19 03:51:57,997 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7545.168411 2021-02-19 03:51:58,299 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7078.159118 2021-02-19 03:51:58,338 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 28.49 % 2021-02-19 03:51:58,338 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 28.4941710391 2021-02-19 03:51:58,371 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:51:59,015 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:51:59,122 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:51:59,250 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3765.000000 2021-02-19 03:51:59,388 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7534.074292 2021-02-19 03:51:59,456 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1514.163455 2021-02-19 03:51:59,457 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3906.888325 2021-02-19 03:51:59,506 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4779.573571 2021-02-19 03:51:59,627 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7477.402559 2021-02-19 03:51:59,930 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7078.159118 2021-02-19 03:51:59,992 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:00,642 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:00,759 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:52:00,882 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3765.000000 2021-02-19 03:52:01,028 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7168.813715 2021-02-19 03:52:01,105 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1514.163455 2021-02-19 03:52:01,121 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3906.888325 2021-02-19 03:52:01,171 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4779.573571 2021-02-19 03:52:01,282 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7477.402559 2021-02-19 03:52:01,576 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7314.126789 2021-02-19 03:52:01,605 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:02,283 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:02,414 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:52:02,507 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3595.600000 2021-02-19 03:52:02,657 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6783.113715 2021-02-19 03:52:02,753 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3870.488325 2021-02-19 03:52:02,795 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1496.563455 2021-02-19 03:52:02,839 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4755.873571 2021-02-19 03:52:02,940 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7491.402559 2021-02-19 03:52:03,210 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7357.026789 2021-02-19 03:52:03,226 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:03,384 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 28.86 % 2021-02-19 03:52:03,384 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 28.8649376984 2021-02-19 03:52:03,536 | infra | INFO | pool-2-thread-24 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.3' completed 2021-02-19 03:52:03,536 | infra | INFO | pool-2-thread-24 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:52:03,920 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:04,059 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:52:04,178 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3595.600000 2021-02-19 03:52:04,302 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6783.113715 2021-02-19 03:52:04,398 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3870.488325 2021-02-19 03:52:04,457 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1496.563455 2021-02-19 03:52:04,496 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4755.873571 2021-02-19 03:52:04,596 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7491.402559 2021-02-19 03:52:04,855 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:04,881 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7357.026789 2021-02-19 03:52:05,546 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:05,704 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:52:05,788 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3449.500000 2021-02-19 03:52:05,931 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6783.113715 2021-02-19 03:52:06,042 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3870.488325 2021-02-19 03:52:06,095 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1496.563455 2021-02-19 03:52:06,128 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4755.873571 2021-02-19 03:52:06,237 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7517.302559 2021-02-19 03:52:06,463 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:06,532 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7382.226789 2021-02-19 03:52:07,161 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:07,204 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 29.10 % 2021-02-19 03:52:07,206 | test | INFO | MainThread | [Magma:abort_rebalance:933] Rebalance % = 29.1028411765 2021-02-19 03:52:07,223 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 29.12 % 2021-02-19 03:52:07,239 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:52:07,240 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:52:07,311 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:52:07,400 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3449.500000 2021-02-19 03:52:07,565 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6488.013715 2021-02-19 03:52:07,687 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3831.888325 2021-02-19 03:52:07,723 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1444.763455 2021-02-19 03:52:07,763 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4743.073571 2021-02-19 03:52:07,867 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7517.302559 2021-02-19 03:52:08,072 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:08,196 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7382.226789 2021-02-19 03:52:08,440 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 29.21 % 2021-02-19 03:52:08,440 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 29.2149901944 2021-02-19 03:52:08,819 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:08,956 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:52:09,068 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3449.500000 2021-02-19 03:52:09,197 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6488.013715 2021-02-19 03:52:09,252 | infra | INFO | pool-2-thread-46 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.34' completed 2021-02-19 03:52:09,252 | infra | INFO | pool-2-thread-46 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:52:09,361 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3831.888325 2021-02-19 03:52:09,437 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1444.763455 2021-02-19 03:52:09,438 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4775.759876 2021-02-19 03:52:09,536 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7553.953025 2021-02-19 03:52:09,676 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:09,822 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7467.651845 2021-02-19 03:52:10,448 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:10,621 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:52:10,700 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3449.500000 2021-02-19 03:52:10,834 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6503.523122 2021-02-19 03:52:11,039 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3781.022832 2021-02-19 03:52:11,095 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1407.105371 2021-02-19 03:52:11,138 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4775.759876 2021-02-19 03:52:11,193 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7553.953025 2021-02-19 03:52:11,299 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:11,480 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7467.651845 2021-02-19 03:52:12,066 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:12,289 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:52:12,334 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3405.300000 2021-02-19 03:52:12,469 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6564.723122 2021-02-19 03:52:12,687 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3741.922832 2021-02-19 03:52:12,720 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1565.305371 2021-02-19 03:52:12,789 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4783.259876 2021-02-19 03:52:12,819 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7560.553025 2021-02-19 03:52:12,904 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:13,084 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7505.051845 2021-02-19 03:52:13,486 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 29.52 % 2021-02-19 03:52:13,486 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 29.5241413639 2021-02-19 03:52:13,671 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:13,933 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:52:13,960 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3405.300000 2021-02-19 03:52:14,147 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6564.723122 2021-02-19 03:52:14,326 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3741.922832 2021-02-19 03:52:14,417 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1565.305371 2021-02-19 03:52:14,487 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7560.553025 2021-02-19 03:52:14,513 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4783.259876 2021-02-19 03:52:14,543 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:14,729 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7505.051845 2021-02-19 03:52:15,289 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:15,572 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:52:15,585 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3364.100000 2021-02-19 03:52:15,782 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6645.323122 2021-02-19 03:52:15,976 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3741.922832 2021-02-19 03:52:16,062 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1565.305371 2021-02-19 03:52:16,134 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7560.553025 2021-02-19 03:52:16,178 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4783.259876 2021-02-19 03:52:16,206 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:16,354 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7570.451845 2021-02-19 03:52:16,918 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:17,184 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:52:17,219 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3364.100000 2021-02-19 03:52:17,257 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 29.75 % 2021-02-19 03:52:17,272 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:52:17,272 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:52:17,413 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6645.323122 2021-02-19 03:52:17,625 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3694.322832 2021-02-19 03:52:17,729 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1683.005371 2021-02-19 03:52:17,788 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7526.753025 2021-02-19 03:52:17,845 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4734.759876 2021-02-19 03:52:17,848 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:18,007 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7570.451845 2021-02-19 03:52:18,371 | infra | INFO | pool-2-thread-14 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 03:52:18,371 | infra | INFO | pool-2-thread-14 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:52:18,529 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:18,539 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 29.85 % 2021-02-19 03:52:18,539 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 29.8503401361 2021-02-19 03:52:18,799 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:52:18,845 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3364.100000 2021-02-19 03:52:19,046 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6645.323122 2021-02-19 03:52:19,303 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3694.322832 2021-02-19 03:52:19,384 | infra | INFO | pool-2-thread-42 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 03:52:19,384 | infra | INFO | pool-2-thread-42 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:52:19,387 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1683.005371 2021-02-19 03:52:19,489 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7433.400000 2021-02-19 03:52:19,505 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:19,526 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4608.800000 2021-02-19 03:52:19,658 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7566.800000 2021-02-19 03:52:20,141 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:20,446 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:52:20,506 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3364.100000 2021-02-19 03:52:20,686 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6513.400000 2021-02-19 03:52:20,943 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3680.100000 2021-02-19 03:52:21,026 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1644.300000 2021-02-19 03:52:21,148 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:21,180 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7433.400000 2021-02-19 03:52:21,207 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4608.800000 2021-02-19 03:52:21,292 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7566.800000 2021-02-19 03:52:21,772 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:22,091 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:52:22,128 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3364.100000 2021-02-19 03:52:22,316 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6415.900000 2021-02-19 03:52:22,555 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3658.700000 2021-02-19 03:52:22,667 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1406.800000 2021-02-19 03:52:22,816 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:22,845 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7234.800000 2021-02-19 03:52:22,855 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4498.200000 2021-02-19 03:52:22,924 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7560.300000 2021-02-19 03:52:23,385 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:23,578 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 30.00 % 2021-02-19 03:52:23,579 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 30.0 2021-02-19 03:52:23,710 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 403.500000 2021-02-19 03:52:23,743 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3297.600000 2021-02-19 03:52:23,944 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6415.900000 2021-02-19 03:52:24,201 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3658.700000 2021-02-19 03:52:24,311 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1406.800000 2021-02-19 03:52:24,448 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:24,496 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7234.800000 2021-02-19 03:52:24,520 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4498.200000 2021-02-19 03:52:24,559 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7560.300000 2021-02-19 03:52:24,993 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:25,332 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 403.500000 2021-02-19 03:52:25,371 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3297.600000 2021-02-19 03:52:25,566 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6272.700000 2021-02-19 03:52:25,859 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3636.600000 2021-02-19 03:52:25,938 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1406.800000 2021-02-19 03:52:26,069 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:26,128 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7234.800000 2021-02-19 03:52:26,174 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4498.200000 2021-02-19 03:52:26,197 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7495.400000 2021-02-19 03:52:26,630 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:26,967 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1504.300000 2021-02-19 03:52:27,036 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3287.100000 2021-02-19 03:52:27,200 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6272.700000 2021-02-19 03:52:27,282 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 30.00 % 2021-02-19 03:52:27,298 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:52:27,298 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:52:27,513 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3636.600000 2021-02-19 03:52:27,573 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1509.600000 2021-02-19 03:52:27,717 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:27,798 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6743.700000 2021-02-19 03:52:27,828 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4415.400000 2021-02-19 03:52:27,851 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7495.400000 2021-02-19 03:52:28,247 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:28,605 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1504.300000 2021-02-19 03:52:28,625 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 30.00 % 2021-02-19 03:52:28,627 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 30.0 2021-02-19 03:52:28,663 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3287.100000 2021-02-19 03:52:28,825 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6272.700000 2021-02-19 03:52:29,193 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3636.600000 2021-02-19 03:52:29,237 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1509.600000 2021-02-19 03:52:29,359 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:29,483 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5788.629073 2021-02-19 03:52:29,513 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4343.258946 2021-02-19 03:52:29,523 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7476.706230 2021-02-19 03:52:29,871 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:30,226 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3695.693770 2021-02-19 03:52:30,308 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3287.100000 2021-02-19 03:52:30,463 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6245.085304 2021-02-19 03:52:30,841 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3552.292332 2021-02-19 03:52:30,890 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1494.600000 2021-02-19 03:52:30,986 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:31,141 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5788.629073 2021-02-19 03:52:31,194 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4343.258946 2021-02-19 03:52:31,213 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7476.706230 2021-02-19 03:52:31,502 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:31,851 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3695.693770 2021-02-19 03:52:31,950 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3287.100000 2021-02-19 03:52:32,098 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6245.085304 2021-02-19 03:52:32,505 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3454.892332 2021-02-19 03:52:32,523 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2998.500000 2021-02-19 03:52:32,601 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:32,766 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4741.929073 2021-02-19 03:52:32,877 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4213.458946 2021-02-19 03:52:32,878 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7421.806230 2021-02-19 03:52:33,125 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:33,477 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5752.793770 2021-02-19 03:52:33,559 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3152.700000 2021-02-19 03:52:33,684 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 30.03 % 2021-02-19 03:52:33,686 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 30.0260798883 2021-02-19 03:52:33,730 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6126.985304 2021-02-19 03:52:34,161 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2998.500000 2021-02-19 03:52:34,184 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3454.892332 2021-02-19 03:52:34,246 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:34,404 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4741.929073 2021-02-19 03:52:34,553 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7421.806230 2021-02-19 03:52:34,555 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4213.458946 2021-02-19 03:52:34,744 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:35,095 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5752.793770 2021-02-19 03:52:35,190 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3152.700000 2021-02-19 03:52:35,372 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6126.985304 2021-02-19 03:52:35,786 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4267.900000 2021-02-19 03:52:35,818 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3365.992332 2021-02-19 03:52:35,867 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:36,051 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4741.929073 2021-02-19 03:52:36,191 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7337.006230 2021-02-19 03:52:36,201 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4030.558946 2021-02-19 03:52:36,358 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:36,743 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7028.293770 2021-02-19 03:52:36,805 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2983.000000 2021-02-19 03:52:36,980 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5999.785304 2021-02-19 03:52:37,309 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 30.24 % 2021-02-19 03:52:37,322 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:52:37,323 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:52:37,437 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4267.900000 2021-02-19 03:52:37,456 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3365.992332 2021-02-19 03:52:37,502 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:37,697 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3979.629073 2021-02-19 03:52:37,865 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7337.006230 2021-02-19 03:52:37,875 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4030.558946 2021-02-19 03:52:38,007 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:38,374 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7028.293770 2021-02-19 03:52:38,473 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2983.000000 2021-02-19 03:52:38,609 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5999.785304 2021-02-19 03:52:38,743 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 30.32 % 2021-02-19 03:52:38,744 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 30.3193224665 2021-02-19 03:52:39,059 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4267.900000 2021-02-19 03:52:39,102 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3365.992332 2021-02-19 03:52:39,119 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:39,325 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3979.629073 2021-02-19 03:52:39,530 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3553.907599 2021-02-19 03:52:39,536 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7146.769413 2021-02-19 03:52:39,628 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:40,038 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7028.293770 2021-02-19 03:52:40,160 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2983.000000 2021-02-19 03:52:40,275 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5860.206789 2021-02-19 03:52:40,678 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4267.900000 2021-02-19 03:52:40,730 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:40,782 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3359.887631 2021-02-19 03:52:40,982 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3662.683512 2021-02-19 03:52:41,177 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3553.907599 2021-02-19 03:52:41,190 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7146.769413 2021-02-19 03:52:41,262 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:41,665 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7192.664424 2021-02-19 03:52:41,782 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2983.000000 2021-02-19 03:52:41,881 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5860.206789 2021-02-19 03:52:42,302 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4335.800000 2021-02-19 03:52:42,358 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:42,411 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3349.887631 2021-02-19 03:52:42,631 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3534.183512 2021-02-19 03:52:42,801 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2880.407599 2021-02-19 03:52:42,825 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6992.169413 2021-02-19 03:52:42,881 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:43,312 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7073.964424 2021-02-19 03:52:43,408 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3035.300000 2021-02-19 03:52:43,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5850.906789 2021-02-19 03:52:43,819 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 30.64 % 2021-02-19 03:52:43,821 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 30.6418587253 2021-02-19 03:52:43,928 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4335.800000 2021-02-19 03:52:43,990 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:44,072 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3349.887631 2021-02-19 03:52:44,295 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3534.183512 2021-02-19 03:52:44,470 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2880.407599 2021-02-19 03:52:44,513 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6992.169413 2021-02-19 03:52:44,555 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:44,938 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7073.964424 2021-02-19 03:52:45,059 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3035.300000 2021-02-19 03:52:45,144 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5850.906789 2021-02-19 03:52:45,555 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4433.100000 2021-02-19 03:52:45,618 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:45,726 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3361.787631 2021-02-19 03:52:45,927 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3534.183512 2021-02-19 03:52:46,170 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2880.407599 2021-02-19 03:52:46,183 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6992.169413 2021-02-19 03:52:46,236 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:46,592 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7087.164424 2021-02-19 03:52:46,670 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3134.700000 2021-02-19 03:52:46,770 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5967.806789 2021-02-19 03:52:47,173 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4433.100000 2021-02-19 03:52:47,223 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:47,348 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 30.86 % 2021-02-19 03:52:47,355 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3361.787631 2021-02-19 03:52:47,365 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:52:47,365 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:52:47,549 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3497.783512 2021-02-19 03:52:47,802 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2113.807599 2021-02-19 03:52:47,819 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6975.269413 2021-02-19 03:52:47,861 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:48,210 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7087.164424 2021-02-19 03:52:48,292 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3134.700000 2021-02-19 03:52:48,407 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5967.806789 2021-02-19 03:52:48,826 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4433.100000 2021-02-19 03:52:48,858 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:48,875 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 30.95 % 2021-02-19 03:52:48,875 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 30.9481348774 2021-02-19 03:52:49,006 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3361.787631 2021-02-19 03:52:49,187 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3497.783512 2021-02-19 03:52:49,463 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1672.465331 2021-02-19 03:52:49,470 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7034.229659 2021-02-19 03:52:49,490 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:49,861 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7099.436072 2021-02-19 03:52:49,917 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3134.700000 2021-02-19 03:52:50,038 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5967.806789 2021-02-19 03:52:50,490 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4433.100000 2021-02-19 03:52:50,499 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:50,648 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3398.220240 2021-02-19 03:52:50,811 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3531.296794 2021-02-19 03:52:51,108 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1672.465331 2021-02-19 03:52:51,131 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:51,145 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7034.229659 2021-02-19 03:52:51,513 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7099.436072 2021-02-19 03:52:51,549 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3134.700000 2021-02-19 03:52:51,677 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6093.114830 2021-02-19 03:52:52,125 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:52,138 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4433.100000 2021-02-19 03:52:52,272 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3476.220240 2021-02-19 03:52:52,457 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3623.896794 2021-02-19 03:52:52,743 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1520.665331 2021-02-19 03:52:52,759 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:52,788 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7184.629659 2021-02-19 03:52:53,201 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7216.636072 2021-02-19 03:52:53,234 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3176.500000 2021-02-19 03:52:53,323 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6207.214830 2021-02-19 03:52:53,746 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:53,812 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4537.900000 2021-02-19 03:52:53,940 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 31.29 % 2021-02-19 03:52:53,940 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 31.2869694644 2021-02-19 03:52:53,948 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3476.220240 2021-02-19 03:52:54,073 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3623.896794 2021-02-19 03:52:54,361 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1520.665331 2021-02-19 03:52:54,410 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:54,420 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7184.629659 2021-02-19 03:52:54,829 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7216.636072 2021-02-19 03:52:54,855 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3176.500000 2021-02-19 03:52:55,006 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6207.214830 2021-02-19 03:52:55,361 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:55,440 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4595.340230 2021-02-19 03:52:55,576 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3565.615243 2021-02-19 03:52:55,700 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3683.873605 2021-02-19 03:52:56,055 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1520.665331 2021-02-19 03:52:56,062 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:56,078 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7184.629659 2021-02-19 03:52:56,473 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7280.609336 2021-02-19 03:52:56,489 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3215.390155 2021-02-19 03:52:56,661 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6226.478648 2021-02-19 03:52:56,967 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:57,059 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4595.340230 2021-02-19 03:52:57,207 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3565.615243 2021-02-19 03:52:57,354 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3683.873605 2021-02-19 03:52:57,378 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 31.51 % 2021-02-19 03:52:57,395 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:52:57,395 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:52:57,698 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:57,736 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1522.710608 2021-02-19 03:52:57,773 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7269.804272 2021-02-19 03:52:58,115 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7280.609336 2021-02-19 03:52:58,137 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3215.390155 2021-02-19 03:52:58,289 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6226.478648 2021-02-19 03:52:58,608 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:52:58,693 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4595.340230 2021-02-19 03:52:58,844 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3565.615243 2021-02-19 03:52:58,986 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3683.873605 2021-02-19 03:52:58,989 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 31.60 % 2021-02-19 03:52:58,990 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 31.5965103709 2021-02-19 03:52:59,378 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:52:59,427 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1522.710608 2021-02-19 03:52:59,463 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7351.874613 2021-02-19 03:52:59,769 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3215.390155 2021-02-19 03:52:59,770 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7423.073263 2021-02-19 03:52:59,898 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6237.263818 2021-02-19 03:53:00,230 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:00,315 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4595.340230 2021-02-19 03:53:00,479 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3595.995002 2021-02-19 03:53:00,628 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3732.276812 2021-02-19 03:53:01,025 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:01,055 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1453.145277 2021-02-19 03:53:01,108 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7351.874613 2021-02-19 03:53:01,411 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7423.073263 2021-02-19 03:53:01,427 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3215.390155 2021-02-19 03:53:01,536 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6237.263818 2021-02-19 03:53:01,841 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:01,930 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4595.340230 2021-02-19 03:53:02,119 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3595.995002 2021-02-19 03:53:02,262 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3732.276812 2021-02-19 03:53:02,661 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:02,697 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1472.245277 2021-02-19 03:53:02,747 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7281.474613 2021-02-19 03:53:03,032 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7385.573263 2021-02-19 03:53:03,066 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3247.890155 2021-02-19 03:53:03,154 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6172.463818 2021-02-19 03:53:03,446 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:03,536 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4729.340230 2021-02-19 03:53:03,749 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3577.995002 2021-02-19 03:53:03,890 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3702.876812 2021-02-19 03:53:04,035 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 31.93 % 2021-02-19 03:53:04,035 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 31.9288281897 2021-02-19 03:53:04,302 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:04,395 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1472.245277 2021-02-19 03:53:04,404 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7281.474613 2021-02-19 03:53:04,747 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7385.573263 2021-02-19 03:53:04,769 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3247.890155 2021-02-19 03:53:04,809 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6172.463818 2021-02-19 03:53:05,086 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:05,171 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4729.340230 2021-02-19 03:53:05,365 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3577.995002 2021-02-19 03:53:05,561 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3635.789645 2021-02-19 03:53:05,950 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:06,073 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1472.245277 2021-02-19 03:53:06,088 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7281.474613 2021-02-19 03:53:06,489 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7349.208554 2021-02-19 03:53:06,496 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3253.212506 2021-02-19 03:53:06,496 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6132.816358 2021-02-19 03:53:06,703 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:06,811 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4766.878539 2021-02-19 03:53:06,983 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3544.088044 2021-02-19 03:53:07,190 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3635.789645 2021-02-19 03:53:07,420 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 32.10 % 2021-02-19 03:53:07,436 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:53:07,436 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:53:07,585 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:07,720 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1569.903552 2021-02-19 03:53:07,762 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7187.278289 2021-02-19 03:53:08,127 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3253.212506 2021-02-19 03:53:08,163 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7349.208554 2021-02-19 03:53:08,178 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6132.816358 2021-02-19 03:53:08,309 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:08,434 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4766.878539 2021-02-19 03:53:08,635 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3544.088044 2021-02-19 03:53:08,845 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3635.789645 2021-02-19 03:53:09,089 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 32.22 % 2021-02-19 03:53:09,089 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 32.2155412591 2021-02-19 03:53:09,204 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:09,352 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1569.903552 2021-02-19 03:53:09,380 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7077.443463 2021-02-19 03:53:09,795 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3253.212506 2021-02-19 03:53:09,825 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7164.178366 2021-02-19 03:53:09,831 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6092.605163 2021-02-19 03:53:09,911 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:10,069 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4766.878539 2021-02-19 03:53:10,286 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3533.616033 2021-02-19 03:53:10,480 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3547.426270 2021-02-19 03:53:10,848 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:11,019 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7077.443463 2021-02-19 03:53:11,040 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1578.035059 2021-02-19 03:53:11,421 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3253.212506 2021-02-19 03:53:11,467 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7164.178366 2021-02-19 03:53:11,517 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6092.605163 2021-02-19 03:53:11,573 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:11,693 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4766.878539 2021-02-19 03:53:11,920 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3533.616033 2021-02-19 03:53:12,109 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3547.426270 2021-02-19 03:53:12,473 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:12,648 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7052.343463 2021-02-19 03:53:12,681 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1554.935059 2021-02-19 03:53:13,053 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3266.612506 2021-02-19 03:53:13,108 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7119.078366 2021-02-19 03:53:13,167 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6121.605163 2021-02-19 03:53:13,197 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:13,302 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4603.478539 2021-02-19 03:53:13,556 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3533.416033 2021-02-19 03:53:13,747 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3529.226270 2021-02-19 03:53:14,154 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:14,167 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 32.56 % 2021-02-19 03:53:14,167 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 32.5576788222 2021-02-19 03:53:14,328 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7052.343463 2021-02-19 03:53:14,344 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1554.935059 2021-02-19 03:53:14,701 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3266.612506 2021-02-19 03:53:14,750 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7119.078366 2021-02-19 03:53:14,799 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6121.605163 2021-02-19 03:53:14,838 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:14,983 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4603.478539 2021-02-19 03:53:15,220 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3533.416033 2021-02-19 03:53:15,362 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3529.226270 2021-02-19 03:53:15,786 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:15,940 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7052.343463 2021-02-19 03:53:15,996 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1554.935059 2021-02-19 03:53:16,354 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3296.100000 2021-02-19 03:53:16,407 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7068.569812 2021-02-19 03:53:16,450 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6162.688804 2021-02-19 03:53:16,469 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:16,586 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4534.400000 2021-02-19 03:53:16,851 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3549.527989 2021-02-19 03:53:17,002 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3544.636625 2021-02-19 03:53:17,414 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:17,453 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 32.75 % 2021-02-19 03:53:17,467 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:53:17,467 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:53:17,562 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7029.265174 2021-02-19 03:53:17,634 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1372.831507 2021-02-19 03:53:18,045 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3296.100000 2021-02-19 03:53:18,086 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6162.688804 2021-02-19 03:53:18,109 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7068.569812 2021-02-19 03:53:18,118 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:18,233 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4534.400000 2021-02-19 03:53:18,493 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3549.527989 2021-02-19 03:53:18,653 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3544.636625 2021-02-19 03:53:19,069 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:19,197 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7029.265174 2021-02-19 03:53:19,217 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 32.88 % 2021-02-19 03:53:19,217 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 32.880240562 2021-02-19 03:53:19,290 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1372.831507 2021-02-19 03:53:19,690 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3296.100000 2021-02-19 03:53:19,744 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6234.239816 2021-02-19 03:53:19,756 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7182.975950 2021-02-19 03:53:19,790 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:19,907 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4534.400000 2021-02-19 03:53:20,144 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3549.527989 2021-02-19 03:53:20,318 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3611.790236 2021-02-19 03:53:20,683 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:20,823 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7069.650980 2021-02-19 03:53:20,926 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1309.643217 2021-02-19 03:53:21,325 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3296.100000 2021-02-19 03:53:21,420 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6234.239816 2021-02-19 03:53:21,434 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:21,454 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7182.975950 2021-02-19 03:53:21,523 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4534.400000 2021-02-19 03:53:21,792 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3579.283914 2021-02-19 03:53:21,980 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3611.790236 2021-02-19 03:53:22,306 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:22,479 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7085.650980 2021-02-19 03:53:22,572 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1306.643217 2021-02-19 03:53:22,956 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3237.800000 2021-02-19 03:53:23,069 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6256.439816 2021-02-19 03:53:23,078 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:23,107 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7224.975950 2021-02-19 03:53:23,161 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4583.200000 2021-02-19 03:53:23,467 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3598.483914 2021-02-19 03:53:23,671 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3655.490236 2021-02-19 03:53:23,921 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:24,111 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7085.650980 2021-02-19 03:53:24,240 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1306.643217 2021-02-19 03:53:24,263 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 33.20 % 2021-02-19 03:53:24,263 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 33.1995120664 2021-02-19 03:53:24,594 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3237.800000 2021-02-19 03:53:24,763 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6256.439816 2021-02-19 03:53:24,763 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7224.975950 2021-02-19 03:53:24,783 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:24,801 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4583.200000 2021-02-19 03:53:25,108 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3598.483914 2021-02-19 03:53:25,301 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3655.490236 2021-02-19 03:53:25,571 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:25,780 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7166.350980 2021-02-19 03:53:25,871 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1440.943217 2021-02-19 03:53:26,207 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3140.300000 2021-02-19 03:53:26,461 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6231.239816 2021-02-19 03:53:26,473 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:26,483 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4555.300000 2021-02-19 03:53:26,487 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7284.775950 2021-02-19 03:53:26,740 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3575.583914 2021-02-19 03:53:26,917 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3691.690236 2021-02-19 03:53:27,240 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:27,436 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7166.350980 2021-02-19 03:53:27,482 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 33.40 % 2021-02-19 03:53:27,496 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:53:27,496 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:53:27,523 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1440.943217 2021-02-19 03:53:27,878 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3140.300000 2021-02-19 03:53:28,127 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7284.775950 2021-02-19 03:53:28,147 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:28,164 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6231.239816 2021-02-19 03:53:28,184 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4555.300000 2021-02-19 03:53:28,365 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3575.583914 2021-02-19 03:53:28,546 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3691.690236 2021-02-19 03:53:28,881 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:29,085 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7166.350980 2021-02-19 03:53:29,160 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1440.943217 2021-02-19 03:53:29,328 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 33.54 % 2021-02-19 03:53:29,328 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 33.5350946396 2021-02-19 03:53:29,538 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3140.300000 2021-02-19 03:53:29,790 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:29,825 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7200.600000 2021-02-19 03:53:29,825 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6127.400000 2021-02-19 03:53:29,841 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4555.300000 2021-02-19 03:53:29,990 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3575.583914 2021-02-19 03:53:30,193 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3691.690236 2021-02-19 03:53:30,505 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:30,743 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7178.100000 2021-02-19 03:53:30,786 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1371.500000 2021-02-19 03:53:31,216 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3140.300000 2021-02-19 03:53:31,437 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:31,494 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7200.600000 2021-02-19 03:53:31,499 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4555.300000 2021-02-19 03:53:31,513 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6127.400000 2021-02-19 03:53:31,625 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3544.800000 2021-02-19 03:53:31,864 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3669.900000 2021-02-19 03:53:32,117 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:32,362 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7240.600000 2021-02-19 03:53:32,413 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1320.900000 2021-02-19 03:53:32,859 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3101.200000 2021-02-19 03:53:33,088 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:33,161 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6069.300000 2021-02-19 03:53:33,174 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4535.400000 2021-02-19 03:53:33,190 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7210.200000 2021-02-19 03:53:33,262 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3552.000000 2021-02-19 03:53:33,480 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3642.000000 2021-02-19 03:53:33,753 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:34,000 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7240.600000 2021-02-19 03:53:34,056 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1320.900000 2021-02-19 03:53:34,369 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 33.86 % 2021-02-19 03:53:34,371 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 33.8576563794 2021-02-19 03:53:34,489 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3101.200000 2021-02-19 03:53:34,713 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:34,809 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6069.300000 2021-02-19 03:53:34,832 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4535.400000 2021-02-19 03:53:34,845 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7210.200000 2021-02-19 03:53:34,911 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3552.000000 2021-02-19 03:53:35,131 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3642.000000 2021-02-19 03:53:35,398 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:35,618 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7222.800000 2021-02-19 03:53:35,726 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1268.700000 2021-02-19 03:53:36,098 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3101.200000 2021-02-19 03:53:36,321 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:36,450 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5996.200000 2021-02-19 03:53:36,477 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4555.400000 2021-02-19 03:53:36,525 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7175.500000 2021-02-19 03:53:36,602 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3593.300000 2021-02-19 03:53:36,615 | infra | INFO | pool-2-thread-25 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 03:53:36,615 | infra | INFO | pool-2-thread-25 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' started 2021-02-19 03:53:36,776 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3612.100000 2021-02-19 03:53:37,032 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:37,233 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7222.800000 2021-02-19 03:53:37,375 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1268.700000 2021-02-19 03:53:37,509 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 34.03 % 2021-02-19 03:53:37,525 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:53:37,525 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:53:37,713 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3079.900000 2021-02-19 03:53:37,963 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:38,081 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5996.200000 2021-02-19 03:53:38,180 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4555.400000 2021-02-19 03:53:38,190 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7175.500000 2021-02-19 03:53:38,250 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3593.300000 2021-02-19 03:53:38,408 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3612.100000 2021-02-19 03:53:38,650 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:38,881 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7222.800000 2021-02-19 03:53:39,026 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1268.700000 2021-02-19 03:53:39,344 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3079.900000 2021-02-19 03:53:39,414 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 34.18 % 2021-02-19 03:53:39,415 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 34.1769406243 2021-02-19 03:53:39,562 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:39,736 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5993.100000 2021-02-19 03:53:39,818 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4555.400000 2021-02-19 03:53:39,848 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7282.000000 2021-02-19 03:53:39,890 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3633.600000 2021-02-19 03:53:40,033 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3612.100000 2021-02-19 03:53:40,269 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:40,532 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7260.400000 2021-02-19 03:53:40,661 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1267.100000 2021-02-19 03:53:40,957 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3079.900000 2021-02-19 03:53:41,161 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:41,474 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4555.400000 2021-02-19 03:53:41,497 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5993.100000 2021-02-19 03:53:41,565 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7282.000000 2021-02-19 03:53:41,572 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3633.600000 2021-02-19 03:53:41,677 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3514.600000 2021-02-19 03:53:41,905 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:42,153 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7260.400000 2021-02-19 03:53:42,285 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1300.600000 2021-02-19 03:53:42,572 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3101.700000 2021-02-19 03:53:42,799 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:43,147 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4592.900000 2021-02-19 03:53:43,194 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5989.200000 2021-02-19 03:53:43,246 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7305.900000 2021-02-19 03:53:43,270 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3628.800000 2021-02-19 03:53:43,315 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3075.000000 2021-02-19 03:53:43,542 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:43,789 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7283.200000 2021-02-19 03:53:43,914 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1300.600000 2021-02-19 03:53:44,193 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3101.700000 2021-02-19 03:53:44,470 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:44,482 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 34.51 % 2021-02-19 03:53:44,483 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 34.5092966647 2021-02-19 03:53:44,802 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4592.900000 2021-02-19 03:53:44,828 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5989.200000 2021-02-19 03:53:44,926 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7305.900000 2021-02-19 03:53:44,956 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3628.800000 2021-02-19 03:53:44,976 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3075.000000 2021-02-19 03:53:45,188 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:45,438 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7283.200000 2021-02-19 03:53:45,551 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1328.700000 2021-02-19 03:53:45,806 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3120.900000 2021-02-19 03:53:46,078 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:46,457 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4631.800000 2021-02-19 03:53:46,484 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6086.300000 2021-02-19 03:53:46,575 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7361.000000 2021-02-19 03:53:46,621 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3615.600000 2021-02-19 03:53:46,645 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2300.100000 2021-02-19 03:53:46,857 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:47,075 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7361.100000 2021-02-19 03:53:47,181 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1328.700000 2021-02-19 03:53:47,463 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3120.900000 2021-02-19 03:53:47,540 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 34.73 % 2021-02-19 03:53:47,555 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:53:47,556 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:53:47,686 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:48,075 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4631.800000 2021-02-19 03:53:48,118 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6086.300000 2021-02-19 03:53:48,237 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7361.000000 2021-02-19 03:53:48,305 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3615.600000 2021-02-19 03:53:48,308 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2300.100000 2021-02-19 03:53:48,497 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:48,687 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7361.100000 2021-02-19 03:53:48,805 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1328.700000 2021-02-19 03:53:49,079 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3120.900000 2021-02-19 03:53:49,296 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:49,536 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 34.83 % 2021-02-19 03:53:49,536 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 34.831845664 2021-02-19 03:53:49,709 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4631.800000 2021-02-19 03:53:49,740 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6192.800000 2021-02-19 03:53:49,871 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7295.900000 2021-02-19 03:53:49,956 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1193.800000 2021-02-19 03:53:49,967 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3606.800000 2021-02-19 03:53:50,111 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:50,326 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7405.400000 2021-02-19 03:53:50,431 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1271.600000 2021-02-19 03:53:50,686 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3120.900000 2021-02-19 03:53:50,898 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:51,338 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4631.800000 2021-02-19 03:53:51,369 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6192.800000 2021-02-19 03:53:51,510 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7295.900000 2021-02-19 03:53:51,624 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1193.800000 2021-02-19 03:53:51,645 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3606.800000 2021-02-19 03:53:51,734 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:51,950 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7405.400000 2021-02-19 03:53:52,075 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1271.600000 2021-02-19 03:53:52,302 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3171.500000 2021-02-19 03:53:52,500 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:52,948 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4608.400000 2021-02-19 03:53:53,048 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6267.900000 2021-02-19 03:53:53,209 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7228.700000 2021-02-19 03:53:53,265 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 426.100000 2021-02-19 03:53:53,292 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3631.100000 2021-02-19 03:53:53,377 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:53,617 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7381.900000 2021-02-19 03:53:53,700 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1307.000000 2021-02-19 03:53:53,904 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3171.500000 2021-02-19 03:53:54,109 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:54,578 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4608.400000 2021-02-19 03:53:54,582 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 35.20 % 2021-02-19 03:53:54,582 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 35.2000503748 2021-02-19 03:53:54,733 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6267.900000 2021-02-19 03:53:54,869 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7228.700000 2021-02-19 03:53:54,897 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 426.100000 2021-02-19 03:53:54,967 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3631.100000 2021-02-19 03:53:55,010 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:55,230 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7381.900000 2021-02-19 03:53:55,319 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1307.000000 2021-02-19 03:53:55,517 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3256.200000 2021-02-19 03:53:55,730 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:56,201 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4608.400000 2021-02-19 03:53:56,382 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6277.100000 2021-02-19 03:53:56,506 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7181.100000 2021-02-19 03:53:56,542 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:53:56,687 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3625.100000 2021-02-19 03:53:56,733 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:56,862 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7367.200000 2021-02-19 03:53:56,989 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1329.300000 2021-02-19 03:53:57,151 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3256.200000 2021-02-19 03:53:57,349 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:57,571 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 35.37 % 2021-02-19 03:53:57,585 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:53:57,585 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:53:57,805 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4571.600000 2021-02-19 03:53:57,997 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6277.100000 2021-02-19 03:53:58,134 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7181.100000 2021-02-19 03:53:58,187 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:53:58,352 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3625.100000 2021-02-19 03:53:58,400 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:53:58,493 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7367.200000 2021-02-19 03:53:58,608 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1329.300000 2021-02-19 03:53:58,773 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3256.200000 2021-02-19 03:53:58,960 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:53:59,415 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4571.600000 2021-02-19 03:53:59,618 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6283.900000 2021-02-19 03:53:59,628 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 35.52 % 2021-02-19 03:53:59,628 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 35.5226121147 2021-02-19 03:53:59,776 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7200.600000 2021-02-19 03:53:59,832 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:00,000 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3625.100000 2021-02-19 03:54:00,078 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:00,170 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7367.200000 2021-02-19 03:54:00,295 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1329.300000 2021-02-19 03:54:00,440 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3256.200000 2021-02-19 03:54:00,559 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:01,017 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4571.600000 2021-02-19 03:54:01,230 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6283.900000 2021-02-19 03:54:01,420 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7200.600000 2021-02-19 03:54:01,461 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:01,684 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3598.100000 2021-02-19 03:54:01,716 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:01,844 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7341.700000 2021-02-19 03:54:01,927 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1349.600000 2021-02-19 03:54:02,065 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3256.200000 2021-02-19 03:54:02,151 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:02,651 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4594.000000 2021-02-19 03:54:02,859 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6257.300000 2021-02-19 03:54:03,095 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7264.500000 2021-02-19 03:54:03,134 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:03,322 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3556.300000 2021-02-19 03:54:03,342 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:03,464 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7397.300000 2021-02-19 03:54:03,559 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1457.700000 2021-02-19 03:54:03,683 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3168.100000 2021-02-19 03:54:03,765 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:04,289 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4594.000000 2021-02-19 03:54:04,486 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6257.300000 2021-02-19 03:54:04,673 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 35.84 % 2021-02-19 03:54:04,673 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 35.8419218407 2021-02-19 03:54:04,732 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7264.500000 2021-02-19 03:54:04,783 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:04,999 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:05,007 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3556.300000 2021-02-19 03:54:05,138 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7397.300000 2021-02-19 03:54:05,187 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1457.700000 2021-02-19 03:54:05,328 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3168.100000 2021-02-19 03:54:05,377 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:05,888 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4613.008429 2021-02-19 03:54:06,098 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6257.300000 2021-02-19 03:54:06,351 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7319.809138 2021-02-19 03:54:06,403 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:06,650 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:06,673 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3545.265525 2021-02-19 03:54:06,773 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7415.878368 2021-02-19 03:54:06,877 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1609.178328 2021-02-19 03:54:06,948 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3060.508389 2021-02-19 03:54:07,035 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:07,526 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4613.008429 2021-02-19 03:54:07,601 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 36.03 % 2021-02-19 03:54:07,617 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:54:07,617 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:54:07,706 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6272.274194 2021-02-19 03:54:07,986 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7319.809138 2021-02-19 03:54:08,029 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:08,288 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:08,325 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3545.265525 2021-02-19 03:54:08,407 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7415.878368 2021-02-19 03:54:08,517 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1609.178328 2021-02-19 03:54:08,579 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3060.508389 2021-02-19 03:54:08,648 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:09,134 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4613.008429 2021-02-19 03:54:09,338 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6272.274194 2021-02-19 03:54:09,611 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7369.909138 2021-02-19 03:54:09,657 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:09,726 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 36.15 % 2021-02-19 03:54:09,726 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 36.1514500066 2021-02-19 03:54:09,914 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:09,976 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3583.165525 2021-02-19 03:54:10,048 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7415.878368 2021-02-19 03:54:10,150 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1609.178328 2021-02-19 03:54:10,242 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3060.508389 2021-02-19 03:54:10,296 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:10,747 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4613.008429 2021-02-19 03:54:10,961 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6243.574194 2021-02-19 03:54:11,246 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7369.909138 2021-02-19 03:54:11,289 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:11,552 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:11,611 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3583.165525 2021-02-19 03:54:11,690 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7470.578368 2021-02-19 03:54:11,821 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1610.078328 2021-02-19 03:54:11,891 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3060.508389 2021-02-19 03:54:11,907 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:12,354 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4627.908429 2021-02-19 03:54:12,581 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6287.574194 2021-02-19 03:54:12,871 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7385.009138 2021-02-19 03:54:12,928 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:13,170 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:13,229 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3598.365525 2021-02-19 03:54:13,312 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7496.978368 2021-02-19 03:54:13,463 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1654.078328 2021-02-19 03:54:13,516 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3168.008389 2021-02-19 03:54:13,532 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:13,986 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4627.908429 2021-02-19 03:54:14,197 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6287.574194 2021-02-19 03:54:14,515 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7385.009138 2021-02-19 03:54:14,566 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:14,773 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 36.48 % 2021-02-19 03:54:14,775 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 36.4772637603 2021-02-19 03:54:14,790 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:14,857 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3598.365525 2021-02-19 03:54:14,923 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7496.978368 2021-02-19 03:54:15,101 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1654.078328 2021-02-19 03:54:15,142 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:15,148 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3168.008389 2021-02-19 03:54:15,608 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4703.826276 2021-02-19 03:54:15,796 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6283.355533 2021-02-19 03:54:16,141 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7385.009138 2021-02-19 03:54:16,193 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:16,403 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:16,486 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3634.129678 2021-02-19 03:54:16,542 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7528.705944 2021-02-19 03:54:16,779 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1487.925695 2021-02-19 03:54:16,790 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:16,799 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3288.591555 2021-02-19 03:54:17,223 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4703.826276 2021-02-19 03:54:17,424 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6283.355533 2021-02-19 03:54:17,628 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 36.68 % 2021-02-19 03:54:17,642 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:54:17,642 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:54:17,766 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7367.762357 2021-02-19 03:54:17,818 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:18,089 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:18,115 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3634.129678 2021-02-19 03:54:18,210 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7528.705944 2021-02-19 03:54:18,421 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1487.925695 2021-02-19 03:54:18,440 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3288.591555 2021-02-19 03:54:18,447 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:18,862 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4703.826276 2021-02-19 03:54:19,043 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6283.355533 2021-02-19 03:54:19,407 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7400.062357 2021-02-19 03:54:19,447 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:19,733 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:19,760 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3646.229678 2021-02-19 03:54:19,819 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 36.80 % 2021-02-19 03:54:19,819 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 36.7998382407 2021-02-19 03:54:19,854 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7569.705944 2021-02-19 03:54:20,078 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1487.925695 2021-02-19 03:54:20,084 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:20,114 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3288.591555 2021-02-19 03:54:20,487 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4703.826276 2021-02-19 03:54:20,713 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6324.455533 2021-02-19 03:54:21,036 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7400.062357 2021-02-19 03:54:21,069 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:21,372 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:21,398 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3646.229678 2021-02-19 03:54:21,533 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7569.705944 2021-02-19 03:54:21,711 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1365.725695 2021-02-19 03:54:21,717 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:21,769 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3288.591555 2021-02-19 03:54:22,111 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4703.826276 2021-02-19 03:54:22,338 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6367.355533 2021-02-19 03:54:22,657 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7395.262357 2021-02-19 03:54:22,691 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:23,023 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:23,035 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3666.029678 2021-02-19 03:54:23,171 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7587.805944 2021-02-19 03:54:23,372 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1126.825695 2021-02-19 03:54:23,372 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:23,414 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3261.091555 2021-02-19 03:54:23,713 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4697.426276 2021-02-19 03:54:23,963 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6367.355533 2021-02-19 03:54:24,276 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7395.262357 2021-02-19 03:54:24,299 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:24,694 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:24,709 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3666.029678 2021-02-19 03:54:24,805 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7587.805944 2021-02-19 03:54:24,878 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 37.14 % 2021-02-19 03:54:24,880 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 37.1386855683 2021-02-19 03:54:25,039 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1126.825695 2021-02-19 03:54:25,046 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3261.091555 2021-02-19 03:54:25,051 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:25,332 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4697.426276 2021-02-19 03:54:25,604 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6394.884059 2021-02-19 03:54:25,940 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7398.508356 2021-02-19 03:54:25,950 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:26,325 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:26,346 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3690.168188 2021-02-19 03:54:26,433 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7574.247443 2021-02-19 03:54:26,704 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:26,710 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1052.828180 2021-02-19 03:54:26,743 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3193.409437 2021-02-19 03:54:26,963 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4638.222546 2021-02-19 03:54:27,213 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6394.884059 2021-02-19 03:54:27,585 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:27,591 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7398.508356 2021-02-19 03:54:27,654 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 37.32 % 2021-02-19 03:54:27,665 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:54:27,667 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:54:27,960 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:27,970 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3690.168188 2021-02-19 03:54:28,071 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7574.247443 2021-02-19 03:54:28,328 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:28,365 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1052.828180 2021-02-19 03:54:28,388 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3193.409437 2021-02-19 03:54:28,599 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4638.222546 2021-02-19 03:54:28,842 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6394.884059 2021-02-19 03:54:29,240 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:29,246 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7398.508356 2021-02-19 03:54:29,605 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:29,618 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3680.688971 2021-02-19 03:54:29,723 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7508.367107 2021-02-19 03:54:29,930 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 37.50 % 2021-02-19 03:54:29,930 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 37.5004371762 2021-02-19 03:54:29,974 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:30,023 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1081.002520 2021-02-19 03:54:30,065 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3193.409437 2021-02-19 03:54:30,216 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4638.222546 2021-02-19 03:54:30,493 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6397.587256 2021-02-19 03:54:30,907 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:30,921 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7292.094287 2021-02-19 03:54:31,262 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:31,263 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3680.688971 2021-02-19 03:54:31,405 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7508.367107 2021-02-19 03:54:31,618 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:31,660 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1081.002520 2021-02-19 03:54:31,726 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3193.409437 2021-02-19 03:54:31,846 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4638.222546 2021-02-19 03:54:32,128 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6397.587256 2021-02-19 03:54:32,526 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:32,551 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7265.594287 2021-02-19 03:54:32,914 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3717.188971 2021-02-19 03:54:32,914 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:33,075 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7419.367107 2021-02-19 03:54:33,240 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:33,312 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1303.502520 2021-02-19 03:54:33,372 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3179.509437 2021-02-19 03:54:33,486 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4676.122546 2021-02-19 03:54:33,755 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6381.587256 2021-02-19 03:54:34,138 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:34,184 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7265.594287 2021-02-19 03:54:34,536 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:34,562 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3717.188971 2021-02-19 03:54:34,694 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7419.367107 2021-02-19 03:54:34,859 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:34,957 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1303.502520 2021-02-19 03:54:34,969 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 37.84 % 2021-02-19 03:54:34,970 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 37.8392845037 2021-02-19 03:54:35,000 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3179.509437 2021-02-19 03:54:35,107 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4676.122546 2021-02-19 03:54:35,365 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6381.587256 2021-02-19 03:54:35,755 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:35,809 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7225.585931 2021-02-19 03:54:36,220 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:36,220 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3717.188971 2021-02-19 03:54:36,361 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7378.119664 2021-02-19 03:54:36,486 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:36,589 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1571.074341 2021-02-19 03:54:36,644 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3198.000000 2021-02-19 03:54:36,730 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4696.200000 2021-02-19 03:54:36,987 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6405.303197 2021-02-19 03:54:37,371 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:37,427 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7225.585931 2021-02-19 03:54:37,680 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 38.03 % 2021-02-19 03:54:37,693 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:54:37,693 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:54:37,877 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3696.020783 2021-02-19 03:54:37,891 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:38,003 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7378.119664 2021-02-19 03:54:38,140 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:38,232 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1571.074341 2021-02-19 03:54:38,305 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3198.000000 2021-02-19 03:54:38,364 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4696.200000 2021-02-19 03:54:38,609 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6405.303197 2021-02-19 03:54:39,016 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:39,056 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7225.585931 2021-02-19 03:54:39,565 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3686.628777 2021-02-19 03:54:39,576 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:39,640 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7316.048009 2021-02-19 03:54:39,755 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:39,858 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1525.366820 2021-02-19 03:54:39,928 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3198.000000 2021-02-19 03:54:39,983 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4696.200000 2021-02-19 03:54:40,009 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 38.22 % 2021-02-19 03:54:40,009 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 38.2172325156 2021-02-19 03:54:40,283 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6405.303197 2021-02-19 03:54:40,650 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:40,684 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7225.835701 2021-02-19 03:54:41,243 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:41,260 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3686.628777 2021-02-19 03:54:41,282 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7316.048009 2021-02-19 03:54:41,384 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:41,523 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1525.366820 2021-02-19 03:54:41,598 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3198.000000 2021-02-19 03:54:41,627 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4696.200000 2021-02-19 03:54:41,913 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6407.874144 2021-02-19 03:54:42,293 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:42,323 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7176.635701 2021-02-19 03:54:42,910 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3595.828777 2021-02-19 03:54:42,911 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:42,944 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7308.748009 2021-02-19 03:54:43,003 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:43,168 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1642.366820 2021-02-19 03:54:43,232 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3185.900000 2021-02-19 03:54:43,263 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4687.000000 2021-02-19 03:54:43,519 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6354.374144 2021-02-19 03:54:43,953 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:43,964 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7176.635701 2021-02-19 03:54:44,582 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:44,611 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3595.828777 2021-02-19 03:54:44,670 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:44,683 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7308.748009 2021-02-19 03:54:44,828 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1642.366820 2021-02-19 03:54:44,859 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3185.900000 2021-02-19 03:54:44,890 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4687.000000 2021-02-19 03:54:45,065 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 38.63 % 2021-02-19 03:54:45,066 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 38.6343067301 2021-02-19 03:54:45,145 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6354.374144 2021-02-19 03:54:45,614 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:45,627 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7154.235701 2021-02-19 03:54:46,211 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:46,256 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3595.828777 2021-02-19 03:54:46,332 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:46,344 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7278.048009 2021-02-19 03:54:46,503 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1825.166820 2021-02-19 03:54:46,528 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3135.200000 2021-02-19 03:54:46,542 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4663.200000 2021-02-19 03:54:46,763 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6286.974144 2021-02-19 03:54:47,240 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:47,273 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7154.235701 2021-02-19 03:54:47,713 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 38.86 % 2021-02-19 03:54:47,726 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:54:47,727 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:54:47,855 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:47,954 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3543.328777 2021-02-19 03:54:48,017 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7278.048009 2021-02-19 03:54:48,026 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:48,177 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1825.166820 2021-02-19 03:54:48,197 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4663.200000 2021-02-19 03:54:48,213 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3135.200000 2021-02-19 03:54:48,414 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6286.974144 2021-02-19 03:54:48,881 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:48,928 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7154.235701 2021-02-19 03:54:49,483 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:49,594 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3535.210885 2021-02-19 03:54:49,670 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:49,680 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7289.704993 2021-02-19 03:54:49,802 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1820.151108 2021-02-19 03:54:49,851 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3135.200000 2021-02-19 03:54:49,851 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4663.200000 2021-02-19 03:54:50,030 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6286.974144 2021-02-19 03:54:50,117 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 39.04 % 2021-02-19 03:54:50,118 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 39.0415739036 2021-02-19 03:54:50,517 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:50,552 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7077.956820 2021-02-19 03:54:51,117 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:51,229 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3535.210885 2021-02-19 03:54:51,306 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:51,336 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7289.704993 2021-02-19 03:54:51,441 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1820.151108 2021-02-19 03:54:51,532 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3135.200000 2021-02-19 03:54:51,556 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4663.200000 2021-02-19 03:54:51,658 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6224.114999 2021-02-19 03:54:52,144 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:52,206 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7077.956820 2021-02-19 03:54:52,763 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:52,858 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3599.110885 2021-02-19 03:54:52,924 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:52,966 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7275.204993 2021-02-19 03:54:53,118 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2053.151108 2021-02-19 03:54:53,200 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3093.600000 2021-02-19 03:54:53,213 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4564.800000 2021-02-19 03:54:53,312 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6206.414999 2021-02-19 03:54:53,792 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:53,832 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7041.156820 2021-02-19 03:54:54,441 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:54,513 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3599.110885 2021-02-19 03:54:54,569 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:54,615 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7275.204993 2021-02-19 03:54:54,773 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2053.151108 2021-02-19 03:54:54,838 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3093.600000 2021-02-19 03:54:54,865 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4564.800000 2021-02-19 03:54:54,944 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6206.414999 2021-02-19 03:54:55,161 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 39.42 % 2021-02-19 03:54:55,163 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 39.4195856181 2021-02-19 03:54:55,434 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:55,473 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7015.256820 2021-02-19 03:54:56,078 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:56,211 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:56,213 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3599.110885 2021-02-19 03:54:56,266 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7275.204993 2021-02-19 03:54:56,414 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2057.051108 2021-02-19 03:54:56,473 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3113.900000 2021-02-19 03:54:56,526 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4545.100000 2021-02-19 03:54:56,571 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6174.214999 2021-02-19 03:54:57,049 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:57,108 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7015.256820 2021-02-19 03:54:57,698 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:57,753 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 39.62 % 2021-02-19 03:54:57,767 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:54:57,769 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:54:57,878 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:57,888 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3649.210885 2021-02-19 03:54:57,904 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7284.804993 2021-02-19 03:54:58,061 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2057.051108 2021-02-19 03:54:58,119 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3113.900000 2021-02-19 03:54:58,161 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4545.100000 2021-02-19 03:54:58,204 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6174.214999 2021-02-19 03:54:58,698 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:54:58,765 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7015.256820 2021-02-19 03:54:59,325 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:54:59,546 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7372.320032 2021-02-19 03:54:59,555 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:54:59,572 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3653.837821 2021-02-19 03:54:59,739 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1993.768910 2021-02-19 03:54:59,802 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4545.100000 2021-02-19 03:54:59,812 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3113.900000 2021-02-19 03:54:59,874 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6203.143429 2021-02-19 03:55:00,207 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 39.74 % 2021-02-19 03:55:00,207 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 39.7390737117 2021-02-19 03:55:00,331 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:00,405 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7133.796154 2021-02-19 03:55:00,931 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:01,183 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:01,210 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7372.320032 2021-02-19 03:55:01,247 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3653.837821 2021-02-19 03:55:01,378 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1993.768910 2021-02-19 03:55:01,434 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4545.100000 2021-02-19 03:55:01,448 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3113.900000 2021-02-19 03:55:01,499 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6203.143429 2021-02-19 03:55:01,946 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:02,019 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7133.796154 2021-02-19 03:55:02,575 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:02,825 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:02,859 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7507.020032 2021-02-19 03:55:02,898 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3654.537821 2021-02-19 03:55:03,015 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1702.668910 2021-02-19 03:55:03,065 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4639.500000 2021-02-19 03:55:03,105 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3184.800000 2021-02-19 03:55:03,164 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6237.243429 2021-02-19 03:55:03,563 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:03,651 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7232.296154 2021-02-19 03:55:04,214 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:04,440 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:04,502 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7507.020032 2021-02-19 03:55:04,546 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3654.537821 2021-02-19 03:55:04,667 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1702.668910 2021-02-19 03:55:04,691 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4639.500000 2021-02-19 03:55:04,726 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3184.800000 2021-02-19 03:55:04,808 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6237.243429 2021-02-19 03:55:05,186 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:05,250 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 39.96 % 2021-02-19 03:55:05,250 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 39.9608610568 2021-02-19 03:55:05,293 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7232.296154 2021-02-19 03:55:05,888 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:06,127 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:06,145 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7507.020032 2021-02-19 03:55:06,197 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3654.537821 2021-02-19 03:55:06,319 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1702.668910 2021-02-19 03:55:06,362 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4709.800000 2021-02-19 03:55:06,365 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3238.600000 2021-02-19 03:55:06,428 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6314.543429 2021-02-19 03:55:06,838 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:06,921 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7350.396154 2021-02-19 03:55:07,533 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:07,796 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 40.00 % 2021-02-19 03:55:07,799 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:07,812 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:55:07,812 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:55:07,815 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7667.520032 2021-02-19 03:55:07,848 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3659.037821 2021-02-19 03:55:07,976 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1328.968910 2021-02-19 03:55:08,020 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3238.600000 2021-02-19 03:55:08,072 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4709.800000 2021-02-19 03:55:08,089 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6314.543429 2021-02-19 03:55:08,460 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:08,542 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7350.396154 2021-02-19 03:55:09,154 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:09,440 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:09,474 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7703.580568 2021-02-19 03:55:09,484 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3652.818033 2021-02-19 03:55:09,687 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3238.600000 2021-02-19 03:55:09,709 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1285.900000 2021-02-19 03:55:09,757 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6295.571731 2021-02-19 03:55:09,759 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4709.800000 2021-02-19 03:55:10,109 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:10,201 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7350.396154 2021-02-19 03:55:10,302 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 40.00 % 2021-02-19 03:55:10,302 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 40.0 2021-02-19 03:55:10,770 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:11,063 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:11,099 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7703.580568 2021-02-19 03:55:11,128 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3652.818033 2021-02-19 03:55:11,325 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3238.600000 2021-02-19 03:55:11,384 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1285.900000 2021-02-19 03:55:11,417 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6295.571731 2021-02-19 03:55:11,430 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4709.800000 2021-02-19 03:55:11,756 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:11,842 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7343.728629 2021-02-19 03:55:12,403 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:12,739 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:12,770 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7621.880568 2021-02-19 03:55:12,785 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3611.318033 2021-02-19 03:55:12,993 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3236.000000 2021-02-19 03:55:13,035 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6222.771731 2021-02-19 03:55:13,068 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1634.000000 2021-02-19 03:55:13,076 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4626.900000 2021-02-19 03:55:13,384 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:13,461 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7266.028629 2021-02-19 03:55:14,028 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:14,372 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:14,427 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3611.318033 2021-02-19 03:55:14,433 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7621.880568 2021-02-19 03:55:14,621 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3236.000000 2021-02-19 03:55:14,684 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6222.771731 2021-02-19 03:55:14,732 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4626.900000 2021-02-19 03:55:14,755 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1634.000000 2021-02-19 03:55:15,015 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:15,105 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7266.028629 2021-02-19 03:55:15,351 | test | DEBUG | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 40.00 % 2021-02-19 03:55:15,351 | test | INFO | pool-1-thread-25 | [task:check:330] Rebalance - status: running, progress: 40.0 2021-02-19 03:55:15,648 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:16,003 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:16,092 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7621.880568 2021-02-19 03:55:16,108 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3611.318033 2021-02-19 03:55:16,288 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3236.000000 2021-02-19 03:55:16,365 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4453.200000 2021-02-19 03:55:16,374 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6222.771731 2021-02-19 03:55:16,408 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2682.400000 2021-02-19 03:55:16,648 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:16,749 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7114.528629 2021-02-19 03:55:17,269 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:17,634 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:17,733 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7435.180568 2021-02-19 03:55:17,763 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3561.818033 2021-02-19 03:55:17,812 | test | INFO | MainThread | [rest_client:rebalance_reached:108] Rebalance reached >40.0% in 190.606999874 seconds 2021-02-19 03:55:17,828 | test | DEBUG | MainThread | [rest_client:diag_eval:1363] /diag/eval status on 172.23.110.64:8091: 1 content: true command: ns_orchestrator:needs_rebalance() 2021-02-19 03:55:17,828 | test | INFO | MainThread | [Magma:abort_rebalance:912] Abort rebalance 2021-02-19 03:55:17,913 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3196.600000 2021-02-19 03:55:18,013 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4453.200000 2021-02-19 03:55:18,016 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6086.571731 2021-02-19 03:55:18,033 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2682.400000 2021-02-19 03:55:18,269 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:18,283 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L914 2021-02-19 03:55:18,283 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 60 seconds. Reason: Sleep after error introduction 2021-02-19 03:55:18,348 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7114.528629 2021-02-19 03:55:18,859 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:19,230 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:19,349 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7435.180568 2021-02-19 03:55:19,381 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3520.565466 2021-02-19 03:55:19,529 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3196.600000 2021-02-19 03:55:19,614 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4453.200000 2021-02-19 03:55:19,635 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5940.769948 2021-02-19 03:55:19,648 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2682.400000 2021-02-19 03:55:19,861 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:19,956 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7069.953541 2021-02-19 03:55:20,394 | test | ERROR | pool-1-thread-25 | [rest_client:_rebalance_status_and_progress:1494] {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 03:55:20,423 | test | INFO | pool-1-thread-25 | [rest_client:print_UI_logs:2599] Latest logs from UI on 172.23.110.64: 2021-02-19 03:55:20,423 | test | ERROR | pool-1-thread-25 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_orchestrator', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735718873L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:55:18.873Z', u'text': u'Rebalance exited with reason {mover_crashed,\n {unexpected_exit,\n {\'EXIT\',<0.28675.33>,\n {{wait_seqno_persisted_failed,\n "GleamBookUsers4",338,13618,\n [{\'ns_1@172.23.110.64\',\n {\'EXIT\',\n {{{badmatch,{error,closed}},\n [{mc_client_binary,cmd_vocal_recv,5,\n [{file,"src/mc_client_binary.erl"},\n {line,158}]},\n {mc_client_binary,select_bucket,2,\n [{file,"src/mc_client_binary.erl"},\n {line,350}]},\n {ns_memcached_sockets_pool,\n take_socket,2,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,46}]},\n {ns_memcached_sockets_pool,\n \'-executing_on_socket/3-fun-0-\',3,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,88}]},\n {async,\'-async_init/4-fun-1-\',3,\n [{file,"src/async.erl"},\n {line,197}]}]},\n {gen_server,call,\n [{\'janitor_agent-GleamBookUsers4\',\n \'ns_1@172.23.110.64\'},\n {if_rebalance,<0.28084.33>,\n {wait_seqno_persisted,338,13618}},\n infinity]}}}}]},\n [{ns_single_vbucket_mover,\n \'-wait_seqno_persisted_many/5-fun-2-\',5,\n [{file,"src/ns_single_vbucket_mover.erl"},\n {line,488}]},\n {proc_lib,init_p,3,\n [{file,"proc_lib.erl"},{line,234}]}]}}}}.\nRebalance Operation Id = 6778a0239229755af5c32f3203e04e76'} 2021-02-19 03:55:20,423 | test | ERROR | pool-1-thread-25 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_log', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735718847L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:55:18.847Z', u'text': u"Service 'memcached' exited with status 137. Restarting. Messages:\nWARNING: Logging before InitGoogleLogging() is written to STDERR\nW0219 03:49:03.333839 38186 HazptrDomain.h:671] Using the default inline executor for asynchronous reclamation may be susceptible to deadlock if the current thread happens to hold a resource needed by the deleter of a reclaimable object"} 2021-02-19 03:55:20,424 | test | ERROR | pool-1-thread-25 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735718843L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:55:18.843Z', u'text': u'Worker <0.28539.33> (for action {move,{338,\n [\'ns_1@172.23.110.65\',\n \'ns_1@172.23.110.69\'],\n [\'ns_1@172.23.110.65\',\n \'ns_1@172.23.110.64\'],\n []}}) exited with reason {unexpected_exit,\n {\'EXIT\',\n <0.28675.33>,\n {{wait_seqno_persisted_failed,\n "GleamBookUsers4",\n 338,13618,\n [{\'ns_1@172.23.110.64\',\n {\'EXIT\',\n {{{badmatch,\n {error,\n closed}},\n [{mc_client_binary,\n cmd_vocal_recv,\n 5,\n [{file,\n "src/mc_client_binary.erl"},\n {line,\n 158}]},\n {mc_client_binary,\n select_bucket,\n 2,\n [{file,\n "src/mc_client_binary.erl"},\n {line,\n 350}]},\n {ns_memcached_sockets_pool,\n take_socket,\n 2,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,\n 46}]},\n {ns_memcached_sockets_pool,\n \'-executing_on_socket/3-fun-0-\',\n 3,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,\n 88}]},\n {async,\n \'-async_init/4-fun-1-\',\n 3,\n [{file,\n "src/async.erl"},\n {line,\n 197}]}]},\n {gen_server,\n call,\n [{\'janitor_agent-GleamBookUsers4\',\n \'ns_1@172.23.110.64\'},\n {if_rebalance,\n <0.28084.33>,\n {wait_seqno_persisted,\n 338,\n 13618}},\n infinity]}}}}]},\n [{ns_single_vbucket_mover,\n \'-wait_seqno_persisted_many/5-fun-2-\',\n 5,\n [{file,\n "src/ns_single_vbucket_mover.erl"},\n {line,\n 488}]},\n {proc_lib,\n init_p,3,\n [{file,\n "proc_lib.erl"},\n {line,\n 234}]}]}}}'} 2021-02-19 03:55:20,424 | test | ERROR | pool-1-thread-25 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735718841L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:55:18.841Z', u'text': u"Control connection to memcached on 'ns_1@172.23.110.64' disconnected. Check logs for details."} 2021-02-19 03:55:20,424 | test | ERROR | pool-1-thread-25 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613735716170L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:55:16.170Z', u'text': u'Shutting down bucket "GleamBookUsers3" on \'ns_1@172.23.110.69\' for deletion'} 2021-02-19 03:55:20,424 | test | ERROR | pool-1-thread-25 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735715720L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:55:15.720Z', u'text': u'Bucket "GleamBookUsers4" rebalance does not seem to be swap rebalance'} 2021-02-19 03:55:20,424 | test | ERROR | pool-1-thread-25 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_rebalancer', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735715600L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:55:15.600Z', u'text': u'Started rebalancing bucket GleamBookUsers4'} 2021-02-19 03:55:20,424 | test | ERROR | pool-1-thread-25 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613735552147L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:52:32.147Z', u'text': u'Shutting down bucket "GleamBookUsers2" on \'ns_1@172.23.110.69\' for deletion'} 2021-02-19 03:55:20,424 | test | ERROR | pool-1-thread-25 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735551699L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:52:31.699Z', u'text': u'Bucket "GleamBookUsers3" rebalance does not seem to be swap rebalance'} 2021-02-19 03:55:20,424 | test | ERROR | pool-1-thread-25 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_rebalancer', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735551578L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:52:31.578Z', u'text': u'Started rebalancing bucket GleamBookUsers3'} 2021-02-19 03:55:20,424 | test | ERROR | pool-1-thread-25 | [task:call:242] Rebalance Failed: {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 03:55:20,476 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:20,858 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:20,976 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7189.621208 2021-02-19 03:55:21,046 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3520.565466 2021-02-19 03:55:21,171 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3196.600000 2021-02-19 03:55:21,273 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4453.200000 2021-02-19 03:55:21,301 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5940.769948 2021-02-19 03:55:21,328 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2682.400000 2021-02-19 03:55:21,469 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:21,555 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7069.953541 2021-02-19 03:55:22,125 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:22,476 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:22,598 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4710.821208 2021-02-19 03:55:22,664 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2335.365466 2021-02-19 03:55:22,799 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1587.400000 2021-02-19 03:55:22,890 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2191.100000 2021-02-19 03:55:22,913 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3910.169948 2021-02-19 03:55:22,940 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1597.800000 2021-02-19 03:55:23,099 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:23,171 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4702.653541 2021-02-19 03:55:23,710 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:24,065 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:24,213 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4710.821208 2021-02-19 03:55:24,270 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2335.365466 2021-02-19 03:55:24,407 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1587.400000 2021-02-19 03:55:24,523 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2191.100000 2021-02-19 03:55:24,523 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3910.169948 2021-02-19 03:55:24,548 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1597.800000 2021-02-19 03:55:24,727 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:24,802 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4702.653541 2021-02-19 03:55:25,311 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:25,677 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:25,819 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3378.221208 2021-02-19 03:55:25,881 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1758.665466 2021-02-19 03:55:26,003 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 817.100000 2021-02-19 03:55:26,140 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3910.169948 2021-02-19 03:55:26,171 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2191.100000 2021-02-19 03:55:26,190 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1597.800000 2021-02-19 03:55:26,334 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:26,407 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3638.553541 2021-02-19 03:55:26,898 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:27,278 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:27,467 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3378.221208 2021-02-19 03:55:27,499 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1758.665466 2021-02-19 03:55:27,596 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 817.100000 2021-02-19 03:55:27,736 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2901.169948 2021-02-19 03:55:27,756 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1176.100000 2021-02-19 03:55:27,782 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1008.200000 2021-02-19 03:55:27,927 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:28,013 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3638.553541 2021-02-19 03:55:28,470 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:28,861 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:29,111 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1758.665466 2021-02-19 03:55:29,147 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3378.221208 2021-02-19 03:55:29,253 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 817.100000 2021-02-19 03:55:29,362 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1176.100000 2021-02-19 03:55:29,377 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2901.169948 2021-02-19 03:55:29,390 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1008.200000 2021-02-19 03:55:29,549 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:29,609 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1405.500000 2021-02-19 03:55:30,055 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:30,424 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:30,710 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 672.000000 2021-02-19 03:55:30,776 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1165.800000 2021-02-19 03:55:30,875 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 817.100000 2021-02-19 03:55:30,964 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1176.100000 2021-02-19 03:55:30,979 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1111.800000 2021-02-19 03:55:30,990 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1008.200000 2021-02-19 03:55:31,131 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:31,187 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1405.500000 2021-02-19 03:55:31,625 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:31,996 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:32,302 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 672.000000 2021-02-19 03:55:32,378 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1169.450000 2021-02-19 03:55:32,496 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 817.750000 2021-02-19 03:55:32,566 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1176.100000 2021-02-19 03:55:32,584 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1111.800000 2021-02-19 03:55:32,628 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1008.200000 2021-02-19 03:55:32,760 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:32,816 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1405.500000 2021-02-19 03:55:33,187 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:33,601 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:33,907 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 672.000000 2021-02-19 03:55:33,971 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1169.450000 2021-02-19 03:55:34,091 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 817.750000 2021-02-19 03:55:34,144 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1176.100000 2021-02-19 03:55:34,220 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1008.200000 2021-02-19 03:55:34,236 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1111.800000 2021-02-19 03:55:34,358 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:34,421 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1405.500000 2021-02-19 03:55:34,766 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:35,174 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:35,505 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 77.000000 2021-02-19 03:55:35,615 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 94.250000 2021-02-19 03:55:35,688 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.650000 2021-02-19 03:55:35,727 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:55:35,845 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 03:55:35,861 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 135.500000 2021-02-19 03:55:35,963 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:36,042 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 150.800000 2021-02-19 03:55:36,381 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:36,766 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:37,111 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 77.000000 2021-02-19 03:55:37,263 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 94.250000 2021-02-19 03:55:37,319 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.650000 2021-02-19 03:55:37,368 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:55:37,427 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 03:55:37,470 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 135.500000 2021-02-19 03:55:37,573 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:37,634 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 150.800000 2021-02-19 03:55:37,986 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:38,328 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:38,721 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 77.000000 2021-02-19 03:55:38,862 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 94.250000 2021-02-19 03:55:38,918 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.650000 2021-02-19 03:55:38,960 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:55:38,996 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 03:55:39,046 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 135.500000 2021-02-19 03:55:39,155 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:39,211 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 150.800000 2021-02-19 03:55:39,555 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:39,881 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:40,301 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:55:40,496 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3.650000 2021-02-19 03:55:40,509 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.650000 2021-02-19 03:55:40,582 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 03:55:40,595 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:55:40,631 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:55:40,750 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:40,802 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:55:41,141 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:41,448 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:41,891 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:55:42,095 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3.650000 2021-02-19 03:55:42,138 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.650000 2021-02-19 03:55:42,194 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:55:42,197 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 03:55:42,267 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:55:42,345 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:42,401 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:55:42,713 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:43,012 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:43,492 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:55:43,688 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 15.200000 2021-02-19 03:55:43,729 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 7.600000 2021-02-19 03:55:43,790 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:55:43,806 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 03:55:43,867 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 03:55:43,963 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:44,007 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:55:44,290 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:44,588 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:45,071 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 03:55:45,328 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 15.200000 2021-02-19 03:55:45,375 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 7.600000 2021-02-19 03:55:45,387 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:55:45,400 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 03:55:45,464 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 477.300000 2021-02-19 03:55:45,552 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:45,601 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 663.100000 2021-02-19 03:55:45,884 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:46,157 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:46,645 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 27.600000 2021-02-19 03:55:46,936 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 15.500000 2021-02-19 03:55:46,982 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:55:46,999 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 03:55:47,009 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 7.600000 2021-02-19 03:55:47,105 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 477.300000 2021-02-19 03:55:47,150 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:47,200 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 663.100000 2021-02-19 03:55:47,477 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:47,744 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:48,233 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 27.600000 2021-02-19 03:55:48,562 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 15.500000 2021-02-19 03:55:48,598 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 03:55:48,617 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:55:48,634 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 7.600000 2021-02-19 03:55:48,753 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 477.300000 2021-02-19 03:55:48,769 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:48,802 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 663.100000 2021-02-19 03:55:49,059 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:49,323 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:49,838 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 780.600000 2021-02-19 03:55:50,177 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 15.500000 2021-02-19 03:55:50,223 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 7.600000 2021-02-19 03:55:50,247 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 03:55:50,252 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:55:50,348 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2261.900000 2021-02-19 03:55:50,372 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:50,427 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2725.400000 2021-02-19 03:55:50,641 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:50,892 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:51,443 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 780.600000 2021-02-19 03:55:51,798 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 15.900000 2021-02-19 03:55:51,819 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 7.600000 2021-02-19 03:55:51,858 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 03:55:51,884 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 03:55:51,974 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2261.900000 2021-02-19 03:55:51,983 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:52,025 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2725.400000 2021-02-19 03:55:52,247 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:52,461 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:53,036 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1991.100000 2021-02-19 03:55:53,431 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2.000000 2021-02-19 03:55:53,450 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 78.800000 2021-02-19 03:55:53,513 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.800000 2021-02-19 03:55:53,540 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.900000 2021-02-19 03:55:53,614 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:53,634 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4857.000000 2021-02-19 03:55:53,661 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5688.000000 2021-02-19 03:55:53,848 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:54,038 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:54,625 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1991.100000 2021-02-19 03:55:55,055 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2.000000 2021-02-19 03:55:55,065 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 78.800000 2021-02-19 03:55:55,151 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.800000 2021-02-19 03:55:55,167 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.900000 2021-02-19 03:55:55,256 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4857.000000 2021-02-19 03:55:55,260 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:55,289 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5688.000000 2021-02-19 03:55:55,454 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:55,621 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:56,223 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1991.100000 2021-02-19 03:55:56,673 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 717.800000 2021-02-19 03:55:56,690 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1.700000 2021-02-19 03:55:56,766 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 485.800000 2021-02-19 03:55:56,782 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 696.600000 2021-02-19 03:55:56,862 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7163.400000 2021-02-19 03:55:56,885 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:56,928 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8115.400000 2021-02-19 03:55:57,049 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:57,198 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:57,832 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3532.400000 2021-02-19 03:55:58,266 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 717.800000 2021-02-19 03:55:58,293 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1.700000 2021-02-19 03:55:58,380 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 485.800000 2021-02-19 03:55:58,403 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 696.600000 2021-02-19 03:55:58,492 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7163.400000 2021-02-19 03:55:58,506 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:55:58,540 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8115.400000 2021-02-19 03:55:58,670 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:55:58,782 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:55:59,453 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4177.600000 2021-02-19 03:55:59,865 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 717.800000 2021-02-19 03:55:59,937 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1.300000 2021-02-19 03:55:59,973 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 485.800000 2021-02-19 03:56:00,003 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 696.600000 2021-02-19 03:56:00,105 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7163.400000 2021-02-19 03:56:00,125 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:00,153 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8115.400000 2021-02-19 03:56:00,272 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:00,361 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:01,051 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4177.600000 2021-02-19 03:56:01,456 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 717.800000 2021-02-19 03:56:01,528 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1.300000 2021-02-19 03:56:01,576 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 485.800000 2021-02-19 03:56:01,617 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 696.600000 2021-02-19 03:56:01,717 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7883.100000 2021-02-19 03:56:01,746 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:01,762 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8927.200000 2021-02-19 03:56:01,891 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:01,927 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:02,644 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4267.200000 2021-02-19 03:56:03,085 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2412.000000 2021-02-19 03:56:03,165 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:56:03,204 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2616.600000 2021-02-19 03:56:03,229 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3234.700000 2021-02-19 03:56:03,345 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7674.000000 2021-02-19 03:56:03,369 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:03,378 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8727.000000 2021-02-19 03:56:03,477 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:03,502 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:04,223 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4267.200000 2021-02-19 03:56:04,664 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2412.000000 2021-02-19 03:56:04,780 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:56:04,798 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2616.600000 2021-02-19 03:56:04,811 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3234.700000 2021-02-19 03:56:04,950 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7674.000000 2021-02-19 03:56:04,997 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:05,010 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8727.000000 2021-02-19 03:56:05,079 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:05,089 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:05,811 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3956.800000 2021-02-19 03:56:06,255 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2412.000000 2021-02-19 03:56:06,397 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:56:06,401 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4460.100000 2021-02-19 03:56:06,417 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5134.400000 2021-02-19 03:56:06,572 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7280.100000 2021-02-19 03:56:06,605 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:06,628 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8365.600000 2021-02-19 03:56:06,674 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:06,720 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:07,424 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3956.800000 2021-02-19 03:56:07,835 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3471.000000 2021-02-19 03:56:08,013 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4460.100000 2021-02-19 03:56:08,032 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5134.400000 2021-02-19 03:56:08,046 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:56:08,183 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7280.100000 2021-02-19 03:56:08,270 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8365.600000 2021-02-19 03:56:08,273 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:08,276 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:08,328 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:09,016 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3956.800000 2021-02-19 03:56:09,413 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3471.000000 2021-02-19 03:56:09,640 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:56:09,667 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4460.100000 2021-02-19 03:56:09,686 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5134.400000 2021-02-19 03:56:09,829 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7214.700000 2021-02-19 03:56:09,862 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:09,881 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8286.100000 2021-02-19 03:56:09,904 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:09,956 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:10,607 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3829.000000 2021-02-19 03:56:10,993 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3471.000000 2021-02-19 03:56:11,286 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4460.100000 2021-02-19 03:56:11,296 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:56:11,319 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5134.400000 2021-02-19 03:56:11,463 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7214.700000 2021-02-19 03:56:11,482 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:11,509 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:11,520 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8286.100000 2021-02-19 03:56:11,558 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:12,197 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3829.000000 2021-02-19 03:56:12,563 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3499.100000 2021-02-19 03:56:12,888 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4692.200000 2021-02-19 03:56:12,915 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:56:12,928 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5252.000000 2021-02-19 03:56:13,085 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:13,108 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7235.100000 2021-02-19 03:56:13,125 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:13,155 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8332.700000 2021-02-19 03:56:13,180 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:13,773 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3823.900000 2021-02-19 03:56:14,132 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3499.100000 2021-02-19 03:56:14,490 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4692.200000 2021-02-19 03:56:14,523 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5252.000000 2021-02-19 03:56:14,533 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:56:14,686 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:14,713 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7235.100000 2021-02-19 03:56:14,746 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:14,775 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8332.700000 2021-02-19 03:56:14,792 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:15,372 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3823.900000 2021-02-19 03:56:15,710 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3629.400000 2021-02-19 03:56:16,076 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4764.100000 2021-02-19 03:56:16,128 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 03:56:16,142 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5252.000000 2021-02-19 03:56:16,266 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:16,315 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7235.100000 2021-02-19 03:56:16,355 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:16,378 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8417.400000 2021-02-19 03:56:16,404 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:16,953 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3858.100000 2021-02-19 03:56:17,283 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3629.400000 2021-02-19 03:56:17,694 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4764.100000 2021-02-19 03:56:17,743 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5309.900000 2021-02-19 03:56:17,746 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.200000 2021-02-19 03:56:17,881 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:17,931 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7235.500000 2021-02-19 03:56:17,986 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:18,015 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8417.400000 2021-02-19 03:56:18,036 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:18,318 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.64:8091 2021-02-19 03:56:18,318 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 03:56:18,342 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.64:8091 is running 2021-02-19 03:56:18,342 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:18,579 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3858.100000 2021-02-19 03:56:18,786 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.443000078201. 2021-02-19 03:56:18,786 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:18,901 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3629.400000 2021-02-19 03:56:19,237 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.450999975204. 2021-02-19 03:56:19,237 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:19,279 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4764.100000 2021-02-19 03:56:19,368 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5309.900000 2021-02-19 03:56:19,378 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.200000 2021-02-19 03:56:19,536 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:19,562 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7165.552419 2021-02-19 03:56:19,638 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:19,638 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8449.369372 2021-02-19 03:56:19,661 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:19,687 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.448000192642. 2021-02-19 03:56:19,687 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:20,112 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.425999879837. 2021-02-19 03:56:20,112 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:20,181 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3858.100000 2021-02-19 03:56:20,506 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3629.400000 2021-02-19 03:56:20,552 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.44000005722. 2021-02-19 03:56:20,552 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:20,882 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4764.100000 2021-02-19 03:56:20,970 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5309.900000 2021-02-19 03:56:21,009 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.454999923706. 2021-02-19 03:56:21,009 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:21,009 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 56.277569 2021-02-19 03:56:21,144 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:21,289 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7165.552419 2021-02-19 03:56:21,299 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8449.369372 2021-02-19 03:56:21,308 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:21,326 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:21,460 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.450999975204. 2021-02-19 03:56:21,460 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:21,818 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3928.663615 2021-02-19 03:56:21,914 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.453999996185. 2021-02-19 03:56:21,914 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:22,092 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3629.400000 2021-02-19 03:56:22,358 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.444999933243. 2021-02-19 03:56:22,358 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:22,506 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4639.400000 2021-02-19 03:56:22,592 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5235.300000 2021-02-19 03:56:22,651 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 807.577569 2021-02-19 03:56:22,783 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:22,805 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.446000099182. 2021-02-19 03:56:22,845 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.65:8091 2021-02-19 03:56:22,845 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 03:56:22,868 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.65:8091 is running 2021-02-19 03:56:22,868 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:22,967 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7035.052419 2021-02-19 03:56:23,013 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:23,042 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8365.569372 2021-02-19 03:56:23,055 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:23,334 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.465000152588. 2021-02-19 03:56:23,335 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:23,492 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3939.063615 2021-02-19 03:56:23,730 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3598.600000 2021-02-19 03:56:23,796 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.460999965668. 2021-02-19 03:56:23,796 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:24,165 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4639.400000 2021-02-19 03:56:24,233 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.43799996376. 2021-02-19 03:56:24,233 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:24,252 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5235.300000 2021-02-19 03:56:24,308 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 807.577569 2021-02-19 03:56:24,436 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:24,618 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7035.052419 2021-02-19 03:56:24,677 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:24,681 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.447999954224. 2021-02-19 03:56:24,684 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:24,707 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8365.569372 2021-02-19 03:56:24,727 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:25,127 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.443000078201. 2021-02-19 03:56:25,127 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:25,148 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3939.063615 2021-02-19 03:56:25,358 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3598.600000 2021-02-19 03:56:25,607 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.478999853134. 2021-02-19 03:56:25,607 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:25,822 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4312.800000 2021-02-19 03:56:25,904 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5053.500000 2021-02-19 03:56:25,984 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2236.377569 2021-02-19 03:56:26,039 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.432999849319. 2021-02-19 03:56:26,039 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:26,078 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:26,342 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7035.052419 2021-02-19 03:56:26,362 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:26,405 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:26,411 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8365.569372 2021-02-19 03:56:26,473 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.434000015259. 2021-02-19 03:56:26,473 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:26,819 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3917.463615 2021-02-19 03:56:26,940 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.466000080109. 2021-02-19 03:56:26,940 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 03:56:26,996 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3432.200000 2021-02-19 03:56:27,375 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.4359998703. 2021-02-19 03:56:27,377 | test | INFO | MainThread | [Magma:abort_rebalance:927] Restarting Rebalance after killing at 40 2021-02-19 03:56:27,430 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[]_OUT=[172.23.110.69]_1613735787.38 2021-02-19 03:56:27,430 | infra | INFO | pool-1-thread-26 | [task:start_task:84] Thread 'Rebalance_task_IN=[]_OUT=[172.23.110.69]_1613735787.38' started 2021-02-19 03:56:27,450 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L932 2021-02-19 03:56:27,450 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 120 seconds. Reason: Let the rebalance begin after abort 2021-02-19 03:56:27,503 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4312.800000 2021-02-19 03:56:27,519 | test | DEBUG | pool-1-thread-26 | [task:start_rebalance:301] Removing node 172.23.110.69:8091 from cluster 2021-02-19 03:56:27,519 | test | DEBUG | pool-1-thread-26 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': u'ns_1@172.23.110.69', 'user': 'Administrator'} 2021-02-19 03:56:27,572 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5053.500000 2021-02-19 03:56:27,582 | test | DEBUG | pool-1-thread-26 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 03:56:27,588 | test | INFO | pool-1-thread-26 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+---------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 15.3384915676 | Cluster node | | 172.23.110.69 | kv | 7.0.0-4498-enterprise | 10.7567991485 | --- OUT ---> | | 172.23.110.65 | kv | 7.0.0-4498-enterprise | 14.5456844945 | Cluster node | +---------------+----------+-----------------------+---------------+--------------+ 2021-02-19 03:56:27,598 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 03:56:27,598 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 03:56:27,650 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2236.377569 2021-02-19 03:56:27,740 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:28,020 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6774.052419 2021-02-19 03:56:28,046 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:28,119 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8135.269372 2021-02-19 03:56:28,127 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:28,502 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3917.463615 2021-02-19 03:56:28,667 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3432.200000 2021-02-19 03:56:29,176 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4312.800000 2021-02-19 03:56:29,262 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5053.500000 2021-02-19 03:56:29,398 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2236.377569 2021-02-19 03:56:29,440 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:29,690 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6351.978752 2021-02-19 03:56:29,706 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:29,796 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7656.038936 2021-02-19 03:56:29,805 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:30,148 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3917.463615 2021-02-19 03:56:30,342 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3432.200000 2021-02-19 03:56:30,851 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4312.800000 2021-02-19 03:56:30,914 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5053.500000 2021-02-19 03:56:31,085 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4597.466867 2021-02-19 03:56:31,104 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:31,371 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6351.978752 2021-02-19 03:56:31,381 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:31,503 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7656.038936 2021-02-19 03:56:31,516 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:31,848 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3697.448379 2021-02-19 03:56:32,019 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3432.200000 2021-02-19 03:56:32,484 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4044.800000 2021-02-19 03:56:32,551 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4726.400000 2021-02-19 03:56:32,691 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 40.29 % 2021-02-19 03:56:32,691 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 40.2924513679 2021-02-19 03:56:32,730 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6135.166867 2021-02-19 03:56:32,743 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:33,029 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6044.778752 2021-02-19 03:56:33,035 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:33,157 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:33,174 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7291.738936 2021-02-19 03:56:33,473 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3517.748379 2021-02-19 03:56:33,641 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3158.200000 2021-02-19 03:56:34,108 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4044.800000 2021-02-19 03:56:34,165 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4726.400000 2021-02-19 03:56:34,351 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6135.166867 2021-02-19 03:56:34,358 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:34,694 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6044.778752 2021-02-19 03:56:34,703 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:34,788 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:34,808 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7291.738936 2021-02-19 03:56:35,112 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3517.748379 2021-02-19 03:56:35,256 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3158.200000 2021-02-19 03:56:35,739 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3984.300000 2021-02-19 03:56:35,795 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4560.000000 2021-02-19 03:56:36,006 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6657.566867 2021-02-19 03:56:36,026 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:36,332 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:36,344 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6044.778752 2021-02-19 03:56:36,427 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:36,469 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7063.238936 2021-02-19 03:56:36,733 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3378.248379 2021-02-19 03:56:36,872 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3023.300000 2021-02-19 03:56:37,404 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3984.300000 2021-02-19 03:56:37,466 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4560.000000 2021-02-19 03:56:37,644 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6657.566867 2021-02-19 03:56:37,657 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:37,747 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 40.84 % 2021-02-19 03:56:37,749 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 40.8410447183 2021-02-19 03:56:37,977 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:37,993 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5922.578752 2021-02-19 03:56:38,065 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:38,117 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7063.238936 2021-02-19 03:56:38,368 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3378.248379 2021-02-19 03:56:38,483 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3023.300000 2021-02-19 03:56:39,052 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3984.300000 2021-02-19 03:56:39,075 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4560.000000 2021-02-19 03:56:39,298 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6657.566867 2021-02-19 03:56:39,311 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:39,622 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:39,650 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6060.200000 2021-02-19 03:56:39,697 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:39,759 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7147.300000 2021-02-19 03:56:40,010 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3435.300000 2021-02-19 03:56:40,108 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3023.300000 2021-02-19 03:56:40,674 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3984.300000 2021-02-19 03:56:40,694 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4560.000000 2021-02-19 03:56:40,938 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5671.500000 2021-02-19 03:56:40,953 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:41,263 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:41,289 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6060.200000 2021-02-19 03:56:41,377 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:41,413 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7147.300000 2021-02-19 03:56:41,664 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3435.300000 2021-02-19 03:56:41,753 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3023.300000 2021-02-19 03:56:42,339 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4048.900000 2021-02-19 03:56:42,346 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4713.700000 2021-02-19 03:56:42,602 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:42,618 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4712.400000 2021-02-19 03:56:42,835 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 41.33 % 2021-02-19 03:56:42,836 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 41.3272882275 2021-02-19 03:56:42,940 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6156.400000 2021-02-19 03:56:42,976 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:43,059 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:43,091 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7242.500000 2021-02-19 03:56:43,315 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3553.700000 2021-02-19 03:56:43,410 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3145.400000 2021-02-19 03:56:43,977 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4048.900000 2021-02-19 03:56:43,987 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4713.700000 2021-02-19 03:56:44,292 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:44,335 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4712.400000 2021-02-19 03:56:44,591 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6156.400000 2021-02-19 03:56:44,625 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:44,730 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:44,749 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7242.500000 2021-02-19 03:56:44,974 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3553.700000 2021-02-19 03:56:45,065 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3145.400000 2021-02-19 03:56:45,601 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4079.800000 2021-02-19 03:56:45,631 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4794.700000 2021-02-19 03:56:45,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:45,980 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4177.700000 2021-02-19 03:56:46,273 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6156.400000 2021-02-19 03:56:46,322 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:46,381 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:46,404 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7242.500000 2021-02-19 03:56:46,608 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3654.900000 2021-02-19 03:56:46,706 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3263.100000 2021-02-19 03:56:47,265 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4079.800000 2021-02-19 03:56:47,290 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4794.700000 2021-02-19 03:56:47,552 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:47,634 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4177.700000 2021-02-19 03:56:47,887 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 41.82 % 2021-02-19 03:56:47,887 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 41.8199643494 2021-02-19 03:56:47,963 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6208.900000 2021-02-19 03:56:47,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:48,072 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7329.200000 2021-02-19 03:56:48,078 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:48,260 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3654.900000 2021-02-19 03:56:48,345 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3263.100000 2021-02-19 03:56:48,898 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4079.800000 2021-02-19 03:56:48,913 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4794.700000 2021-02-19 03:56:49,174 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:49,252 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4177.700000 2021-02-19 03:56:49,680 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:49,698 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6168.786684 2021-02-19 03:56:49,724 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7278.285854 2021-02-19 03:56:49,746 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:49,888 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3696.734050 2021-02-19 03:56:49,967 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3263.100000 2021-02-19 03:56:50,513 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4079.800000 2021-02-19 03:56:50,533 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4794.700000 2021-02-19 03:56:50,779 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:50,903 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4022.417255 2021-02-19 03:56:51,302 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:51,345 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6168.786684 2021-02-19 03:56:51,374 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7278.285854 2021-02-19 03:56:51,388 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:51,532 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3696.734050 2021-02-19 03:56:51,611 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3263.100000 2021-02-19 03:56:52,158 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4079.800000 2021-02-19 03:56:52,171 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4794.700000 2021-02-19 03:56:52,404 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:52,540 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4258.517255 2021-02-19 03:56:52,934 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 42.39 % 2021-02-19 03:56:52,934 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 42.3916918546 2021-02-19 03:56:52,940 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:52,986 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6204.186684 2021-02-19 03:56:53,036 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7261.085854 2021-02-19 03:56:53,046 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:53,177 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3685.534050 2021-02-19 03:56:53,226 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3300.400000 2021-02-19 03:56:53,799 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4158.800000 2021-02-19 03:56:53,811 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4734.500000 2021-02-19 03:56:54,019 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:54,142 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4258.517255 2021-02-19 03:56:54,562 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:54,618 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6204.186684 2021-02-19 03:56:54,671 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:54,700 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7261.085854 2021-02-19 03:56:54,805 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3685.534050 2021-02-19 03:56:54,871 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3300.400000 2021-02-19 03:56:55,440 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4158.800000 2021-02-19 03:56:55,469 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4705.100000 2021-02-19 03:56:55,634 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:55,766 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4385.917255 2021-02-19 03:56:56,181 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:56,250 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6204.186684 2021-02-19 03:56:56,301 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:56,345 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7261.085854 2021-02-19 03:56:56,427 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3694.434050 2021-02-19 03:56:56,494 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3320.200000 2021-02-19 03:56:57,078 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4241.700000 2021-02-19 03:56:57,109 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4705.100000 2021-02-19 03:56:57,250 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:57,414 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4385.917255 2021-02-19 03:56:57,855 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:57,918 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6260.886684 2021-02-19 03:56:57,944 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:57,974 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 42.93 % 2021-02-19 03:56:57,974 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 42.9271099744 2021-02-19 03:56:58,026 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7311.585854 2021-02-19 03:56:58,071 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3694.434050 2021-02-19 03:56:58,138 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3320.200000 2021-02-19 03:56:58,687 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4241.700000 2021-02-19 03:56:58,730 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4705.100000 2021-02-19 03:56:58,854 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:56:59,038 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4385.917255 2021-02-19 03:56:59,500 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:56:59,595 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6377.048164 2021-02-19 03:56:59,612 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:56:59,663 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7471.762199 2021-02-19 03:56:59,701 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3721.574092 2021-02-19 03:56:59,776 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3320.200000 2021-02-19 03:57:00,296 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4241.700000 2021-02-19 03:57:00,344 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4705.100000 2021-02-19 03:57:00,463 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:00,664 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4106.498920 2021-02-19 03:57:01,145 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:01,220 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6377.048164 2021-02-19 03:57:01,247 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:57:01,322 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7471.762199 2021-02-19 03:57:01,352 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3721.574092 2021-02-19 03:57:01,430 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3320.200000 2021-02-19 03:57:01,930 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4241.700000 2021-02-19 03:57:01,957 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4705.100000 2021-02-19 03:57:02,059 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:02,295 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4059.798920 2021-02-19 03:57:02,766 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:02,892 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6432.848164 2021-02-19 03:57:02,901 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:57:02,971 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7564.462199 2021-02-19 03:57:03,036 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 43.45 % 2021-02-19 03:57:03,036 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 43.4493528637 2021-02-19 03:57:03,038 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3749.574092 2021-02-19 03:57:03,092 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3310.100000 2021-02-19 03:57:03,575 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4233.100000 2021-02-19 03:57:03,594 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4692.500000 2021-02-19 03:57:03,691 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:03,915 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4059.798920 2021-02-19 03:57:04,388 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:04,526 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:57:04,582 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6432.848164 2021-02-19 03:57:04,696 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7564.462199 2021-02-19 03:57:04,697 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3749.574092 2021-02-19 03:57:04,746 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3310.100000 2021-02-19 03:57:05,203 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4233.100000 2021-02-19 03:57:05,230 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4692.500000 2021-02-19 03:57:05,305 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:05,552 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4044.498920 2021-02-19 03:57:06,058 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:06,201 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:57:06,211 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6432.848164 2021-02-19 03:57:06,331 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7564.462199 2021-02-19 03:57:06,362 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3749.574092 2021-02-19 03:57:06,369 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3310.100000 2021-02-19 03:57:06,865 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4680.700000 2021-02-19 03:57:06,872 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4215.500000 2021-02-19 03:57:06,976 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:07,190 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4044.498920 2021-02-19 03:57:07,717 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:07,844 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:57:07,867 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6435.248164 2021-02-19 03:57:08,000 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7586.162199 2021-02-19 03:57:08,019 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3287.900000 2021-02-19 03:57:08,036 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3757.874092 2021-02-19 03:57:08,088 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 43.93 % 2021-02-19 03:57:08,088 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 43.9323800667 2021-02-19 03:57:08,482 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4680.700000 2021-02-19 03:57:08,496 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4215.500000 2021-02-19 03:57:08,596 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:08,805 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4044.498920 2021-02-19 03:57:08,970 | infra | INFO | pool-2-thread-14 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 03:57:08,970 | infra | INFO | pool-2-thread-14 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope2_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 03:57:09,339 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:09,473 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:57:09,496 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6356.151129 2021-02-19 03:57:09,668 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7584.176794 2021-02-19 03:57:09,684 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3287.900000 2021-02-19 03:57:09,703 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3758.851229 2021-02-19 03:57:10,111 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4680.700000 2021-02-19 03:57:10,131 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4215.500000 2021-02-19 03:57:10,223 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:10,332 | infra | INFO | pool-2-thread-42 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 03:57:10,334 | infra | INFO | pool-2-thread-42 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 03:57:10,440 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3961.052229 2021-02-19 03:57:10,947 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:11,098 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 03:57:11,117 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6356.151129 2021-02-19 03:57:11,315 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3758.851229 2021-02-19 03:57:11,326 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7584.176794 2021-02-19 03:57:11,346 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3287.900000 2021-02-19 03:57:11,756 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4215.500000 2021-02-19 03:57:11,760 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4680.700000 2021-02-19 03:57:11,838 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:12,075 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3961.052229 2021-02-19 03:57:12,578 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:12,710 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6.000000 2021-02-19 03:57:12,756 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6281.251129 2021-02-19 03:57:12,999 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3343.300000 2021-02-19 03:57:13,013 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3756.251229 2021-02-19 03:57:13,026 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7406.276794 2021-02-19 03:57:13,134 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 44.42 % 2021-02-19 03:57:13,135 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 44.4218398822 2021-02-19 03:57:13,384 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4700.300000 2021-02-19 03:57:13,414 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4283.200000 2021-02-19 03:57:13,460 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:13,733 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4103.052229 2021-02-19 03:57:14,198 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:14,325 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6.000000 2021-02-19 03:57:14,417 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6281.251129 2021-02-19 03:57:14,654 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3343.300000 2021-02-19 03:57:14,678 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3756.251229 2021-02-19 03:57:14,688 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7406.276794 2021-02-19 03:57:15,036 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4700.300000 2021-02-19 03:57:15,092 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4283.200000 2021-02-19 03:57:15,104 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:15,275 | infra | INFO | pool-2-thread-22 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.3' completed 2021-02-19 03:57:15,276 | infra | INFO | pool-2-thread-22 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 03:57:15,352 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4103.052229 2021-02-19 03:57:15,832 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:15,960 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 388.300000 2021-02-19 03:57:16,042 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6307.551129 2021-02-19 03:57:16,290 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3343.300000 2021-02-19 03:57:16,328 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7406.276794 2021-02-19 03:57:16,364 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3756.251229 2021-02-19 03:57:16,645 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4783.400000 2021-02-19 03:57:16,717 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4415.100000 2021-02-19 03:57:16,723 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:17,020 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4288.652229 2021-02-19 03:57:17,453 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:17,579 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 388.300000 2021-02-19 03:57:17,661 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6307.551129 2021-02-19 03:57:17,917 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3398.700000 2021-02-19 03:57:17,993 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6534.976794 2021-02-19 03:57:18,006 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3775.551229 2021-02-19 03:57:18,191 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 44.93 % 2021-02-19 03:57:18,191 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 44.9276912346 2021-02-19 03:57:18,256 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4783.400000 2021-02-19 03:57:18,336 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4415.100000 2021-02-19 03:57:18,348 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:18,653 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4288.652229 2021-02-19 03:57:19,065 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:19,200 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 388.300000 2021-02-19 03:57:19,293 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6307.551129 2021-02-19 03:57:19,565 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3398.700000 2021-02-19 03:57:19,632 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4510.908765 2021-02-19 03:57:19,660 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3782.853152 2021-02-19 03:57:19,871 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4783.400000 2021-02-19 03:57:19,966 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:19,967 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4415.100000 2021-02-19 03:57:20,267 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4288.652229 2021-02-19 03:57:20,700 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:20,805 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1326.362838 2021-02-19 03:57:20,924 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6373.088193 2021-02-19 03:57:21,183 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3398.700000 2021-02-19 03:57:21,253 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4510.908765 2021-02-19 03:57:21,283 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3782.853152 2021-02-19 03:57:21,486 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4783.400000 2021-02-19 03:57:21,592 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:21,611 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4415.100000 2021-02-19 03:57:21,880 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4216.204303 2021-02-19 03:57:22,322 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:22,430 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2632.062838 2021-02-19 03:57:22,552 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6497.388193 2021-02-19 03:57:22,796 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3465.200000 2021-02-19 03:57:22,881 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2157.208765 2021-02-19 03:57:22,907 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3783.553152 2021-02-19 03:57:23,108 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4963.500000 2021-02-19 03:57:23,203 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:23,234 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4568.000000 2021-02-19 03:57:23,240 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 45.47 % 2021-02-19 03:57:23,240 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 45.4663256607 2021-02-19 03:57:23,503 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4389.604303 2021-02-19 03:57:23,920 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:24,042 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2632.062838 2021-02-19 03:57:24,178 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6497.388193 2021-02-19 03:57:24,424 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3465.200000 2021-02-19 03:57:24,510 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2157.208765 2021-02-19 03:57:24,522 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3783.553152 2021-02-19 03:57:24,757 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4963.500000 2021-02-19 03:57:24,857 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4568.000000 2021-02-19 03:57:24,871 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:25,140 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4389.604303 2021-02-19 03:57:25,535 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:25,665 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3552.562838 2021-02-19 03:57:25,792 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6560.088193 2021-02-19 03:57:26,078 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3531.300000 2021-02-19 03:57:26,184 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3772.553152 2021-02-19 03:57:26,210 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 514.608765 2021-02-19 03:57:26,378 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4963.500000 2021-02-19 03:57:26,473 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4646.500000 2021-02-19 03:57:26,480 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:26,733 | infra | INFO | pool-2-thread-23 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope2_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.3' completed 2021-02-19 03:57:26,733 | infra | INFO | pool-2-thread-23 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 03:57:26,750 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4472.204303 2021-02-19 03:57:27,155 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:27,325 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3552.562838 2021-02-19 03:57:27,410 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6560.088193 2021-02-19 03:57:27,696 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3531.300000 2021-02-19 03:57:27,805 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3772.553152 2021-02-19 03:57:27,845 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 514.608765 2021-02-19 03:57:28,010 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5055.400000 2021-02-19 03:57:28,036 | infra | INFO | pool-2-thread-38 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.33' completed 2021-02-19 03:57:28,038 | infra | INFO | pool-2-thread-38 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 03:57:28,098 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4646.500000 2021-02-19 03:57:28,118 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:28,250 | infra | INFO | pool-2-thread-47 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.34' completed 2021-02-19 03:57:28,250 | infra | INFO | pool-2-thread-47 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 03:57:28,290 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 45.98 % 2021-02-19 03:57:28,290 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 45.9789196311 2021-02-19 03:57:28,430 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4472.204303 2021-02-19 03:57:28,789 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:28,964 | infra | INFO | pool-2-thread-26 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.31' completed 2021-02-19 03:57:28,966 | infra | INFO | pool-2-thread-26 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 03:57:28,993 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3552.562838 2021-02-19 03:57:29,040 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6560.088193 2021-02-19 03:57:29,309 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3531.300000 2021-02-19 03:57:29,431 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3772.553152 2021-02-19 03:57:29,479 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:57:29,634 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5055.400000 2021-02-19 03:57:29,717 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4646.500000 2021-02-19 03:57:29,746 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:30,062 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4268.263437 2021-02-19 03:57:30,405 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:30,625 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3960.853646 2021-02-19 03:57:30,681 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6726.986114 2021-02-19 03:57:30,947 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3531.300000 2021-02-19 03:57:31,098 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3781.136164 2021-02-19 03:57:31,142 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:57:31,296 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5055.400000 2021-02-19 03:57:31,345 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4646.500000 2021-02-19 03:57:31,369 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 03:57:31,693 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4268.263437 2021-02-19 03:57:32,015 | infra | INFO | pool-2-thread-18 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.27' completed 2021-02-19 03:57:32,016 | infra | INFO | pool-2-thread-18 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 03:57:32,016 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 24 docs from 0 to 1000000 2021-02-19 03:57:32,039 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:32,249 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3960.853646 2021-02-19 03:57:32,319 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6843.886114 2021-02-19 03:57:32,384 | infra | INFO | pool-2-thread-44 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.34' completed 2021-02-19 03:57:32,384 | infra | INFO | pool-2-thread-44 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 03:57:32,467 | infra | INFO | pool-2-thread-63 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' completed 2021-02-19 03:57:32,467 | infra | INFO | pool-2-thread-63 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 03:57:32,588 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3524.800000 2021-02-19 03:57:32,757 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3760.136164 2021-02-19 03:57:32,775 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:57:32,938 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5090.700000 2021-02-19 03:57:32,996 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4759.400000 2021-02-19 03:57:33,009 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 273.100000 2021-02-19 03:57:33,348 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4140.663437 2021-02-19 03:57:33,351 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 46.54 % 2021-02-19 03:57:33,351 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 46.5403782066 2021-02-19 03:57:33,671 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:33,888 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3979.653646 2021-02-19 03:57:33,948 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6843.886114 2021-02-19 03:57:34,226 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3524.800000 2021-02-19 03:57:34,408 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3760.136164 2021-02-19 03:57:34,410 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 03:57:34,588 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5090.700000 2021-02-19 03:57:34,634 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4759.400000 2021-02-19 03:57:34,648 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 273.100000 2021-02-19 03:57:34,983 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4140.663437 2021-02-19 03:57:35,283 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:35,528 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3977.053646 2021-02-19 03:57:35,592 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6867.486114 2021-02-19 03:57:35,849 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3466.000000 2021-02-19 03:57:36,039 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 206.000000 2021-02-19 03:57:36,062 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3674.236164 2021-02-19 03:57:36,233 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5090.700000 2021-02-19 03:57:36,292 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 273.100000 2021-02-19 03:57:36,301 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4759.400000 2021-02-19 03:57:36,632 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3899.063437 2021-02-19 03:57:36,911 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:37,193 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3977.053646 2021-02-19 03:57:37,259 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6867.486114 2021-02-19 03:57:37,466 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3466.000000 2021-02-19 03:57:37,674 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 206.000000 2021-02-19 03:57:37,710 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3674.236164 2021-02-19 03:57:37,874 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5054.600000 2021-02-19 03:57:37,953 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5022.800000 2021-02-19 03:57:37,954 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1046.400000 2021-02-19 03:57:38,311 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3899.063437 2021-02-19 03:57:38,424 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 46.99 % 2021-02-19 03:57:38,424 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 46.9935286368 2021-02-19 03:57:38,535 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:38,839 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3977.053646 2021-02-19 03:57:38,887 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6867.486114 2021-02-19 03:57:39,115 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3466.000000 2021-02-19 03:57:39,316 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 206.000000 2021-02-19 03:57:39,375 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3674.236164 2021-02-19 03:57:39,530 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5054.600000 2021-02-19 03:57:39,602 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5022.800000 2021-02-19 03:57:39,609 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1046.400000 2021-02-19 03:57:39,938 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3624.662162 2021-02-19 03:57:40,171 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:40,500 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3773.342643 2021-02-19 03:57:40,529 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6499.445846 2021-02-19 03:57:40,772 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3466.000000 2021-02-19 03:57:40,973 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1300.194194 2021-02-19 03:57:41,039 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3449.439039 2021-02-19 03:57:41,187 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5054.600000 2021-02-19 03:57:41,283 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1046.400000 2021-02-19 03:57:41,301 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5022.800000 2021-02-19 03:57:41,618 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3624.662162 2021-02-19 03:57:41,790 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:42,145 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3773.342643 2021-02-19 03:57:42,171 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6499.445846 2021-02-19 03:57:42,414 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3137.300000 2021-02-19 03:57:42,681 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2975.394194 2021-02-19 03:57:42,733 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3220.339039 2021-02-19 03:57:42,848 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4455.800000 2021-02-19 03:57:42,959 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2348.800000 2021-02-19 03:57:42,970 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5581.900000 2021-02-19 03:57:43,236 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3274.762162 2021-02-19 03:57:43,414 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:43,486 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 47.36 % 2021-02-19 03:57:43,486 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 47.3647213826 2021-02-19 03:57:43,776 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3517.942643 2021-02-19 03:57:43,808 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5984.945846 2021-02-19 03:57:44,059 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3137.300000 2021-02-19 03:57:44,355 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2975.394194 2021-02-19 03:57:44,430 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3220.339039 2021-02-19 03:57:44,492 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4455.800000 2021-02-19 03:57:44,604 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2348.800000 2021-02-19 03:57:44,618 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5581.900000 2021-02-19 03:57:44,901 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3274.762162 2021-02-19 03:57:45,071 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:45,459 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3517.942643 2021-02-19 03:57:45,467 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5984.945846 2021-02-19 03:57:45,707 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2856.400000 2021-02-19 03:57:46,026 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4800.894194 2021-02-19 03:57:46,091 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3052.939039 2021-02-19 03:57:46,160 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3878.200000 2021-02-19 03:57:46,263 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2348.800000 2021-02-19 03:57:46,312 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5581.900000 2021-02-19 03:57:46,555 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3047.862162 2021-02-19 03:57:46,730 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:47,118 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3207.742643 2021-02-19 03:57:47,127 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5428.745846 2021-02-19 03:57:47,345 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2856.400000 2021-02-19 03:57:47,676 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4800.894194 2021-02-19 03:57:47,742 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3052.939039 2021-02-19 03:57:47,780 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3878.200000 2021-02-19 03:57:47,905 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3074.300000 2021-02-19 03:57:47,966 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6024.700000 2021-02-19 03:57:48,187 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3047.862162 2021-02-19 03:57:48,371 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:48,546 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 47.75 % 2021-02-19 03:57:48,546 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 47.7490893591 2021-02-19 03:57:48,756 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5428.745846 2021-02-19 03:57:48,776 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3207.742643 2021-02-19 03:57:49,003 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2856.400000 2021-02-19 03:57:49,312 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4800.894194 2021-02-19 03:57:49,382 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3052.939039 2021-02-19 03:57:49,417 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3878.200000 2021-02-19 03:57:49,536 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3074.300000 2021-02-19 03:57:49,602 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6024.700000 2021-02-19 03:57:49,842 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2923.900000 2021-02-19 03:57:50,000 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:50,447 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3060.600000 2021-02-19 03:57:50,463 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5146.300000 2021-02-19 03:57:50,638 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2856.400000 2021-02-19 03:57:50,992 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5741.400000 2021-02-19 03:57:51,104 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3019.800000 2021-02-19 03:57:51,108 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3878.200000 2021-02-19 03:57:51,180 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3074.300000 2021-02-19 03:57:51,244 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6024.700000 2021-02-19 03:57:51,480 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2923.900000 2021-02-19 03:57:51,640 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:52,101 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5146.300000 2021-02-19 03:57:52,114 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3060.600000 2021-02-19 03:57:52,309 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2928.100000 2021-02-19 03:57:52,663 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6095.100000 2021-02-19 03:57:52,753 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3805.000000 2021-02-19 03:57:52,769 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3016.000000 2021-02-19 03:57:52,802 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2999.700000 2021-02-19 03:57:52,880 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6044.500000 2021-02-19 03:57:53,108 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2972.600000 2021-02-19 03:57:53,262 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:53,605 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 48.21 % 2021-02-19 03:57:53,605 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 48.2121987135 2021-02-19 03:57:53,753 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2956.700000 2021-02-19 03:57:53,770 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5012.600000 2021-02-19 03:57:53,920 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2928.100000 2021-02-19 03:57:54,296 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6095.100000 2021-02-19 03:57:54,414 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3016.000000 2021-02-19 03:57:54,430 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3805.000000 2021-02-19 03:57:54,513 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2999.700000 2021-02-19 03:57:54,542 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6044.500000 2021-02-19 03:57:54,747 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2972.600000 2021-02-19 03:57:54,904 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:55,413 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2956.700000 2021-02-19 03:57:55,434 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5012.600000 2021-02-19 03:57:55,543 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3003.800000 2021-02-19 03:57:55,917 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6075.300000 2021-02-19 03:57:56,069 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3016.700000 2021-02-19 03:57:56,104 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3769.100000 2021-02-19 03:57:56,183 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3006.100000 2021-02-19 03:57:56,220 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6044.500000 2021-02-19 03:57:56,365 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2972.600000 2021-02-19 03:57:56,530 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:57,076 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2961.400000 2021-02-19 03:57:57,121 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5024.200000 2021-02-19 03:57:57,214 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3003.800000 2021-02-19 03:57:57,556 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6075.300000 2021-02-19 03:57:57,723 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3016.700000 2021-02-19 03:57:57,740 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3769.100000 2021-02-19 03:57:57,815 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3006.100000 2021-02-19 03:57:57,852 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6072.700000 2021-02-19 03:57:57,993 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3096.700000 2021-02-19 03:57:58,153 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:57:58,648 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 48.60 % 2021-02-19 03:57:58,651 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 48.5997829962 2021-02-19 03:57:58,753 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5024.200000 2021-02-19 03:57:58,760 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2961.400000 2021-02-19 03:57:58,848 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3003.800000 2021-02-19 03:57:59,204 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6075.300000 2021-02-19 03:57:59,364 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3016.700000 2021-02-19 03:57:59,391 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3769.100000 2021-02-19 03:57:59,473 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3006.100000 2021-02-19 03:57:59,503 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6072.700000 2021-02-19 03:57:59,637 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3031.900000 2021-02-19 03:57:59,767 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:00,390 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5064.100000 2021-02-19 03:58:00,394 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2984.300000 2021-02-19 03:58:00,487 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3003.800000 2021-02-19 03:58:00,854 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6135.100000 2021-02-19 03:58:01,045 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3769.100000 2021-02-19 03:58:01,048 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3012.500000 2021-02-19 03:58:01,085 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3006.100000 2021-02-19 03:58:01,135 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6072.700000 2021-02-19 03:58:01,280 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3031.900000 2021-02-19 03:58:01,404 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:02,017 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5064.100000 2021-02-19 03:58:02,043 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2984.300000 2021-02-19 03:58:02,111 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3003.800000 2021-02-19 03:58:02,492 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6236.900000 2021-02-19 03:58:02,709 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2998.900000 2021-02-19 03:58:02,730 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3817.400000 2021-02-19 03:58:02,746 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3069.500000 2021-02-19 03:58:02,831 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6200.100000 2021-02-19 03:58:02,977 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3052.200000 2021-02-19 03:58:03,025 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:03,674 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5110.300000 2021-02-19 03:58:03,736 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3060.200000 2021-02-19 03:58:03,752 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 49.12 % 2021-02-19 03:58:03,752 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 49.1188095792 2021-02-19 03:58:03,757 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2936.300000 2021-02-19 03:58:04,115 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6236.900000 2021-02-19 03:58:04,371 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3817.400000 2021-02-19 03:58:04,427 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2998.900000 2021-02-19 03:58:04,434 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3069.500000 2021-02-19 03:58:04,507 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6200.100000 2021-02-19 03:58:04,644 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:04,684 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3052.200000 2021-02-19 03:58:05,355 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5110.300000 2021-02-19 03:58:05,414 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2936.300000 2021-02-19 03:58:05,447 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3060.200000 2021-02-19 03:58:05,750 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6374.700000 2021-02-19 03:58:06,006 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3933.200000 2021-02-19 03:58:06,071 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2985.300000 2021-02-19 03:58:06,078 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3128.500000 2021-02-19 03:58:06,154 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6301.400000 2021-02-19 03:58:06,319 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:06,382 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3052.200000 2021-02-19 03:58:06,997 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5179.700000 2021-02-19 03:58:07,073 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2876.900000 2021-02-19 03:58:07,118 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3116.300000 2021-02-19 03:58:07,387 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6374.700000 2021-02-19 03:58:07,644 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3933.200000 2021-02-19 03:58:07,736 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3128.500000 2021-02-19 03:58:07,759 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2985.300000 2021-02-19 03:58:07,855 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6301.400000 2021-02-19 03:58:07,996 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:08,062 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2937.600000 2021-02-19 03:58:08,654 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5179.700000 2021-02-19 03:58:08,700 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2876.900000 2021-02-19 03:58:08,744 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3116.300000 2021-02-19 03:58:08,809 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 49.64 % 2021-02-19 03:58:08,809 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 49.6442687747 2021-02-19 03:58:09,002 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6374.700000 2021-02-19 03:58:09,289 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3933.200000 2021-02-19 03:58:09,358 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3128.500000 2021-02-19 03:58:09,424 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2985.300000 2021-02-19 03:58:09,529 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6301.400000 2021-02-19 03:58:09,617 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:09,687 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2829.900000 2021-02-19 03:58:10,299 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5179.700000 2021-02-19 03:58:10,329 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2876.900000 2021-02-19 03:58:10,385 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3146.700000 2021-02-19 03:58:10,655 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6429.000000 2021-02-19 03:58:10,927 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3933.200000 2021-02-19 03:58:11,017 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3128.500000 2021-02-19 03:58:11,059 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2976.200000 2021-02-19 03:58:11,211 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6301.400000 2021-02-19 03:58:11,247 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:11,325 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2829.900000 2021-02-19 03:58:11,938 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5244.800000 2021-02-19 03:58:11,964 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2876.900000 2021-02-19 03:58:12,029 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3146.700000 2021-02-19 03:58:12,312 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6495.400000 2021-02-19 03:58:12,539 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3950.500000 2021-02-19 03:58:12,648 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3199.400000 2021-02-19 03:58:12,732 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3016.200000 2021-02-19 03:58:12,852 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6282.000000 2021-02-19 03:58:12,898 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:13,013 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2634.300000 2021-02-19 03:58:13,588 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5306.900000 2021-02-19 03:58:13,615 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2973.800000 2021-02-19 03:58:13,701 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3163.000000 2021-02-19 03:58:13,855 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 49.99 % 2021-02-19 03:58:13,855 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 49.9868247694 2021-02-19 03:58:14,009 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6495.400000 2021-02-19 03:58:14,157 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3950.500000 2021-02-19 03:58:14,266 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3199.400000 2021-02-19 03:58:14,371 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3016.200000 2021-02-19 03:58:14,477 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6282.000000 2021-02-19 03:58:14,553 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:14,651 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2634.300000 2021-02-19 03:58:15,306 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5306.900000 2021-02-19 03:58:15,328 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2973.800000 2021-02-19 03:58:15,348 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3163.000000 2021-02-19 03:58:15,650 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6571.100000 2021-02-19 03:58:15,782 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3907.800000 2021-02-19 03:58:15,894 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3320.900000 2021-02-19 03:58:15,997 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3022.000000 2021-02-19 03:58:16,101 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6287.700000 2021-02-19 03:58:16,184 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:16,319 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2634.300000 2021-02-19 03:58:17,022 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3083.800000 2021-02-19 03:58:17,078 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5307.100000 2021-02-19 03:58:17,088 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3176.500000 2021-02-19 03:58:17,289 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6571.100000 2021-02-19 03:58:17,424 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3907.800000 2021-02-19 03:58:17,510 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3320.900000 2021-02-19 03:58:17,644 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3022.000000 2021-02-19 03:58:17,770 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6287.700000 2021-02-19 03:58:17,816 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:17,963 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2535.800000 2021-02-19 03:58:18,707 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3083.800000 2021-02-19 03:58:18,747 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3176.500000 2021-02-19 03:58:18,815 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5307.100000 2021-02-19 03:58:18,911 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.00 % 2021-02-19 03:58:18,911 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 50.0 2021-02-19 03:58:18,926 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6571.100000 2021-02-19 03:58:19,094 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3907.800000 2021-02-19 03:58:19,197 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3320.900000 2021-02-19 03:58:19,289 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3022.000000 2021-02-19 03:58:19,405 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6287.700000 2021-02-19 03:58:19,476 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:19,618 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2470.599600 2021-02-19 03:58:20,349 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3083.800000 2021-02-19 03:58:20,398 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3168.367466 2021-02-19 03:58:20,474 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5263.120464 2021-02-19 03:58:20,568 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6566.884333 2021-02-19 03:58:20,733 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3907.800000 2021-02-19 03:58:20,822 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3320.900000 2021-02-19 03:58:20,930 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3009.216147 2021-02-19 03:58:21,055 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6287.700000 2021-02-19 03:58:21,121 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:21,246 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2470.599600 2021-02-19 03:58:21,977 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3083.800000 2021-02-19 03:58:22,042 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3168.367466 2021-02-19 03:58:22,125 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5263.120464 2021-02-19 03:58:22,219 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6566.884333 2021-02-19 03:58:22,401 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3767.200000 2021-02-19 03:58:22,457 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3188.700000 2021-02-19 03:58:22,612 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2968.516147 2021-02-19 03:58:22,688 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6243.200000 2021-02-19 03:58:22,815 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:22,892 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3225.399600 2021-02-19 03:58:23,618 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2989.400000 2021-02-19 03:58:23,710 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3128.667466 2021-02-19 03:58:23,793 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5170.520464 2021-02-19 03:58:23,901 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6409.484333 2021-02-19 03:58:23,960 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.00 % 2021-02-19 03:58:23,960 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 50.0 2021-02-19 03:58:24,144 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3767.200000 2021-02-19 03:58:24,164 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3188.700000 2021-02-19 03:58:24,282 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2968.516147 2021-02-19 03:58:24,301 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6243.200000 2021-02-19 03:58:24,444 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:24,519 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3224.900000 2021-02-19 03:58:25,247 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2989.400000 2021-02-19 03:58:25,381 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3128.667466 2021-02-19 03:58:25,421 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5170.520464 2021-02-19 03:58:25,536 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6165.484333 2021-02-19 03:58:25,809 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3627.700000 2021-02-19 03:58:25,842 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2940.900000 2021-02-19 03:58:25,930 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2950.416147 2021-02-19 03:58:25,943 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6105.300000 2021-02-19 03:58:26,076 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:26,148 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4341.000000 2021-02-19 03:58:26,914 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2798.200000 2021-02-19 03:58:27,069 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3058.567466 2021-02-19 03:58:27,092 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5112.120464 2021-02-19 03:58:27,178 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6165.484333 2021-02-19 03:58:27,447 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3627.700000 2021-02-19 03:58:27,461 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.14 % 2021-02-19 03:58:27,461 | test | INFO | MainThread | [Magma:abort_rebalance:933] Rebalance % = 50.1433565347 2021-02-19 03:58:27,487 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.14 % 2021-02-19 03:58:27,500 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:58:27,500 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:58:27,506 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2940.900000 2021-02-19 03:58:27,582 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2950.416147 2021-02-19 03:58:27,605 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6105.300000 2021-02-19 03:58:27,720 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:27,808 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4341.000000 2021-02-19 03:58:28,543 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2798.200000 2021-02-19 03:58:28,707 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3058.567466 2021-02-19 03:58:28,743 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5112.120464 2021-02-19 03:58:28,809 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6165.484333 2021-02-19 03:58:29,026 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.21 % 2021-02-19 03:58:29,028 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 50.2117891585 2021-02-19 03:58:29,095 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3627.700000 2021-02-19 03:58:29,144 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2940.900000 2021-02-19 03:58:29,227 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6105.300000 2021-02-19 03:58:29,272 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2950.416147 2021-02-19 03:58:29,391 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:29,436 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4341.000000 2021-02-19 03:58:30,161 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2798.200000 2021-02-19 03:58:30,349 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3058.567466 2021-02-19 03:58:30,365 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5112.120464 2021-02-19 03:58:30,473 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5628.986469 2021-02-19 03:58:30,716 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3627.700000 2021-02-19 03:58:30,773 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2940.900000 2021-02-19 03:58:30,851 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6105.300000 2021-02-19 03:58:30,928 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2961.692874 2021-02-19 03:58:31,028 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:31,075 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4341.000000 2021-02-19 03:58:31,785 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2798.200000 2021-02-19 03:58:32,029 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2989.477262 2021-02-19 03:58:32,052 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5071.747238 2021-02-19 03:58:32,125 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5628.986469 2021-02-19 03:58:32,365 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3672.400000 2021-02-19 03:58:32,447 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2926.000000 2021-02-19 03:58:32,532 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6115.400000 2021-02-19 03:58:32,596 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2956.492874 2021-02-19 03:58:32,657 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:32,697 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4865.300000 2021-02-19 03:58:33,394 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2747.600000 2021-02-19 03:58:33,690 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2986.677262 2021-02-19 03:58:33,700 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5143.747238 2021-02-19 03:58:33,769 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4941.586469 2021-02-19 03:58:33,989 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3672.400000 2021-02-19 03:58:34,069 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2926.000000 2021-02-19 03:58:34,089 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.51 % 2021-02-19 03:58:34,089 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 50.5115740234 2021-02-19 03:58:34,158 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6115.400000 2021-02-19 03:58:34,272 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2956.492874 2021-02-19 03:58:34,302 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:34,345 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4865.300000 2021-02-19 03:58:35,020 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2747.600000 2021-02-19 03:58:35,358 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2986.677262 2021-02-19 03:58:35,365 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5143.747238 2021-02-19 03:58:35,403 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4941.586469 2021-02-19 03:58:35,609 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3785.500000 2021-02-19 03:58:35,719 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3039.800000 2021-02-19 03:58:35,793 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6313.000000 2021-02-19 03:58:35,947 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:35,956 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2983.492874 2021-02-19 03:58:35,999 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5042.200000 2021-02-19 03:58:36,657 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2801.500000 2021-02-19 03:58:37,053 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5238.647238 2021-02-19 03:58:37,068 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3064.677262 2021-02-19 03:58:37,082 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4028.086469 2021-02-19 03:58:37,253 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3785.500000 2021-02-19 03:58:37,351 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3039.800000 2021-02-19 03:58:37,448 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6313.000000 2021-02-19 03:58:37,525 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.73 % 2021-02-19 03:58:37,538 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:58:37,538 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:58:37,595 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:37,642 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2983.492874 2021-02-19 03:58:37,658 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5042.200000 2021-02-19 03:58:38,285 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2801.500000 2021-02-19 03:58:38,716 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5238.647238 2021-02-19 03:58:38,778 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3064.677262 2021-02-19 03:58:38,785 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4028.086469 2021-02-19 03:58:38,871 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3785.500000 2021-02-19 03:58:38,990 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3039.800000 2021-02-19 03:58:39,095 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6313.000000 2021-02-19 03:58:39,144 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.84 % 2021-02-19 03:58:39,144 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 50.8439045827 2021-02-19 03:58:39,229 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:39,289 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5042.200000 2021-02-19 03:58:39,302 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2983.492874 2021-02-19 03:58:39,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2801.500000 2021-02-19 03:58:40,380 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5238.647238 2021-02-19 03:58:40,427 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3308.200000 2021-02-19 03:58:40,443 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3209.300000 2021-02-19 03:58:40,497 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3785.500000 2021-02-19 03:58:40,615 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3039.800000 2021-02-19 03:58:40,713 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6313.000000 2021-02-19 03:58:40,871 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:40,930 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2999.300000 2021-02-19 03:58:40,957 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5042.200000 2021-02-19 03:58:41,536 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2801.500000 2021-02-19 03:58:42,023 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5441.700000 2021-02-19 03:58:42,071 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3308.200000 2021-02-19 03:58:42,089 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3209.300000 2021-02-19 03:58:42,134 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3785.500000 2021-02-19 03:58:42,260 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3039.800000 2021-02-19 03:58:42,332 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6496.600000 2021-02-19 03:58:42,490 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:42,614 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5053.100000 2021-02-19 03:58:42,619 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3027.600000 2021-02-19 03:58:43,161 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2849.900000 2021-02-19 03:58:43,644 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5547.300000 2021-02-19 03:58:43,736 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2860.400000 2021-02-19 03:58:43,779 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3283.600000 2021-02-19 03:58:43,782 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3897.000000 2021-02-19 03:58:43,895 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3152.600000 2021-02-19 03:58:43,983 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6496.600000 2021-02-19 03:58:44,138 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:44,197 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 51.16 % 2021-02-19 03:58:44,197 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 51.1599622949 2021-02-19 03:58:44,259 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3027.600000 2021-02-19 03:58:44,275 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5053.100000 2021-02-19 03:58:44,793 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2849.900000 2021-02-19 03:58:45,309 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5547.300000 2021-02-19 03:58:45,381 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2860.400000 2021-02-19 03:58:45,437 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3897.000000 2021-02-19 03:58:45,450 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3283.600000 2021-02-19 03:58:45,535 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3152.600000 2021-02-19 03:58:45,642 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6531.800000 2021-02-19 03:58:45,782 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:45,900 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3034.600000 2021-02-19 03:58:45,911 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5048.800000 2021-02-19 03:58:46,418 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2849.900000 2021-02-19 03:58:46,986 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5636.100000 2021-02-19 03:58:47,049 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2666.700000 2021-02-19 03:58:47,082 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4000.300000 2021-02-19 03:58:47,124 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3311.000000 2021-02-19 03:58:47,176 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3213.300000 2021-02-19 03:58:47,286 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6531.800000 2021-02-19 03:58:47,424 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:47,556 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3034.600000 2021-02-19 03:58:47,572 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 51.33 % 2021-02-19 03:58:47,585 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5048.800000 2021-02-19 03:58:47,592 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:58:47,592 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:58:48,042 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2888.400000 2021-02-19 03:58:48,621 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5636.100000 2021-02-19 03:58:48,684 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2666.700000 2021-02-19 03:58:48,737 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4000.300000 2021-02-19 03:58:48,796 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3311.000000 2021-02-19 03:58:48,803 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3213.300000 2021-02-19 03:58:48,924 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6531.800000 2021-02-19 03:58:49,072 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:49,213 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3034.600000 2021-02-19 03:58:49,219 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5048.800000 2021-02-19 03:58:49,250 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 51.50 % 2021-02-19 03:58:49,250 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 51.495544868 2021-02-19 03:58:49,674 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2888.400000 2021-02-19 03:58:50,266 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5656.500000 2021-02-19 03:58:50,349 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2666.700000 2021-02-19 03:58:50,372 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4000.300000 2021-02-19 03:58:50,453 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3213.300000 2021-02-19 03:58:50,473 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3334.100000 2021-02-19 03:58:50,573 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6531.800000 2021-02-19 03:58:50,703 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:50,874 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3067.200000 2021-02-19 03:58:50,881 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5048.800000 2021-02-19 03:58:51,299 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2888.400000 2021-02-19 03:58:51,976 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5656.500000 2021-02-19 03:58:52,022 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4000.300000 2021-02-19 03:58:52,056 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2672.800000 2021-02-19 03:58:52,114 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3213.300000 2021-02-19 03:58:52,151 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3334.100000 2021-02-19 03:58:52,220 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6531.800000 2021-02-19 03:58:52,345 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:52,538 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5167.700000 2021-02-19 03:58:52,545 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3078.600000 2021-02-19 03:58:52,936 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2897.300000 2021-02-19 03:58:53,648 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5700.200000 2021-02-19 03:58:53,671 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4086.200000 2021-02-19 03:58:53,739 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2783.500000 2021-02-19 03:58:53,756 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3285.500000 2021-02-19 03:58:53,862 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3396.100000 2021-02-19 03:58:53,903 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6614.800000 2021-02-19 03:58:53,999 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:54,170 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5167.700000 2021-02-19 03:58:54,188 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3078.600000 2021-02-19 03:58:54,315 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 51.81 % 2021-02-19 03:58:54,315 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 51.8116025802 2021-02-19 03:58:54,552 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2897.300000 2021-02-19 03:58:55,292 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5700.200000 2021-02-19 03:58:55,322 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4086.200000 2021-02-19 03:58:55,391 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2783.500000 2021-02-19 03:58:55,426 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3285.500000 2021-02-19 03:58:55,558 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6614.800000 2021-02-19 03:58:55,607 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3396.100000 2021-02-19 03:58:55,647 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:55,789 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5276.700000 2021-02-19 03:58:55,858 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3087.200000 2021-02-19 03:58:56,196 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2869.400000 2021-02-19 03:58:56,947 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5705.300000 2021-02-19 03:58:56,979 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4095.300000 2021-02-19 03:58:57,049 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2955.500000 2021-02-19 03:58:57,088 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3307.100000 2021-02-19 03:58:57,200 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6684.700000 2021-02-19 03:58:57,312 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3434.000000 2021-02-19 03:58:57,354 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:57,457 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5276.700000 2021-02-19 03:58:57,529 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3087.200000 2021-02-19 03:58:57,607 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 52.05 % 2021-02-19 03:58:57,621 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:58:57,621 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:58:57,832 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2869.400000 2021-02-19 03:58:58,596 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5705.300000 2021-02-19 03:58:58,609 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4095.300000 2021-02-19 03:58:58,713 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2955.500000 2021-02-19 03:58:58,730 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3307.100000 2021-02-19 03:58:58,839 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6684.700000 2021-02-19 03:58:58,970 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3434.000000 2021-02-19 03:58:58,987 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:58:59,094 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5276.700000 2021-02-19 03:58:59,171 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3087.200000 2021-02-19 03:58:59,364 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 52.16 % 2021-02-19 03:58:59,365 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 52.1634707411 2021-02-19 03:58:59,446 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2869.400000 2021-02-19 03:59:00,240 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4095.300000 2021-02-19 03:59:00,260 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5678.900000 2021-02-19 03:59:00,371 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2955.500000 2021-02-19 03:59:00,375 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3307.100000 2021-02-19 03:59:00,480 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6684.700000 2021-02-19 03:59:00,625 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:00,625 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3412.100000 2021-02-19 03:59:00,743 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5276.700000 2021-02-19 03:59:00,818 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3060.100000 2021-02-19 03:59:01,052 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2869.400000 2021-02-19 03:59:01,309 | infra | INFO | pool-2-thread-64 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 03:59:01,309 | infra | INFO | pool-2-thread-64 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 03:59:01,914 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4095.300000 2021-02-19 03:59:01,937 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5678.900000 2021-02-19 03:59:02,033 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3307.100000 2021-02-19 03:59:02,046 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2912.600000 2021-02-19 03:59:02,131 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6684.700000 2021-02-19 03:59:02,273 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:02,292 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3412.100000 2021-02-19 03:59:02,411 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5328.500000 2021-02-19 03:59:02,459 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3046.600000 2021-02-19 03:59:02,674 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2856.500000 2021-02-19 03:59:03,589 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4017.200000 2021-02-19 03:59:03,625 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5675.900000 2021-02-19 03:59:03,703 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3283.100000 2021-02-19 03:59:03,707 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3025.300000 2021-02-19 03:59:03,779 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6653.000000 2021-02-19 03:59:03,980 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:03,989 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3403.500000 2021-02-19 03:59:04,107 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5328.500000 2021-02-19 03:59:04,119 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3046.600000 2021-02-19 03:59:04,295 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2856.500000 2021-02-19 03:59:04,423 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 52.56 % 2021-02-19 03:59:04,423 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 52.561007354 2021-02-19 03:59:05,269 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4017.200000 2021-02-19 03:59:05,280 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5675.900000 2021-02-19 03:59:05,395 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3025.300000 2021-02-19 03:59:05,398 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3283.100000 2021-02-19 03:59:05,446 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6653.000000 2021-02-19 03:59:05,628 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:05,664 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3405.500000 2021-02-19 03:59:05,769 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5395.900000 2021-02-19 03:59:05,792 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3022.300000 2021-02-19 03:59:05,900 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2882.000000 2021-02-19 03:59:06,913 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3986.900000 2021-02-19 03:59:06,947 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5772.900000 2021-02-19 03:59:07,051 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3053.300000 2021-02-19 03:59:07,092 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3300.200000 2021-02-19 03:59:07,188 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6655.300000 2021-02-19 03:59:07,306 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:07,358 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3405.500000 2021-02-19 03:59:07,450 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5395.900000 2021-02-19 03:59:07,454 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3022.300000 2021-02-19 03:59:07,510 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2882.000000 2021-02-19 03:59:07,644 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 52.78 % 2021-02-19 03:59:07,658 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:59:07,658 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:59:08,536 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3986.900000 2021-02-19 03:59:08,611 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5772.900000 2021-02-19 03:59:08,704 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3053.300000 2021-02-19 03:59:08,742 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3300.200000 2021-02-19 03:59:08,834 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6655.300000 2021-02-19 03:59:08,954 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:09,006 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3405.500000 2021-02-19 03:59:09,081 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5395.900000 2021-02-19 03:59:09,117 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3022.300000 2021-02-19 03:59:09,150 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2882.000000 2021-02-19 03:59:09,467 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 52.93 % 2021-02-19 03:59:09,467 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 52.9291738432 2021-02-19 03:59:10,203 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3986.900000 2021-02-19 03:59:10,233 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5998.200000 2021-02-19 03:59:10,336 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3053.300000 2021-02-19 03:59:10,354 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3300.200000 2021-02-19 03:59:10,433 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6655.300000 2021-02-19 03:59:10,568 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:10,674 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3394.600000 2021-02-19 03:59:10,713 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5395.900000 2021-02-19 03:59:10,756 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3000.000000 2021-02-19 03:59:10,775 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2882.000000 2021-02-19 03:59:11,822 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3986.900000 2021-02-19 03:59:11,880 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5998.200000 2021-02-19 03:59:11,963 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3300.200000 2021-02-19 03:59:11,983 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2830.800000 2021-02-19 03:59:12,042 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6655.300000 2021-02-19 03:59:12,200 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:12,323 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5029.500000 2021-02-19 03:59:12,335 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3164.400000 2021-02-19 03:59:12,400 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2875.900000 2021-02-19 03:59:12,417 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2782.100000 2021-02-19 03:59:13,450 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3796.200000 2021-02-19 03:59:13,517 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6011.500000 2021-02-19 03:59:13,586 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3003.700000 2021-02-19 03:59:13,608 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2449.300000 2021-02-19 03:59:13,661 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6124.700000 2021-02-19 03:59:13,858 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:13,941 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5029.500000 2021-02-19 03:59:13,960 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3164.400000 2021-02-19 03:59:14,017 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2875.900000 2021-02-19 03:59:14,035 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2782.100000 2021-02-19 03:59:14,499 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 53.14 % 2021-02-19 03:59:14,499 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 53.1442022377 2021-02-19 03:59:15,073 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3796.200000 2021-02-19 03:59:15,174 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6011.500000 2021-02-19 03:59:15,209 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3003.700000 2021-02-19 03:59:15,273 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2449.300000 2021-02-19 03:59:15,315 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6124.700000 2021-02-19 03:59:15,505 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:15,552 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3939.000000 2021-02-19 03:59:15,635 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2627.500000 2021-02-19 03:59:15,678 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2265.500000 2021-02-19 03:59:15,690 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2479.100000 2021-02-19 03:59:16,687 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3020.400000 2021-02-19 03:59:16,792 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5337.800000 2021-02-19 03:59:16,842 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2255.400000 2021-02-19 03:59:16,930 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1895.700000 2021-02-19 03:59:16,950 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4665.900000 2021-02-19 03:59:17,128 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:17,207 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3939.000000 2021-02-19 03:59:17,270 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2627.500000 2021-02-19 03:59:17,313 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2265.500000 2021-02-19 03:59:17,369 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2479.100000 2021-02-19 03:59:17,671 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 53.27 % 2021-02-19 03:59:17,684 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:59:17,684 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:59:18,296 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3020.400000 2021-02-19 03:59:18,420 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5337.800000 2021-02-19 03:59:18,467 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2255.400000 2021-02-19 03:59:18,596 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1895.700000 2021-02-19 03:59:18,609 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4665.900000 2021-02-19 03:59:18,773 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:18,838 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3939.000000 2021-02-19 03:59:18,901 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2627.500000 2021-02-19 03:59:18,940 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2265.500000 2021-02-19 03:59:18,990 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2479.100000 2021-02-19 03:59:19,540 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 53.36 % 2021-02-19 03:59:19,540 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 53.3560040993 2021-02-19 03:59:19,910 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3020.400000 2021-02-19 03:59:20,085 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4574.200000 2021-02-19 03:59:20,164 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2255.400000 2021-02-19 03:59:20,282 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1695.200000 2021-02-19 03:59:20,295 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4665.900000 2021-02-19 03:59:20,407 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:20,516 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3939.000000 2021-02-19 03:59:20,545 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2218.900000 2021-02-19 03:59:20,634 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2190.600000 2021-02-19 03:59:20,642 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2265.500000 2021-02-19 03:59:21,539 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3020.400000 2021-02-19 03:59:21,742 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4574.200000 2021-02-19 03:59:21,832 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2255.400000 2021-02-19 03:59:21,923 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1695.200000 2021-02-19 03:59:21,951 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4665.900000 2021-02-19 03:59:22,040 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:22,194 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3939.000000 2021-02-19 03:59:22,210 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2218.900000 2021-02-19 03:59:22,296 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2176.700000 2021-02-19 03:59:22,305 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1041.800000 2021-02-19 03:59:23,157 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1226.200000 2021-02-19 03:59:23,424 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4395.400000 2021-02-19 03:59:23,480 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1806.100000 2021-02-19 03:59:23,568 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2025.000000 2021-02-19 03:59:23,582 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2156.000000 2021-02-19 03:59:23,657 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:23,845 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4059.600000 2021-02-19 03:59:23,867 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2190.700000 2021-02-19 03:59:23,970 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2176.700000 2021-02-19 03:59:23,970 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1041.800000 2021-02-19 03:59:24,585 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 53.57 % 2021-02-19 03:59:24,585 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 53.5743355072 2021-02-19 03:59:24,798 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1226.200000 2021-02-19 03:59:25,071 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4395.400000 2021-02-19 03:59:25,131 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1806.100000 2021-02-19 03:59:25,269 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2156.000000 2021-02-19 03:59:25,292 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2025.000000 2021-02-19 03:59:25,371 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:25,440 | infra | INFO | pool-2-thread-21 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' completed 2021-02-19 03:59:25,441 | infra | INFO | pool-2-thread-21 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 03:59:25,484 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4059.600000 2021-02-19 03:59:25,516 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2190.700000 2021-02-19 03:59:25,618 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2749.300000 2021-02-19 03:59:25,631 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 654.000000 2021-02-19 03:59:26,450 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 500.800000 2021-02-19 03:59:26,714 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5465.300000 2021-02-19 03:59:26,796 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2253.600000 2021-02-19 03:59:26,907 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1488.200000 2021-02-19 03:59:26,928 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2975.500000 2021-02-19 03:59:27,020 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:27,178 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5588.900000 2021-02-19 03:59:27,181 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2794.700000 2021-02-19 03:59:27,282 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2749.300000 2021-02-19 03:59:27,286 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 654.000000 2021-02-19 03:59:27,700 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 53.77 % 2021-02-19 03:59:27,713 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:59:27,713 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:59:28,091 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 500.800000 2021-02-19 03:59:28,375 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5465.300000 2021-02-19 03:59:28,431 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2253.600000 2021-02-19 03:59:28,621 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1488.200000 2021-02-19 03:59:28,655 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2975.500000 2021-02-19 03:59:28,684 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:28,846 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2794.700000 2021-02-19 03:59:28,855 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5588.900000 2021-02-19 03:59:28,936 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 654.000000 2021-02-19 03:59:28,944 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2749.300000 2021-02-19 03:59:29,661 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 53.91 % 2021-02-19 03:59:29,661 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 53.9131573537 2021-02-19 03:59:29,710 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 500.800000 2021-02-19 03:59:30,056 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6509.500000 2021-02-19 03:59:30,115 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2253.600000 2021-02-19 03:59:30,260 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1488.200000 2021-02-19 03:59:30,306 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3330.700000 2021-02-19 03:59:30,326 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:30,513 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3231.300000 2021-02-19 03:59:30,542 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5588.900000 2021-02-19 03:59:30,585 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 654.000000 2021-02-19 03:59:30,609 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3153.800000 2021-02-19 03:59:31,344 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 500.800000 2021-02-19 03:59:31,714 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6509.500000 2021-02-19 03:59:31,746 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2253.600000 2021-02-19 03:59:31,892 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1488.200000 2021-02-19 03:59:31,989 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:32,006 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3330.700000 2021-02-19 03:59:32,217 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5588.900000 2021-02-19 03:59:32,224 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3231.300000 2021-02-19 03:59:32,244 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 654.000000 2021-02-19 03:59:32,267 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3153.800000 2021-02-19 03:59:33,013 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2459.600000 2021-02-19 03:59:33,339 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7074.900000 2021-02-19 03:59:33,365 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2934.300000 2021-02-19 03:59:33,526 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4365.800000 2021-02-19 03:59:33,645 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:33,688 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3390.200000 2021-02-19 03:59:33,887 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2125.800000 2021-02-19 03:59:33,891 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5763.400000 2021-02-19 03:59:33,917 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3419.600000 2021-02-19 03:59:33,938 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3300.600000 2021-02-19 03:59:34,644 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2459.600000 2021-02-19 03:59:34,759 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 54.39 % 2021-02-19 03:59:34,759 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 54.3921219053 2021-02-19 03:59:34,993 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7074.900000 2021-02-19 03:59:35,010 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2934.300000 2021-02-19 03:59:35,233 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4365.800000 2021-02-19 03:59:35,335 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:35,344 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3390.200000 2021-02-19 03:59:35,538 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2125.800000 2021-02-19 03:59:35,555 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5763.400000 2021-02-19 03:59:35,592 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3419.600000 2021-02-19 03:59:35,605 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3300.600000 2021-02-19 03:59:36,273 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4033.464618 2021-02-19 03:59:36,654 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7025.634733 2021-02-19 03:59:36,693 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3194.494753 2021-02-19 03:59:36,864 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6354.904548 2021-02-19 03:59:36,974 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:36,977 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2951.883708 2021-02-19 03:59:37,180 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3144.818091 2021-02-19 03:59:37,204 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5288.465767 2021-02-19 03:59:37,263 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3313.449775 2021-02-19 03:59:37,289 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3153.786457 2021-02-19 03:59:37,743 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 54.64 % 2021-02-19 03:59:37,756 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:59:37,757 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:59:37,885 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4033.464618 2021-02-19 03:59:38,292 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7025.634733 2021-02-19 03:59:38,338 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3194.494753 2021-02-19 03:59:38,509 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6354.904548 2021-02-19 03:59:38,674 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:38,680 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2951.883708 2021-02-19 03:59:38,815 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3144.818091 2021-02-19 03:59:38,890 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5288.465767 2021-02-19 03:59:38,917 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3313.449775 2021-02-19 03:59:39,020 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3153.786457 2021-02-19 03:59:39,500 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4033.464618 2021-02-19 03:59:39,826 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 54.77 % 2021-02-19 03:59:39,828 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 54.7700826576 2021-02-19 03:59:39,941 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6977.134733 2021-02-19 03:59:39,976 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3194.494753 2021-02-19 03:59:40,155 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6354.904548 2021-02-19 03:59:40,341 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2743.283708 2021-02-19 03:59:40,345 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:40,496 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3144.818091 2021-02-19 03:59:40,592 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5288.465767 2021-02-19 03:59:40,592 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3275.349775 2021-02-19 03:59:40,678 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3059.286457 2021-02-19 03:59:41,131 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4033.464618 2021-02-19 03:59:41,576 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6977.134733 2021-02-19 03:59:41,598 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3194.494753 2021-02-19 03:59:41,772 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6354.904548 2021-02-19 03:59:41,997 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2743.283708 2021-02-19 03:59:42,023 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:42,135 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3144.818091 2021-02-19 03:59:42,230 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5288.465767 2021-02-19 03:59:42,259 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3275.349775 2021-02-19 03:59:42,301 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3086.586457 2021-02-19 03:59:42,762 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4179.064618 2021-02-19 03:59:43,200 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7010.334733 2021-02-19 03:59:43,229 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3189.094753 2021-02-19 03:59:43,405 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6292.904548 2021-02-19 03:59:43,644 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2827.283708 2021-02-19 03:59:43,661 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:43,769 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3066.618091 2021-02-19 03:59:43,890 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3309.549775 2021-02-19 03:59:43,900 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5351.565767 2021-02-19 03:59:43,967 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3086.586457 2021-02-19 03:59:44,410 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4179.064618 2021-02-19 03:59:44,842 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7010.334733 2021-02-19 03:59:44,861 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3189.094753 2021-02-19 03:59:44,907 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 55.24 % 2021-02-19 03:59:44,907 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 55.2360263759 2021-02-19 03:59:45,023 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6292.904548 2021-02-19 03:59:45,331 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:45,346 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2827.283708 2021-02-19 03:59:45,407 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3066.618091 2021-02-19 03:59:45,536 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3309.549775 2021-02-19 03:59:45,559 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5351.565767 2021-02-19 03:59:45,628 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3070.205353 2021-02-19 03:59:46,043 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4224.558129 2021-02-19 03:59:46,532 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7021.570885 2021-02-19 03:59:46,543 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3146.283842 2021-02-19 03:59:46,677 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6172.535268 2021-02-19 03:59:46,986 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:47,009 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2974.089695 2021-02-19 03:59:47,045 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3019.358279 2021-02-19 03:59:47,161 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3297.144022 2021-02-19 03:59:47,196 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5386.451676 2021-02-19 03:59:47,286 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3070.205353 2021-02-19 03:59:47,671 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4224.558129 2021-02-19 03:59:47,785 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 55.49 % 2021-02-19 03:59:47,799 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:59:47,799 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:59:48,167 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7021.570885 2021-02-19 03:59:48,190 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3146.283842 2021-02-19 03:59:48,286 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6172.535268 2021-02-19 03:59:48,637 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:48,657 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2974.089695 2021-02-19 03:59:48,676 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3019.358279 2021-02-19 03:59:48,796 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3297.144022 2021-02-19 03:59:48,822 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5386.451676 2021-02-19 03:59:48,927 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3070.205353 2021-02-19 03:59:49,305 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4224.558129 2021-02-19 03:59:49,818 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7045.170885 2021-02-19 03:59:49,831 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3146.283842 2021-02-19 03:59:49,920 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6172.535268 2021-02-19 03:59:49,982 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 55.71 % 2021-02-19 03:59:49,983 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 55.7084741593 2021-02-19 03:59:50,303 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3019.358279 2021-02-19 03:59:50,336 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:50,351 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2835.689695 2021-02-19 03:59:50,446 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3314.644022 2021-02-19 03:59:50,469 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5386.451676 2021-02-19 03:59:50,565 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3055.005353 2021-02-19 03:59:50,930 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4224.558129 2021-02-19 03:59:51,473 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7045.170885 2021-02-19 03:59:51,483 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3146.283842 2021-02-19 03:59:51,552 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6172.535268 2021-02-19 03:59:52,006 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3019.358279 2021-02-19 03:59:52,009 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2835.689695 2021-02-19 03:59:52,015 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:52,085 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3314.644022 2021-02-19 03:59:52,135 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5386.451676 2021-02-19 03:59:52,200 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3055.005353 2021-02-19 03:59:52,552 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4272.058129 2021-02-19 03:59:53,127 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7097.870885 2021-02-19 03:59:53,164 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3213.983842 2021-02-19 03:59:53,233 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6256.635268 2021-02-19 03:59:53,667 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3120.758279 2021-02-19 03:59:53,684 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:53,696 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2738.289695 2021-02-19 03:59:53,778 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3329.844022 2021-02-19 03:59:53,796 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5457.151676 2021-02-19 03:59:53,864 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3018.805353 2021-02-19 03:59:54,196 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4272.058129 2021-02-19 03:59:54,785 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7097.870885 2021-02-19 03:59:54,828 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3213.983842 2021-02-19 03:59:54,881 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6256.635268 2021-02-19 03:59:55,039 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 56.21 % 2021-02-19 03:59:55,039 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 56.2070017936 2021-02-19 03:59:55,335 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3120.758279 2021-02-19 03:59:55,357 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2738.289695 2021-02-19 03:59:55,368 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:55,436 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5457.151676 2021-02-19 03:59:55,490 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3329.844022 2021-02-19 03:59:55,523 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3018.805353 2021-02-19 03:59:55,822 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4298.600000 2021-02-19 03:59:56,450 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7097.870885 2021-02-19 03:59:56,490 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3295.200000 2021-02-19 03:59:56,562 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6391.500000 2021-02-19 03:59:57,040 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2684.700000 2021-02-19 03:59:57,055 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3255.600000 2021-02-19 03:59:57,082 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:57,125 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5495.700000 2021-02-19 03:59:57,190 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3065.500000 2021-02-19 03:59:57,191 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3373.700000 2021-02-19 03:59:57,440 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4298.600000 2021-02-19 03:59:57,812 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 56.49 % 2021-02-19 03:59:57,825 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 03:59:57,825 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 03:59:58,101 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7154.800000 2021-02-19 03:59:58,131 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3295.200000 2021-02-19 03:59:58,207 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6391.500000 2021-02-19 03:59:58,717 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2684.700000 2021-02-19 03:59:58,732 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3255.600000 2021-02-19 03:59:58,734 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 03:59:58,813 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5495.700000 2021-02-19 03:59:58,861 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3373.700000 2021-02-19 03:59:58,861 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3065.500000 2021-02-19 03:59:59,055 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4298.600000 2021-02-19 03:59:59,763 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7164.500000 2021-02-19 03:59:59,773 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3295.200000 2021-02-19 03:59:59,836 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6391.500000 2021-02-19 04:00:00,101 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 56.69 % 2021-02-19 04:00:00,102 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 56.689218359 2021-02-19 04:00:00,374 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2684.700000 2021-02-19 04:00:00,391 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:00,414 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3255.600000 2021-02-19 04:00:00,487 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5495.700000 2021-02-19 04:00:00,542 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3350.400000 2021-02-19 04:00:00,565 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3126.900000 2021-02-19 04:00:00,690 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4298.600000 2021-02-19 04:00:01,404 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3295.200000 2021-02-19 04:00:01,417 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7164.500000 2021-02-19 04:00:01,457 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6391.500000 2021-02-19 04:00:02,042 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2573.700000 2021-02-19 04:00:02,058 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:02,068 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3255.600000 2021-02-19 04:00:02,122 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5495.700000 2021-02-19 04:00:02,184 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3350.400000 2021-02-19 04:00:02,220 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3126.900000 2021-02-19 04:00:02,341 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4226.200000 2021-02-19 04:00:03,039 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3248.400000 2021-02-19 04:00:03,058 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7150.300000 2021-02-19 04:00:03,099 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6371.000000 2021-02-19 04:00:03,687 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:03,736 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2510.900000 2021-02-19 04:00:03,744 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3231.700000 2021-02-19 04:00:03,782 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5468.800000 2021-02-19 04:00:03,845 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3312.800000 2021-02-19 04:00:03,875 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3169.600000 2021-02-19 04:00:03,967 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4226.200000 2021-02-19 04:00:04,707 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3248.400000 2021-02-19 04:00:04,727 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7150.300000 2021-02-19 04:00:04,746 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6371.000000 2021-02-19 04:00:05,161 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 57.20 % 2021-02-19 04:00:05,161 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 57.2040953211 2021-02-19 04:00:05,374 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:05,428 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3231.700000 2021-02-19 04:00:05,437 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2510.900000 2021-02-19 04:00:05,447 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5468.800000 2021-02-19 04:00:05,502 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3312.800000 2021-02-19 04:00:05,529 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3169.600000 2021-02-19 04:00:05,608 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4226.200000 2021-02-19 04:00:06,332 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3190.600000 2021-02-19 04:00:06,378 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6371.000000 2021-02-19 04:00:06,394 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7150.300000 2021-02-19 04:00:07,049 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:07,078 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3147.600000 2021-02-19 04:00:07,114 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2337.800000 2021-02-19 04:00:07,128 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5396.200000 2021-02-19 04:00:07,150 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3242.000000 2021-02-19 04:00:07,188 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3156.000000 2021-02-19 04:00:07,240 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4152.700000 2021-02-19 04:00:07,846 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 57.49 % 2021-02-19 04:00:07,859 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:00:07,861 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:00:07,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3190.600000 2021-02-19 04:00:08,015 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6299.500000 2021-02-19 04:00:08,015 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7080.600000 2021-02-19 04:00:08,724 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:08,747 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3147.600000 2021-02-19 04:00:08,788 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5396.200000 2021-02-19 04:00:08,805 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2337.800000 2021-02-19 04:00:08,815 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3242.000000 2021-02-19 04:00:08,867 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3156.000000 2021-02-19 04:00:08,891 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4152.700000 2021-02-19 04:00:09,555 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3190.600000 2021-02-19 04:00:09,657 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6299.500000 2021-02-19 04:00:09,677 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7037.800000 2021-02-19 04:00:10,206 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 57.72 % 2021-02-19 04:00:10,206 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 57.7221095948 2021-02-19 04:00:10,378 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3147.600000 2021-02-19 04:00:10,426 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:10,476 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5396.200000 2021-02-19 04:00:10,512 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3241.500000 2021-02-19 04:00:10,538 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2173.700000 2021-02-19 04:00:10,552 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3154.600000 2021-02-19 04:00:10,561 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4152.700000 2021-02-19 04:00:10,790 | infra | INFO | pool-2-thread-55 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 04:00:10,790 | infra | INFO | pool-2-thread-55 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 04:00:11,170 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3190.600000 2021-02-19 04:00:11,342 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6299.500000 2021-02-19 04:00:11,368 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7037.800000 2021-02-19 04:00:12,040 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3147.600000 2021-02-19 04:00:12,111 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:12,164 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5396.200000 2021-02-19 04:00:12,213 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4152.700000 2021-02-19 04:00:12,226 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3241.500000 2021-02-19 04:00:12,233 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2173.700000 2021-02-19 04:00:12,273 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3154.600000 2021-02-19 04:00:12,793 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3220.200000 2021-02-19 04:00:12,987 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6264.700000 2021-02-19 04:00:13,000 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6980.400000 2021-02-19 04:00:13,710 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3143.600000 2021-02-19 04:00:13,750 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:13,831 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5395.200000 2021-02-19 04:00:13,882 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3262.100000 2021-02-19 04:00:13,920 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4179.100000 2021-02-19 04:00:13,927 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2082.100000 2021-02-19 04:00:13,928 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3184.500000 2021-02-19 04:00:14,418 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3220.200000 2021-02-19 04:00:14,608 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6264.700000 2021-02-19 04:00:14,628 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6980.400000 2021-02-19 04:00:15,266 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 58.16 % 2021-02-19 04:00:15,266 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 58.1619861654 2021-02-19 04:00:15,361 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3143.600000 2021-02-19 04:00:15,408 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:15,480 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5395.200000 2021-02-19 04:00:15,551 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3262.100000 2021-02-19 04:00:15,611 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3184.500000 2021-02-19 04:00:15,617 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2082.100000 2021-02-19 04:00:15,635 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4179.100000 2021-02-19 04:00:16,042 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3279.300000 2021-02-19 04:00:16,226 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6268.300000 2021-02-19 04:00:16,289 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6970.100000 2021-02-19 04:00:16,994 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3142.700000 2021-02-19 04:00:17,026 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:17,118 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5513.500000 2021-02-19 04:00:17,220 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3336.300000 2021-02-19 04:00:17,279 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3217.200000 2021-02-19 04:00:17,296 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4235.200000 2021-02-19 04:00:17,311 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2280.200000 2021-02-19 04:00:17,684 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3279.300000 2021-02-19 04:00:17,888 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 58.38 % 2021-02-19 04:00:17,904 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:00:17,904 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:00:17,921 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6268.300000 2021-02-19 04:00:17,979 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6970.100000 2021-02-19 04:00:18,664 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:18,690 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3142.700000 2021-02-19 04:00:18,740 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5513.500000 2021-02-19 04:00:18,917 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3336.300000 2021-02-19 04:00:18,986 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4235.200000 2021-02-19 04:00:18,996 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3217.200000 2021-02-19 04:00:19,009 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2280.200000 2021-02-19 04:00:19,309 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3279.300000 2021-02-19 04:00:19,526 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6268.300000 2021-02-19 04:00:19,607 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6970.100000 2021-02-19 04:00:20,318 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:20,329 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 58.60 % 2021-02-19 04:00:20,329 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 58.5953841893 2021-02-19 04:00:20,355 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3142.700000 2021-02-19 04:00:20,405 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5513.500000 2021-02-19 04:00:20,555 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3432.300000 2021-02-19 04:00:20,618 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4235.200000 2021-02-19 04:00:20,650 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2265.600000 2021-02-19 04:00:20,657 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3235.800000 2021-02-19 04:00:20,921 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3279.300000 2021-02-19 04:00:21,141 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6268.300000 2021-02-19 04:00:21,237 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6992.100000 2021-02-19 04:00:21,963 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:22,003 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3142.700000 2021-02-19 04:00:22,026 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5513.500000 2021-02-19 04:00:22,210 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3432.300000 2021-02-19 04:00:22,362 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3240.400000 2021-02-19 04:00:22,371 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2534.900000 2021-02-19 04:00:22,387 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4235.200000 2021-02-19 04:00:22,540 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3396.600000 2021-02-19 04:00:22,775 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6424.900000 2021-02-19 04:00:22,895 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7064.800000 2021-02-19 04:00:23,589 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:23,630 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3168.100000 2021-02-19 04:00:23,714 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5608.700000 2021-02-19 04:00:23,946 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3510.300000 2021-02-19 04:00:24,023 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3240.400000 2021-02-19 04:00:24,048 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4369.000000 2021-02-19 04:00:24,078 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2534.900000 2021-02-19 04:00:24,180 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3396.600000 2021-02-19 04:00:24,427 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6424.900000 2021-02-19 04:00:24,559 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7064.800000 2021-02-19 04:00:25,206 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:25,296 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3168.100000 2021-02-19 04:00:25,385 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 59.04 % 2021-02-19 04:00:25,385 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 59.041815787 2021-02-19 04:00:25,390 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5608.700000 2021-02-19 04:00:25,595 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3510.300000 2021-02-19 04:00:25,694 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3265.900000 2021-02-19 04:00:25,704 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4522.300000 2021-02-19 04:00:25,760 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2548.400000 2021-02-19 04:00:25,835 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3501.200000 2021-02-19 04:00:26,049 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6621.300000 2021-02-19 04:00:26,184 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7161.600000 2021-02-19 04:00:26,831 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:26,950 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3224.100000 2021-02-19 04:00:27,026 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5629.100000 2021-02-19 04:00:27,243 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3569.800000 2021-02-19 04:00:27,332 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3265.900000 2021-02-19 04:00:27,371 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4522.300000 2021-02-19 04:00:27,418 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2548.400000 2021-02-19 04:00:27,471 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3501.200000 2021-02-19 04:00:27,711 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6621.300000 2021-02-19 04:00:27,815 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7161.600000 2021-02-19 04:00:27,938 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 59.24 % 2021-02-19 04:00:27,954 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:00:27,954 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:00:28,466 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:28,594 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3224.100000 2021-02-19 04:00:28,671 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5629.100000 2021-02-19 04:00:28,884 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3569.800000 2021-02-19 04:00:28,987 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3265.900000 2021-02-19 04:00:29,026 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4522.300000 2021-02-19 04:00:29,088 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2548.400000 2021-02-19 04:00:29,121 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3501.200000 2021-02-19 04:00:29,332 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6621.300000 2021-02-19 04:00:29,431 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7161.600000 2021-02-19 04:00:30,118 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:30,240 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3224.100000 2021-02-19 04:00:30,288 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5629.100000 2021-02-19 04:00:30,463 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 59.37 % 2021-02-19 04:00:30,463 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 59.3741846053 2021-02-19 04:00:30,545 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3543.500000 2021-02-19 04:00:30,651 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3298.900000 2021-02-19 04:00:30,683 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4522.300000 2021-02-19 04:00:30,730 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2424.900000 2021-02-19 04:00:30,772 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3501.200000 2021-02-19 04:00:30,947 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6621.300000 2021-02-19 04:00:31,065 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7185.800000 2021-02-19 04:00:31,752 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:31,871 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3224.100000 2021-02-19 04:00:31,940 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5629.100000 2021-02-19 04:00:32,198 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3543.500000 2021-02-19 04:00:32,285 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3341.000000 2021-02-19 04:00:32,326 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4484.900000 2021-02-19 04:00:32,375 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2294.300000 2021-02-19 04:00:32,434 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3448.100000 2021-02-19 04:00:32,582 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6606.900000 2021-02-19 04:00:32,709 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7150.400000 2021-02-19 04:00:33,371 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:33,492 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3268.300000 2021-02-19 04:00:33,549 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5520.900000 2021-02-19 04:00:33,839 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3522.700000 2021-02-19 04:00:33,924 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3341.000000 2021-02-19 04:00:33,954 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4484.900000 2021-02-19 04:00:34,013 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2294.300000 2021-02-19 04:00:34,086 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3448.100000 2021-02-19 04:00:34,223 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6606.900000 2021-02-19 04:00:34,328 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7150.400000 2021-02-19 04:00:34,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:35,117 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3268.300000 2021-02-19 04:00:35,187 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5520.900000 2021-02-19 04:00:35,457 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3522.700000 2021-02-19 04:00:35,507 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 59.65 % 2021-02-19 04:00:35,507 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 59.647825954 2021-02-19 04:00:35,589 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3341.000000 2021-02-19 04:00:35,614 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4484.900000 2021-02-19 04:00:35,684 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2294.300000 2021-02-19 04:00:35,720 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3405.400000 2021-02-19 04:00:35,842 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6574.100000 2021-02-19 04:00:35,982 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7102.300000 2021-02-19 04:00:36,625 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:36,737 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3289.000000 2021-02-19 04:00:36,829 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5438.100000 2021-02-19 04:00:37,104 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3496.700000 2021-02-19 04:00:37,255 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3382.000000 2021-02-19 04:00:37,273 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4423.000000 2021-02-19 04:00:37,384 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2063.100000 2021-02-19 04:00:37,414 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3405.400000 2021-02-19 04:00:37,500 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6574.100000 2021-02-19 04:00:37,638 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7102.300000 2021-02-19 04:00:37,977 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 59.77 % 2021-02-19 04:00:37,993 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:00:37,993 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:00:38,270 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:38,364 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3289.000000 2021-02-19 04:00:38,460 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5438.100000 2021-02-19 04:00:38,733 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3496.700000 2021-02-19 04:00:38,907 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3382.000000 2021-02-19 04:00:38,910 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4423.000000 2021-02-19 04:00:39,009 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2063.100000 2021-02-19 04:00:39,046 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3405.400000 2021-02-19 04:00:39,151 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6574.100000 2021-02-19 04:00:39,273 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7102.300000 2021-02-19 04:00:39,894 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:39,984 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3289.000000 2021-02-19 04:00:40,069 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5438.100000 2021-02-19 04:00:40,378 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3549.800000 2021-02-19 04:00:40,552 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4423.000000 2021-02-19 04:00:40,562 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 59.87 % 2021-02-19 04:00:40,562 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 59.8695368558 2021-02-19 04:00:40,591 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3429.800000 2021-02-19 04:00:40,671 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3405.400000 2021-02-19 04:00:40,671 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2039.700000 2021-02-19 04:00:40,782 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6574.100000 2021-02-19 04:00:40,897 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7179.900000 2021-02-19 04:00:41,538 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:41,615 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3289.000000 2021-02-19 04:00:41,680 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5438.100000 2021-02-19 04:00:41,711 | infra | INFO | pool-2-thread-39 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 04:00:41,713 | infra | INFO | pool-2-thread-39 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 04:00:41,999 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3549.800000 2021-02-19 04:00:42,196 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4423.000000 2021-02-19 04:00:42,301 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3429.800000 2021-02-19 04:00:42,315 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1403.200000 2021-02-19 04:00:42,351 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3532.400000 2021-02-19 04:00:42,466 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6745.700000 2021-02-19 04:00:42,579 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7321.000000 2021-02-19 04:00:43,180 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:43,250 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3258.700000 2021-02-19 04:00:43,326 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5538.700000 2021-02-19 04:00:43,654 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3625.300000 2021-02-19 04:00:43,839 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4551.100000 2021-02-19 04:00:43,980 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1403.200000 2021-02-19 04:00:43,996 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3475.900000 2021-02-19 04:00:44,023 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3532.400000 2021-02-19 04:00:44,118 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6745.700000 2021-02-19 04:00:44,239 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7321.000000 2021-02-19 04:00:44,841 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:44,960 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3258.700000 2021-02-19 04:00:44,990 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5538.700000 2021-02-19 04:00:45,321 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3625.300000 2021-02-19 04:00:45,519 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4551.100000 2021-02-19 04:00:45,628 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 60.00 % 2021-02-19 04:00:45,628 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 60.0 2021-02-19 04:00:45,632 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1403.200000 2021-02-19 04:00:45,756 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3475.900000 2021-02-19 04:00:45,772 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3532.400000 2021-02-19 04:00:45,773 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6862.600000 2021-02-19 04:00:45,901 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7438.000000 2021-02-19 04:00:46,453 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:46,611 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3208.100000 2021-02-19 04:00:46,621 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5745.100000 2021-02-19 04:00:46,996 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3694.500000 2021-02-19 04:00:47,128 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4677.000000 2021-02-19 04:00:47,273 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1052.200000 2021-02-19 04:00:47,476 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3482.800000 2021-02-19 04:00:47,496 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6862.600000 2021-02-19 04:00:47,497 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3639.100000 2021-02-19 04:00:47,585 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7438.000000 2021-02-19 04:00:48,019 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 60.00 % 2021-02-19 04:00:48,036 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:00:48,036 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:00:48,059 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:48,299 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5745.100000 2021-02-19 04:00:48,311 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3208.100000 2021-02-19 04:00:48,642 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3694.500000 2021-02-19 04:00:48,757 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4677.000000 2021-02-19 04:00:48,900 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1052.200000 2021-02-19 04:00:49,128 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3482.800000 2021-02-19 04:00:49,165 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3639.100000 2021-02-19 04:00:49,176 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6862.600000 2021-02-19 04:00:49,239 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7438.000000 2021-02-19 04:00:49,694 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:49,960 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5745.100000 2021-02-19 04:00:49,979 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3208.100000 2021-02-19 04:00:50,296 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3599.000000 2021-02-19 04:00:50,444 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4677.000000 2021-02-19 04:00:50,619 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1052.200000 2021-02-19 04:00:50,698 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 60.00 % 2021-02-19 04:00:50,698 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 60.0 2021-02-19 04:00:50,785 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3639.100000 2021-02-19 04:00:50,818 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3394.300000 2021-02-19 04:00:50,838 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6862.600000 2021-02-19 04:00:50,871 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7213.200000 2021-02-19 04:00:51,338 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:51,614 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5745.100000 2021-02-19 04:00:51,619 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3208.100000 2021-02-19 04:00:51,950 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3599.000000 2021-02-19 04:00:52,072 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4677.000000 2021-02-19 04:00:52,262 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1052.200000 2021-02-19 04:00:52,420 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3280.000000 2021-02-19 04:00:52,493 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3232.900000 2021-02-19 04:00:52,523 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6766.800000 2021-02-19 04:00:52,523 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6278.500000 2021-02-19 04:00:52,987 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:53,282 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3148.100000 2021-02-19 04:00:53,285 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6011.300000 2021-02-19 04:00:53,599 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3383.800000 2021-02-19 04:00:53,694 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4486.600000 2021-02-19 04:00:53,882 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2982.700000 2021-02-19 04:00:54,095 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3280.000000 2021-02-19 04:00:54,125 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3232.900000 2021-02-19 04:00:54,178 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6278.500000 2021-02-19 04:00:54,187 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6766.800000 2021-02-19 04:00:54,621 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:54,944 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6011.300000 2021-02-19 04:00:54,963 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3148.100000 2021-02-19 04:00:55,265 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3383.800000 2021-02-19 04:00:55,351 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4486.600000 2021-02-19 04:00:55,516 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2982.700000 2021-02-19 04:00:55,763 | test | DEBUG | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 60.07 % 2021-02-19 04:00:55,763 | test | INFO | pool-1-thread-26 | [task:check:330] Rebalance - status: running, progress: 60.0684326238 2021-02-19 04:00:55,769 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2836.600000 2021-02-19 04:00:55,845 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3069.900000 2021-02-19 04:00:55,848 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6238.400000 2021-02-19 04:00:55,865 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5634.200000 2021-02-19 04:00:56,250 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:56,605 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3099.900000 2021-02-19 04:00:56,631 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6148.200000 2021-02-19 04:00:56,911 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3120.500000 2021-02-19 04:00:57,006 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4210.100000 2021-02-19 04:00:57,170 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5405.700000 2021-02-19 04:00:57,404 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2836.600000 2021-02-19 04:00:57,517 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5634.200000 2021-02-19 04:00:57,517 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3069.900000 2021-02-19 04:00:57,552 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6238.400000 2021-02-19 04:00:57,875 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:58,036 | test | INFO | MainThread | [rest_client:rebalance_reached:108] Rebalance reached >60.0% in 150.573999882 seconds 2021-02-19 04:00:58,059 | test | DEBUG | MainThread | [rest_client:diag_eval:1363] /diag/eval status on 172.23.110.64:8091: 1 content: true command: ns_orchestrator:needs_rebalance() 2021-02-19 04:00:58,059 | test | INFO | MainThread | [Magma:abort_rebalance:912] Abort rebalance 2021-02-19 04:00:58,247 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3099.900000 2021-02-19 04:00:58,275 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6148.200000 2021-02-19 04:00:58,496 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L914 2021-02-19 04:00:58,497 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 60 seconds. Reason: Sleep after error introduction 2021-02-19 04:00:58,546 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3120.500000 2021-02-19 04:00:58,622 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4210.100000 2021-02-19 04:00:58,773 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5405.700000 2021-02-19 04:00:59,033 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2836.600000 2021-02-19 04:00:59,125 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5634.200000 2021-02-19 04:00:59,144 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3069.900000 2021-02-19 04:00:59,190 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6238.400000 2021-02-19 04:00:59,463 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:00:59,875 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3099.900000 2021-02-19 04:00:59,884 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6148.200000 2021-02-19 04:01:00,148 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3015.300000 2021-02-19 04:01:00,230 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4210.100000 2021-02-19 04:01:00,355 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5405.700000 2021-02-19 04:01:00,733 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5634.200000 2021-02-19 04:01:00,749 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2836.600000 2021-02-19 04:01:00,778 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3037.700000 2021-02-19 04:01:00,822 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5599.200000 2021-02-19 04:01:00,851 | test | ERROR | pool-1-thread-26 | [rest_client:_rebalance_status_and_progress:1494] {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 04:01:00,930 | test | INFO | pool-1-thread-26 | [rest_client:print_UI_logs:2599] Latest logs from UI on 172.23.110.64: 2021-02-19 04:01:00,930 | test | ERROR | pool-1-thread-26 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_orchestrator', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613736059239L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:00:59.239Z', u'text': u'Rebalance exited with reason {mover_crashed,\n {unexpected_exit,\n {\'EXIT\',<0.26615.37>,\n {{{badmatch,{error,closed}},\n [{mc_client_binary,cmd_vocal_recv,5,\n [{file,"src/mc_client_binary.erl"},\n {line,158}]},\n {mc_client_binary,\n wait_for_seqno_persistence,3,\n [{file,"src/mc_client_binary.erl"},\n {line,763}]},\n {ns_memcached,\n \'-wait_for_seqno_persistence/3-fun-0-\',3,\n [{file,"src/ns_memcached.erl"},\n {line,1392}]},\n {ns_memcached,\n \'-perform_very_long_call/3-fun-0-\',2,\n [{file,"src/ns_memcached.erl"},\n {line,324}]},\n {ns_memcached_sockets_pool,\n \'-executing_on_socket/3-fun-0-\',3,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,92}]},\n {async,\'-async_init/4-fun-1-\',3,\n [{file,"src/async.erl"},{line,197}]}]},\n {gen_server,call,\n [{\'janitor_agent-GleamBookUsers6\',\n \'ns_1@172.23.110.64\'},\n {if_rebalance,<0.24889.37>,\n {update_vbucket_state,848,active,\n undefined,undefined,\n [[\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.69\'],\n [\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.65\']]}},\n infinity]}}}}}.\nRebalance Operation Id = ad3a281454c11e9832237485407c1dc3'} 2021-02-19 04:01:00,930 | test | ERROR | pool-1-thread-26 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_log', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613736059208L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:00:59.208Z', u'text': u"Service 'memcached' exited with status 137. Restarting. Messages:\nWARNING: Logging before InitGoogleLogging() is written to STDERR\nW0219 03:55:24.273398 39618 HazptrDomain.h:671] Using the default inline executor for asynchronous reclamation may be susceptible to deadlock if the current thread happens to hold a resource needed by the deleter of a reclaimable object"} 2021-02-19 04:01:00,930 | test | ERROR | pool-1-thread-26 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613736059208L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:00:59.208Z', u'text': u'Worker <0.26069.37> (for action {move,{848,\n [\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.69\'],\n [\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.65\'],\n []}}) exited with reason {unexpected_exit,\n {\'EXIT\',\n <0.26615.37>,\n {{{badmatch,\n {error,\n closed}},\n [{mc_client_binary,\n cmd_vocal_recv,\n 5,\n [{file,\n "src/mc_client_binary.erl"},\n {line,\n 158}]},\n {mc_client_binary,\n wait_for_seqno_persistence,\n 3,\n [{file,\n "src/mc_client_binary.erl"},\n {line,\n 763}]},\n {ns_memcached,\n \'-wait_for_seqno_persistence/3-fun-0-\',\n 3,\n [{file,\n "src/ns_memcached.erl"},\n {line,\n 1392}]},\n {ns_memcached,\n \'-perform_very_long_call/3-fun-0-\',\n 2,\n [{file,\n "src/ns_memcached.erl"},\n {line,\n 324}]},\n {ns_memcached_sockets_pool,\n \'-executing_on_socket/3-fun-0-\',\n 3,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,\n 92}]},\n {async,\n \'-async_init/4-fun-1-\',\n 3,\n [{file,\n "src/async.erl"},\n {line,\n 197}]}]},\n {gen_server,\n call,\n [{\'janitor_agent-GleamBookUsers6\',\n \'ns_1@172.23.110.64\'},\n {if_rebalance,\n <0.24889.37>,\n {update_vbucket_state,\n 848,\n active,\n undefined,\n undefined,\n [[\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.69\'],\n [\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.65\']]}},\n infinity]}}}}'} 2021-02-19 04:01:00,931 | test | ERROR | pool-1-thread-26 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613736059205L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:00:59.205Z', u'text': u"Control connection to memcached on 'ns_1@172.23.110.64' disconnected. Check logs for details."} 2021-02-19 04:01:00,931 | test | ERROR | pool-1-thread-26 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613736053496L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:00:53.496Z', u'text': u'Shutting down bucket "GleamBookUsers5" on \'ns_1@172.23.110.69\' for deletion'} 2021-02-19 04:01:00,931 | test | ERROR | pool-1-thread-26 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613736053049L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:00:53.049Z', u'text': u'Bucket "GleamBookUsers6" rebalance does not seem to be swap rebalance'} 2021-02-19 04:01:00,931 | test | ERROR | pool-1-thread-26 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_rebalancer', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613736052927L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:00:52.927Z', u'text': u'Started rebalancing bucket GleamBookUsers6'} 2021-02-19 04:01:00,931 | test | ERROR | pool-1-thread-26 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613735904170L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:58:24.170Z', u'text': u'Shutting down bucket "GleamBookUsers4" on \'ns_1@172.23.110.69\' for deletion'} 2021-02-19 04:01:00,933 | test | ERROR | pool-1-thread-26 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735903716L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:58:23.716Z', u'text': u'Bucket "GleamBookUsers5" rebalance does not seem to be swap rebalance'} 2021-02-19 04:01:00,933 | test | ERROR | pool-1-thread-26 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_rebalancer', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613735903598L, u'shortText': u'message', u'serverTime': u'2021-02-19T03:58:23.598Z', u'text': u'Started rebalancing bucket GleamBookUsers5'} 2021-02-19 04:01:00,933 | test | ERROR | pool-1-thread-26 | [task:call:242] Rebalance Failed: {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 04:01:01,065 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:01,775 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3099.900000 2021-02-19 04:01:01,776 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3015.300000 2021-02-19 04:01:01,792 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6148.200000 2021-02-19 04:01:01,868 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4210.100000 2021-02-19 04:01:02,020 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5405.700000 2021-02-19 04:01:02,371 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1375.400000 2021-02-19 04:01:02,371 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2773.700000 2021-02-19 04:01:02,394 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2022.000000 2021-02-19 04:01:02,450 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3544.800000 2021-02-19 04:01:02,677 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:03,400 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1986.900000 2021-02-19 04:01:03,411 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1544.300000 2021-02-19 04:01:03,424 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3068.500000 2021-02-19 04:01:03,477 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2066.200000 2021-02-19 04:01:03,617 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3005.100000 2021-02-19 04:01:04,005 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1375.400000 2021-02-19 04:01:04,020 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2022.000000 2021-02-19 04:01:04,032 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2773.700000 2021-02-19 04:01:04,095 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3544.800000 2021-02-19 04:01:04,279 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:05,052 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1986.900000 2021-02-19 04:01:05,069 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1544.300000 2021-02-19 04:01:05,084 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3068.500000 2021-02-19 04:01:05,151 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2066.200000 2021-02-19 04:01:05,292 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3005.100000 2021-02-19 04:01:05,635 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1375.400000 2021-02-19 04:01:05,661 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2773.700000 2021-02-19 04:01:05,704 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2022.000000 2021-02-19 04:01:05,795 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2207.800000 2021-02-19 04:01:05,884 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:06,680 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1567.500000 2021-02-19 04:01:06,694 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 796.200000 2021-02-19 04:01:06,733 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1684.200000 2021-02-19 04:01:06,767 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1101.500000 2021-02-19 04:01:06,898 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1620.800000 2021-02-19 04:01:07,265 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 833.300000 2021-02-19 04:01:07,315 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1575.000000 2021-02-19 04:01:07,348 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1580.900000 2021-02-19 04:01:07,450 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2207.800000 2021-02-19 04:01:07,500 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:08,282 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1567.500000 2021-02-19 04:01:08,305 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 796.200000 2021-02-19 04:01:08,369 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1684.200000 2021-02-19 04:01:08,400 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1101.500000 2021-02-19 04:01:08,500 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1620.800000 2021-02-19 04:01:08,855 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 833.300000 2021-02-19 04:01:08,907 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1575.000000 2021-02-19 04:01:08,970 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1580.900000 2021-02-19 04:01:09,059 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2207.800000 2021-02-19 04:01:09,102 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:09,885 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 643.300000 2021-02-19 04:01:09,917 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 796.200000 2021-02-19 04:01:09,961 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1684.200000 2021-02-19 04:01:09,999 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1101.500000 2021-02-19 04:01:10,124 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1620.800000 2021-02-19 04:01:10,440 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 833.300000 2021-02-19 04:01:10,503 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1575.000000 2021-02-19 04:01:10,558 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 625.000000 2021-02-19 04:01:10,657 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 759.300000 2021-02-19 04:01:10,701 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:11,480 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 643.300000 2021-02-19 04:01:11,509 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 796.200000 2021-02-19 04:01:11,638 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1684.200000 2021-02-19 04:01:11,648 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1101.500000 2021-02-19 04:01:11,703 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1620.800000 2021-02-19 04:01:12,023 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 833.300000 2021-02-19 04:01:12,098 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1575.000000 2021-02-19 04:01:12,210 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 625.000000 2021-02-19 04:01:12,282 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 759.300000 2021-02-19 04:01:12,292 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:13,073 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 643.300000 2021-02-19 04:01:13,161 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 796.200000 2021-02-19 04:01:13,230 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1101.950000 2021-02-19 04:01:13,240 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1684.200000 2021-02-19 04:01:13,295 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1620.800000 2021-02-19 04:01:13,605 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 833.300000 2021-02-19 04:01:13,683 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1575.000000 2021-02-19 04:01:13,793 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 625.000000 2021-02-19 04:01:13,871 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:13,888 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 759.300000 2021-02-19 04:01:14,697 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 643.300000 2021-02-19 04:01:14,763 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 796.200000 2021-02-19 04:01:14,819 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1684.200000 2021-02-19 04:01:14,834 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1101.950000 2021-02-19 04:01:14,907 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1620.800000 2021-02-19 04:01:15,188 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 833.300000 2021-02-19 04:01:15,256 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1575.000000 2021-02-19 04:01:15,387 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 625.000000 2021-02-19 04:01:15,453 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:15,476 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 759.300000 2021-02-19 04:01:16,309 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 88.000000 2021-02-19 04:01:16,346 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:01:16,408 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1101.950000 2021-02-19 04:01:16,438 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1684.200000 2021-02-19 04:01:16,483 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:01:16,773 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:01:16,859 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:01:16,996 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 79.200000 2021-02-19 04:01:17,026 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:17,052 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 140.300000 2021-02-19 04:01:17,917 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 88.000000 2021-02-19 04:01:17,947 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:01:18,016 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:01:18,030 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.450000 2021-02-19 04:01:18,063 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:01:18,375 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:01:18,506 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:01:18,579 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 79.200000 2021-02-19 04:01:18,595 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:18,625 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 140.300000 2021-02-19 04:01:19,526 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 88.000000 2021-02-19 04:01:19,545 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:01:19,605 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:01:19,635 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.450000 2021-02-19 04:01:19,648 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:01:19,963 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:01:20,089 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:01:20,206 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:01:20,236 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:01:20,246 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:21,121 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:01:21,132 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:01:21,207 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:01:21,223 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.450000 2021-02-19 04:01:21,236 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:01:21,552 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:01:21,687 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:01:21,818 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:01:21,839 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:21,858 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:01:22,724 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:01:22,736 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:01:22,799 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:01:22,815 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 16.000000 2021-02-19 04:01:22,825 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:01:23,141 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:01:23,260 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:01:23,440 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:01:23,453 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:01:23,460 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:24,321 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:01:24,334 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:01:24,385 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:01:24,401 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 16.000000 2021-02-19 04:01:24,417 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:01:24,727 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:01:24,839 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:01:25,035 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:01:25,049 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:01:25,062 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:25,927 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:01:25,959 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:01:25,973 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1024.439103 2021-02-19 04:01:26,007 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 16.000000 2021-02-19 04:01:26,020 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:01:26,321 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:01:26,447 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:01:26,634 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:01:26,648 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:01:26,657 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:27,522 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:01:27,563 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:01:27,578 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1024.439103 2021-02-19 04:01:27,631 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 16.000000 2021-02-19 04:01:27,642 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:01:27,907 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:01:28,043 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:01:28,223 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:01:28,256 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:01:28,279 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:29,099 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:01:29,164 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:01:29,180 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1024.439103 2021-02-19 04:01:29,227 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 16.000000 2021-02-19 04:01:29,236 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:01:29,502 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:01:29,625 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:01:29,839 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 69.555645 2021-02-19 04:01:29,867 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 578.662930 2021-02-19 04:01:29,869 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:30,733 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:01:30,801 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.500400 2021-02-19 04:01:30,822 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1024.439103 2021-02-19 04:01:30,828 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:01:30,890 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 16.000000 2021-02-19 04:01:31,084 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:01:31,214 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:01:31,470 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 578.662930 2021-02-19 04:01:31,477 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 69.555645 2021-02-19 04:01:31,489 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:32,359 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:01:32,407 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3.600400 2021-02-19 04:01:32,447 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5367.739103 2021-02-19 04:01:32,467 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1641.300000 2021-02-19 04:01:32,482 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 15.800000 2021-02-19 04:01:32,673 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:01:32,802 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:01:33,073 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2034.962930 2021-02-19 04:01:33,081 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 629.755645 2021-02-19 04:01:33,091 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:33,950 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:01:34,015 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3.600400 2021-02-19 04:01:34,078 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1641.300000 2021-02-19 04:01:34,105 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5367.739103 2021-02-19 04:01:34,115 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 15.800000 2021-02-19 04:01:34,270 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:01:34,382 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:01:34,674 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2034.962930 2021-02-19 04:01:34,697 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 629.755645 2021-02-19 04:01:34,704 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:35,588 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:01:35,671 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3.600400 2021-02-19 04:01:35,710 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4397.300000 2021-02-19 04:01:35,730 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8673.700000 2021-02-19 04:01:35,743 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 15.800000 2021-02-19 04:01:35,862 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.900000 2021-02-19 04:01:35,979 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:01:36,279 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4263.562930 2021-02-19 04:01:36,309 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1598.255645 2021-02-19 04:01:36,312 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:37,132 | infra | INFO | pool-2-thread-27 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 04:01:37,134 | infra | INFO | pool-2-thread-27 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 04:01:37,184 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.800000 2021-02-19 04:01:37,312 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 292.000400 2021-02-19 04:01:37,352 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4397.300000 2021-02-19 04:01:37,361 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8673.700000 2021-02-19 04:01:37,367 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 15.800000 2021-02-19 04:01:37,470 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.900000 2021-02-19 04:01:37,582 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:01:37,900 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4263.562930 2021-02-19 04:01:37,924 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1598.255645 2021-02-19 04:01:37,933 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:38,785 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.800000 2021-02-19 04:01:38,947 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 292.000400 2021-02-19 04:01:38,992 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 15.800000 2021-02-19 04:01:39,009 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4397.300000 2021-02-19 04:01:39,013 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8673.700000 2021-02-19 04:01:39,065 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.900000 2021-02-19 04:01:39,191 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:01:39,507 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4263.562930 2021-02-19 04:01:39,546 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:39,549 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1598.255645 2021-02-19 04:01:39,937 | infra | INFO | pool-2-thread-16 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 04:01:39,938 | infra | INFO | pool-2-thread-16 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 04:01:40,369 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.800000 2021-02-19 04:01:40,588 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1232.700000 2021-02-19 04:01:40,631 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4397.300000 2021-02-19 04:01:40,667 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8673.700000 2021-02-19 04:01:40,671 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 15.800000 2021-02-19 04:01:40,730 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.900000 2021-02-19 04:01:40,792 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:01:41,117 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6294.700000 2021-02-19 04:01:41,167 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:41,180 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3149.400000 2021-02-19 04:01:41,937 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.800000 2021-02-19 04:01:42,196 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1232.700000 2021-02-19 04:01:42,242 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4397.300000 2021-02-19 04:01:42,283 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 445.700000 2021-02-19 04:01:42,315 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8047.000000 2021-02-19 04:01:42,377 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.300000 2021-02-19 04:01:42,398 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 233.700000 2021-02-19 04:01:42,788 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6947.700000 2021-02-19 04:01:42,795 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:42,848 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4062.600000 2021-02-19 04:01:43,526 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 474.500000 2021-02-19 04:01:43,802 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2841.500000 2021-02-19 04:01:43,841 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6697.000000 2021-02-19 04:01:43,895 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 445.700000 2021-02-19 04:01:43,930 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8047.000000 2021-02-19 04:01:44,026 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 233.700000 2021-02-19 04:01:44,036 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.300000 2021-02-19 04:01:44,421 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:44,434 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6947.700000 2021-02-19 04:01:44,473 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4062.600000 2021-02-19 04:01:45,118 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 474.500000 2021-02-19 04:01:45,414 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2841.500000 2021-02-19 04:01:45,490 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7842.800000 2021-02-19 04:01:45,507 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 445.700000 2021-02-19 04:01:45,655 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 233.700000 2021-02-19 04:01:45,657 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8047.000000 2021-02-19 04:01:45,687 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.300000 2021-02-19 04:01:46,038 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:46,088 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6064.200000 2021-02-19 04:01:46,089 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4518.600000 2021-02-19 04:01:46,703 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1352.100000 2021-02-19 04:01:47,016 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4436.300000 2021-02-19 04:01:47,091 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7842.800000 2021-02-19 04:01:47,154 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1632.000000 2021-02-19 04:01:47,263 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1135.200000 2021-02-19 04:01:47,270 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.500000 2021-02-19 04:01:47,302 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7251.200000 2021-02-19 04:01:47,635 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:47,697 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6064.200000 2021-02-19 04:01:47,714 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4518.600000 2021-02-19 04:01:48,290 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1352.100000 2021-02-19 04:01:48,703 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4436.300000 2021-02-19 04:01:48,710 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7842.800000 2021-02-19 04:01:48,828 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1632.000000 2021-02-19 04:01:48,888 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.500000 2021-02-19 04:01:48,890 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1135.200000 2021-02-19 04:01:48,920 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7251.200000 2021-02-19 04:01:49,038 | infra | INFO | pool-2-thread-46 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 04:01:49,038 | infra | INFO | pool-2-thread-46 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 04:01:49,250 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:49,329 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6064.200000 2021-02-19 04:01:49,341 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4518.600000 2021-02-19 04:01:49,884 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1352.100000 2021-02-19 04:01:50,332 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7842.800000 2021-02-19 04:01:50,369 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5805.200000 2021-02-19 04:01:50,459 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1632.000000 2021-02-19 04:01:50,528 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1135.200000 2021-02-19 04:01:50,548 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.500000 2021-02-19 04:01:50,565 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7251.200000 2021-02-19 04:01:50,868 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:50,937 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3742.000000 2021-02-19 04:01:50,970 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4132.100000 2021-02-19 04:01:51,480 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1352.100000 2021-02-19 04:01:51,950 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7842.800000 2021-02-19 04:01:51,999 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5805.200000 2021-02-19 04:01:52,111 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1632.000000 2021-02-19 04:01:52,177 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7251.200000 2021-02-19 04:01:52,184 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1135.200000 2021-02-19 04:01:52,217 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.500000 2021-02-19 04:01:52,540 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:52,579 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3901.600000 2021-02-19 04:01:52,601 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1632.700000 2021-02-19 04:01:53,075 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2423.100000 2021-02-19 04:01:53,539 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7651.600000 2021-02-19 04:01:53,595 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6556.300000 2021-02-19 04:01:53,729 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3727.000000 2021-02-19 04:01:53,818 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6984.500000 2021-02-19 04:01:53,821 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3706.800000 2021-02-19 04:01:53,822 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.200000 2021-02-19 04:01:54,184 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:54,211 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3901.600000 2021-02-19 04:01:54,256 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1632.700000 2021-02-19 04:01:54,661 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2423.100000 2021-02-19 04:01:55,131 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7651.600000 2021-02-19 04:01:55,223 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6556.300000 2021-02-19 04:01:55,344 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3727.000000 2021-02-19 04:01:55,470 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3706.800000 2021-02-19 04:01:55,486 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.200000 2021-02-19 04:01:55,499 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6984.500000 2021-02-19 04:01:55,806 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:55,851 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3678.500000 2021-02-19 04:01:55,868 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 287.600000 2021-02-19 04:01:56,244 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3158.200000 2021-02-19 04:01:56,746 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7390.700000 2021-02-19 04:01:56,836 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7122.000000 2021-02-19 04:01:56,956 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5012.600000 2021-02-19 04:01:57,075 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5834.500000 2021-02-19 04:01:57,088 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 256.500000 2021-02-19 04:01:57,118 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6992.600000 2021-02-19 04:01:57,410 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:57,474 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3678.500000 2021-02-19 04:01:57,493 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 287.600000 2021-02-19 04:01:57,831 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3158.200000 2021-02-19 04:01:58,359 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7390.700000 2021-02-19 04:01:58,440 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7122.000000 2021-02-19 04:01:58,536 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.64:8091 2021-02-19 04:01:58,536 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 04:01:58,546 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5012.600000 2021-02-19 04:01:58,555 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.64:8091 is running 2021-02-19 04:01:58,556 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:01:58,723 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 256.500000 2021-02-19 04:01:58,736 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5834.500000 2021-02-19 04:01:58,750 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6992.600000 2021-02-19 04:01:59,003 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.445000171661. 2021-02-19 04:01:59,003 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:01:59,039 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:01:59,099 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3678.500000 2021-02-19 04:01:59,111 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 287.600000 2021-02-19 04:01:59,417 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3158.200000 2021-02-19 04:01:59,473 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.47000002861. 2021-02-19 04:01:59,473 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:01:59,953 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.480000019073. 2021-02-19 04:01:59,953 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:01:59,953 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7390.700000 2021-02-19 04:02:00,055 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7155.200000 2021-02-19 04:02:00,158 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5012.600000 2021-02-19 04:02:00,351 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 256.500000 2021-02-19 04:02:00,352 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5834.500000 2021-02-19 04:02:00,390 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6992.600000 2021-02-19 04:02:00,426 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.473000049591. 2021-02-19 04:02:00,427 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:02:00,671 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:00,736 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:00,759 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3600.600000 2021-02-19 04:02:00,891 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.464999914169. 2021-02-19 04:02:00,891 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:02:01,006 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3158.200000 2021-02-19 04:02:01,323 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.431999921799. 2021-02-19 04:02:01,323 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:02:01,561 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7390.700000 2021-02-19 04:02:01,681 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7155.200000 2021-02-19 04:02:01,762 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5012.600000 2021-02-19 04:02:01,769 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.445000171661. 2021-02-19 04:02:01,769 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:02:01,973 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5834.500000 2021-02-19 04:02:01,976 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 256.500000 2021-02-19 04:02:02,013 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6992.600000 2021-02-19 04:02:02,203 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.434000015259. 2021-02-19 04:02:02,204 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:02:02,331 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:02,378 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:02,414 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3439.900000 2021-02-19 04:02:02,637 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3165.800000 2021-02-19 04:02:02,638 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.433000087738. 2021-02-19 04:02:02,638 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:02:03,085 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.447999954224. 2021-02-19 04:02:03,111 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.65:8091 2021-02-19 04:02:03,111 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 04:02:03,167 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.65:8091 is running 2021-02-19 04:02:03,167 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:02:03,207 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7024.200000 2021-02-19 04:02:03,318 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7040.500000 2021-02-19 04:02:03,417 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4707.000000 2021-02-19 04:02:03,630 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.462000131607. 2021-02-19 04:02:03,631 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:02:03,663 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6146.100000 2021-02-19 04:02:03,687 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6757.100000 2021-02-19 04:02:03,707 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2747.000000 2021-02-19 04:02:04,029 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:04,049 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:04,078 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.447000026703. 2021-02-19 04:02:04,078 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:02:04,114 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3439.900000 2021-02-19 04:02:04,267 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3165.800000 2021-02-19 04:02:04,519 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.441999912262. 2021-02-19 04:02:04,519 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:02:04,880 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7024.200000 2021-02-19 04:02:04,990 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7040.500000 2021-02-19 04:02:04,997 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.476999998093. 2021-02-19 04:02:04,997 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:02:05,065 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4707.000000 2021-02-19 04:02:05,318 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6146.100000 2021-02-19 04:02:05,361 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6757.100000 2021-02-19 04:02:05,362 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2747.000000 2021-02-19 04:02:05,451 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.453999996185. 2021-02-19 04:02:05,451 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:02:05,711 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:05,756 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:05,819 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3257.800000 2021-02-19 04:02:05,913 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3053.100000 2021-02-19 04:02:05,933 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.481000185013. 2021-02-19 04:02:05,933 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:02:06,381 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.447999954224. 2021-02-19 04:02:06,381 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:02:06,572 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6723.600000 2021-02-19 04:02:06,706 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6794.100000 2021-02-19 04:02:06,767 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4401.600000 2021-02-19 04:02:06,834 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.453000068665. 2021-02-19 04:02:06,835 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:02:07,012 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6213.100000 2021-02-19 04:02:07,022 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5586.000000 2021-02-19 04:02:07,042 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6377.000000 2021-02-19 04:02:07,299 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.463999986649. 2021-02-19 04:02:07,299 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:02:07,358 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:07,437 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:07,487 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3257.800000 2021-02-19 04:02:07,575 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3053.100000 2021-02-19 04:02:07,769 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.47000002861. 2021-02-19 04:02:07,769 | test | INFO | MainThread | [Magma:abort_rebalance:927] Restarting Rebalance after killing at 60 2021-02-19 04:02:07,829 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[]_OUT=[172.23.110.69]_1613736127.77 2021-02-19 04:02:07,829 | infra | INFO | pool-1-thread-27 | [task:start_task:84] Thread 'Rebalance_task_IN=[]_OUT=[172.23.110.69]_1613736127.77' started 2021-02-19 04:02:07,849 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L932 2021-02-19 04:02:07,849 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 120 seconds. Reason: Let the rebalance begin after abort 2021-02-19 04:02:07,885 | test | DEBUG | pool-1-thread-27 | [task:start_rebalance:301] Removing node 172.23.110.69:8091 from cluster 2021-02-19 04:02:07,887 | test | DEBUG | pool-1-thread-27 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': u'ns_1@172.23.110.69', 'user': 'Administrator'} 2021-02-19 04:02:07,931 | test | DEBUG | pool-1-thread-27 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 04:02:07,937 | test | INFO | pool-1-thread-27 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+---------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 18.2016279822 | Cluster node | | 172.23.110.69 | kv | 7.0.0-4498-enterprise | 5.8610052622 | --- OUT ---> | | 172.23.110.65 | kv | 7.0.0-4498-enterprise | 18.1386969189 | Cluster node | +---------------+----------+-----------------------+---------------+--------------+ 2021-02-19 04:02:07,963 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 04:02:07,963 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 04:02:08,267 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6723.600000 2021-02-19 04:02:08,430 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6794.100000 2021-02-19 04:02:08,496 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4401.600000 2021-02-19 04:02:08,707 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6213.100000 2021-02-19 04:02:08,716 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5586.000000 2021-02-19 04:02:08,721 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6377.000000 2021-02-19 04:02:09,029 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:09,135 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:09,197 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3257.800000 2021-02-19 04:02:09,240 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3053.100000 2021-02-19 04:02:09,940 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6723.600000 2021-02-19 04:02:10,101 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6645.000000 2021-02-19 04:02:10,170 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4401.600000 2021-02-19 04:02:10,394 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6213.100000 2021-02-19 04:02:10,397 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5586.000000 2021-02-19 04:02:10,417 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6377.000000 2021-02-19 04:02:10,723 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:10,855 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:10,941 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3118.100000 2021-02-19 04:02:10,947 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3053.100000 2021-02-19 04:02:11,627 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6723.600000 2021-02-19 04:02:11,786 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6645.000000 2021-02-19 04:02:11,865 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4401.600000 2021-02-19 04:02:12,084 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6213.100000 2021-02-19 04:02:12,115 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6377.000000 2021-02-19 04:02:12,135 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5586.000000 2021-02-19 04:02:12,371 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:12,484 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:12,621 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3067.093761 2021-02-19 04:02:12,637 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3006.898780 2021-02-19 04:02:13,016 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 60.36 % 2021-02-19 04:02:13,016 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 60.3601273312 2021-02-19 04:02:13,249 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6623.443371 2021-02-19 04:02:13,418 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6615.356269 2021-02-19 04:02:13,484 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4340.865127 2021-02-19 04:02:13,713 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6196.080024 2021-02-19 04:02:13,763 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6279.176685 2021-02-19 04:02:13,782 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6148.989282 2021-02-19 04:02:14,013 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:14,168 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:14,285 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3006.898780 2021-02-19 04:02:14,292 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3067.093761 2021-02-19 04:02:14,881 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6623.443371 2021-02-19 04:02:15,085 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6615.356269 2021-02-19 04:02:15,117 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4340.865127 2021-02-19 04:02:15,349 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6196.080024 2021-02-19 04:02:15,418 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6279.176685 2021-02-19 04:02:15,427 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6148.989282 2021-02-19 04:02:15,664 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:15,832 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:15,933 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3042.298780 2021-02-19 04:02:15,950 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3105.993761 2021-02-19 04:02:16,535 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6530.543371 2021-02-19 04:02:16,760 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6599.956269 2021-02-19 04:02:16,778 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4339.965127 2021-02-19 04:02:17,009 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6167.080024 2021-02-19 04:02:17,101 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6085.689282 2021-02-19 04:02:17,121 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6204.476685 2021-02-19 04:02:17,315 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:17,473 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:17,569 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3042.298780 2021-02-19 04:02:17,611 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3105.993761 2021-02-19 04:02:18,081 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 61.13 % 2021-02-19 04:02:18,081 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 61.1269893991 2021-02-19 04:02:18,163 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6530.543371 2021-02-19 04:02:18,417 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6599.956269 2021-02-19 04:02:18,430 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4339.965127 2021-02-19 04:02:18,634 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6167.080024 2021-02-19 04:02:18,756 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6085.689282 2021-02-19 04:02:18,776 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6204.476685 2021-02-19 04:02:18,950 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:19,117 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:19,217 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3042.298780 2021-02-19 04:02:19,266 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3105.993761 2021-02-19 04:02:19,796 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6530.543371 2021-02-19 04:02:20,055 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6538.356269 2021-02-19 04:02:20,063 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4339.965127 2021-02-19 04:02:20,279 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6167.080024 2021-02-19 04:02:20,394 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6204.476685 2021-02-19 04:02:20,420 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6085.689282 2021-02-19 04:02:20,575 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:20,755 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:20,835 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3042.298780 2021-02-19 04:02:20,904 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3148.293761 2021-02-19 04:02:21,444 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6530.543371 2021-02-19 04:02:21,724 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4339.965127 2021-02-19 04:02:21,724 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6538.356269 2021-02-19 04:02:21,931 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6167.080024 2021-02-19 04:02:22,045 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6204.476685 2021-02-19 04:02:22,061 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6085.689282 2021-02-19 04:02:22,224 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:22,405 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:22,469 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3107.114183 2021-02-19 04:02:22,563 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3174.711522 2021-02-19 04:02:23,061 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6491.548830 2021-02-19 04:02:23,144 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 61.88 % 2021-02-19 04:02:23,144 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 61.8805181337 2021-02-19 04:02:23,380 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6396.315323 2021-02-19 04:02:23,387 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4278.722625 2021-02-19 04:02:23,579 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5981.382837 2021-02-19 04:02:23,755 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6060.894599 2021-02-19 04:02:23,783 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6010.995779 2021-02-19 04:02:23,874 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:24,055 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:24,135 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3107.114183 2021-02-19 04:02:24,236 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3174.711522 2021-02-19 04:02:24,700 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6491.548830 2021-02-19 04:02:25,035 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4278.722625 2021-02-19 04:02:25,059 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6396.315323 2021-02-19 04:02:25,233 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5981.382837 2021-02-19 04:02:25,394 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6060.894599 2021-02-19 04:02:25,437 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6010.995779 2021-02-19 04:02:25,526 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:25,729 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:25,803 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3114.314183 2021-02-19 04:02:25,875 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3159.411522 2021-02-19 04:02:26,331 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6557.348830 2021-02-19 04:02:26,724 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4210.422625 2021-02-19 04:02:26,759 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6306.115323 2021-02-19 04:02:26,901 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5870.182837 2021-02-19 04:02:27,042 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5951.894599 2021-02-19 04:02:27,078 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6002.895779 2021-02-19 04:02:27,176 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:27,404 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:27,426 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3114.314183 2021-02-19 04:02:27,509 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3159.411522 2021-02-19 04:02:27,959 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6557.348830 2021-02-19 04:02:28,216 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 62.64 % 2021-02-19 04:02:28,216 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 62.6408532789 2021-02-19 04:02:28,359 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4210.422625 2021-02-19 04:02:28,410 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6306.115323 2021-02-19 04:02:28,552 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5870.182837 2021-02-19 04:02:28,723 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6002.895779 2021-02-19 04:02:28,759 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5951.894599 2021-02-19 04:02:28,822 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:29,068 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:29,086 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3114.314183 2021-02-19 04:02:29,174 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3159.411522 2021-02-19 04:02:29,596 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6557.348830 2021-02-19 04:02:30,039 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4210.422625 2021-02-19 04:02:30,061 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6265.515323 2021-02-19 04:02:30,190 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5870.182837 2021-02-19 04:02:30,385 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6002.895779 2021-02-19 04:02:30,407 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5951.894599 2021-02-19 04:02:30,492 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:30,740 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:30,746 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3114.314183 2021-02-19 04:02:30,815 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3134.511522 2021-02-19 04:02:31,260 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6557.348830 2021-02-19 04:02:31,676 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4210.422625 2021-02-19 04:02:31,701 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6265.515323 2021-02-19 04:02:31,812 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5870.182837 2021-02-19 04:02:32,052 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6002.895779 2021-02-19 04:02:32,072 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5951.894599 2021-02-19 04:02:32,141 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:32,431 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3012.200000 2021-02-19 04:02:32,433 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:32,492 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3124.900000 2021-02-19 04:02:32,901 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6623.800000 2021-02-19 04:02:33,276 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 63.41 % 2021-02-19 04:02:33,276 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 63.4109989289 2021-02-19 04:02:33,338 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6317.400000 2021-02-19 04:02:33,346 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4183.800000 2021-02-19 04:02:33,500 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5952.500000 2021-02-19 04:02:33,700 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6077.200000 2021-02-19 04:02:33,726 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5983.500000 2021-02-19 04:02:33,786 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:34,098 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3012.200000 2021-02-19 04:02:34,121 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:34,144 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3124.900000 2021-02-19 04:02:34,532 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6623.800000 2021-02-19 04:02:34,990 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6317.400000 2021-02-19 04:02:35,000 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4183.800000 2021-02-19 04:02:35,171 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5952.500000 2021-02-19 04:02:35,375 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5983.500000 2021-02-19 04:02:35,392 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6077.200000 2021-02-19 04:02:35,444 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:35,822 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3012.200000 2021-02-19 04:02:35,823 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:35,846 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3143.738262 2021-02-19 04:02:36,167 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6568.542058 2021-02-19 04:02:36,668 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6299.321179 2021-02-19 04:02:36,668 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4145.141359 2021-02-19 04:02:36,816 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5930.965534 2021-02-19 04:02:37,059 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5989.614985 2021-02-19 04:02:37,076 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6060.992208 2021-02-19 04:02:37,084 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:37,494 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3143.738262 2021-02-19 04:02:37,500 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2950.418382 2021-02-19 04:02:37,503 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:37,779 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6568.542058 2021-02-19 04:02:38,342 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4145.141359 2021-02-19 04:02:38,348 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 64.11 % 2021-02-19 04:02:38,348 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 64.11447571 2021-02-19 04:02:38,351 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6299.321179 2021-02-19 04:02:38,484 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5930.965534 2021-02-19 04:02:38,737 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5989.614985 2021-02-19 04:02:38,747 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6060.992208 2021-02-19 04:02:38,769 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:39,148 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3143.738262 2021-02-19 04:02:39,161 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:39,210 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2950.418382 2021-02-19 04:02:39,421 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6568.542058 2021-02-19 04:02:39,986 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4145.141359 2021-02-19 04:02:40,010 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6283.021179 2021-02-19 04:02:40,147 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5930.965534 2021-02-19 04:02:40,388 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5989.614985 2021-02-19 04:02:40,401 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6060.992208 2021-02-19 04:02:40,418 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:40,821 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:40,851 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3179.638262 2021-02-19 04:02:40,910 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2950.418382 2021-02-19 04:02:41,043 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6568.542058 2021-02-19 04:02:41,619 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4145.141359 2021-02-19 04:02:41,671 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6283.021179 2021-02-19 04:02:41,782 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5930.965534 2021-02-19 04:02:42,030 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6060.992208 2021-02-19 04:02:42,061 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5989.614985 2021-02-19 04:02:42,075 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:42,457 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:42,525 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3225.138262 2021-02-19 04:02:42,586 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3009.418382 2021-02-19 04:02:42,677 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6474.042058 2021-02-19 04:02:43,253 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4074.141359 2021-02-19 04:02:43,311 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6197.321179 2021-02-19 04:02:43,415 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 64.86 % 2021-02-19 04:02:43,415 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 64.8647611039 2021-02-19 04:02:43,424 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5732.965534 2021-02-19 04:02:43,667 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5914.492208 2021-02-19 04:02:43,721 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5916.314985 2021-02-19 04:02:43,726 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:44,101 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:44,160 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3225.138262 2021-02-19 04:02:44,232 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3009.418382 2021-02-19 04:02:44,321 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6474.042058 2021-02-19 04:02:44,881 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4074.141359 2021-02-19 04:02:44,946 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6197.321179 2021-02-19 04:02:45,072 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5732.965534 2021-02-19 04:02:45,293 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5914.492208 2021-02-19 04:02:45,415 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5916.314985 2021-02-19 04:02:45,433 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:45,490 | infra | INFO | pool-2-thread-42 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' completed 2021-02-19 04:02:45,492 | infra | INFO | pool-2-thread-42 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 04:02:45,733 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:45,822 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3250.065334 2021-02-19 04:02:45,892 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3070.682847 2021-02-19 04:02:45,993 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6437.211555 2021-02-19 04:02:46,505 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4068.778689 2021-02-19 04:02:46,578 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6156.984606 2021-02-19 04:02:46,700 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5613.274090 2021-02-19 04:02:46,915 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5841.626030 2021-02-19 04:02:47,055 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5881.319992 2021-02-19 04:02:47,091 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:47,371 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:47,448 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3250.065334 2021-02-19 04:02:47,525 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3070.682847 2021-02-19 04:02:47,634 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6437.211555 2021-02-19 04:02:48,153 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4068.778689 2021-02-19 04:02:48,226 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6156.984606 2021-02-19 04:02:48,344 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5613.274090 2021-02-19 04:02:48,459 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 65.65 % 2021-02-19 04:02:48,459 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 65.6482803287 2021-02-19 04:02:48,538 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5841.626030 2021-02-19 04:02:48,694 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5881.319992 2021-02-19 04:02:48,723 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:49,015 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:49,109 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3250.065334 2021-02-19 04:02:49,157 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3070.682847 2021-02-19 04:02:49,285 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6437.211555 2021-02-19 04:02:49,786 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4068.778689 2021-02-19 04:02:49,848 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5938.884606 2021-02-19 04:02:49,963 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5613.274090 2021-02-19 04:02:50,177 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5841.626030 2021-02-19 04:02:50,328 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5881.319992 2021-02-19 04:02:50,341 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:50,665 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:50,756 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3264.165334 2021-02-19 04:02:50,825 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3070.682847 2021-02-19 04:02:50,924 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6437.211555 2021-02-19 04:02:51,450 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4068.778689 2021-02-19 04:02:51,483 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5938.884606 2021-02-19 04:02:51,601 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5613.274090 2021-02-19 04:02:51,793 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5841.626030 2021-02-19 04:02:51,973 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5881.319992 2021-02-19 04:02:51,982 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:52,319 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:52,420 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3275.465334 2021-02-19 04:02:52,483 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3094.882847 2021-02-19 04:02:52,565 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6338.111555 2021-02-19 04:02:53,072 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4113.878689 2021-02-19 04:02:53,121 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5559.984606 2021-02-19 04:02:53,230 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5835.874090 2021-02-19 04:02:53,410 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6054.526030 2021-02-19 04:02:53,512 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 66.35 % 2021-02-19 04:02:53,513 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 66.3453911529 2021-02-19 04:02:53,608 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:53,618 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6080.619992 2021-02-19 04:02:53,953 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:54,049 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3275.465334 2021-02-19 04:02:54,102 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3094.882847 2021-02-19 04:02:54,233 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6338.111555 2021-02-19 04:02:54,721 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4113.878689 2021-02-19 04:02:54,765 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5559.984606 2021-02-19 04:02:54,897 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5835.874090 2021-02-19 04:02:55,048 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6054.526030 2021-02-19 04:02:55,230 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:55,273 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6080.619992 2021-02-19 04:02:55,605 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:55,671 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3275.465334 2021-02-19 04:02:55,711 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3094.882847 2021-02-19 04:02:55,848 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6174.881033 2021-02-19 04:02:56,408 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4089.039816 2021-02-19 04:02:56,497 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4940.586721 2021-02-19 04:02:56,581 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6097.707250 2021-02-19 04:02:56,684 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6272.914640 2021-02-19 04:02:56,872 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:56,907 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6333.484038 2021-02-19 04:02:57,247 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:57,328 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3280.728700 2021-02-19 04:02:57,335 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3116.290006 2021-02-19 04:02:57,490 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6174.881033 2021-02-19 04:02:58,043 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4089.039816 2021-02-19 04:02:58,132 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4940.586721 2021-02-19 04:02:58,197 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6097.707250 2021-02-19 04:02:58,322 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6272.914640 2021-02-19 04:02:58,494 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:02:58,539 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6333.484038 2021-02-19 04:02:58,562 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 67.14 % 2021-02-19 04:02:58,563 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 67.1422034696 2021-02-19 04:02:58,872 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:02:58,963 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3280.728700 2021-02-19 04:02:58,973 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3116.290006 2021-02-19 04:02:59,131 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6174.881033 2021-02-19 04:02:59,667 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4089.039816 2021-02-19 04:02:59,785 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4940.586721 2021-02-19 04:02:59,835 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6097.707250 2021-02-19 04:02:59,947 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6272.914640 2021-02-19 04:03:00,130 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:00,174 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6333.484038 2021-02-19 04:03:00,522 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:00,621 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3116.290006 2021-02-19 04:03:00,635 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3269.328700 2021-02-19 04:03:00,766 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6174.881033 2021-02-19 04:03:01,283 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4089.039816 2021-02-19 04:03:01,411 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4310.886721 2021-02-19 04:03:01,463 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6097.707250 2021-02-19 04:03:01,572 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6272.914640 2021-02-19 04:03:01,782 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:01,815 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6333.484038 2021-02-19 04:03:02,155 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:02,266 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3116.290006 2021-02-19 04:03:02,290 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3269.328700 2021-02-19 04:03:02,404 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6109.181033 2021-02-19 04:03:02,921 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4102.339816 2021-02-19 04:03:03,042 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3871.986721 2021-02-19 04:03:03,102 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6289.207250 2021-02-19 04:03:03,211 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6400.314640 2021-02-19 04:03:03,451 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:03,486 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6535.784038 2021-02-19 04:03:03,615 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 67.82 % 2021-02-19 04:03:03,615 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 67.8192147912 2021-02-19 04:03:03,812 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:03,908 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3077.290006 2021-02-19 04:03:03,961 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3250.328700 2021-02-19 04:03:04,032 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6109.181033 2021-02-19 04:03:04,532 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4102.339816 2021-02-19 04:03:04,664 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3871.986721 2021-02-19 04:03:04,746 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6289.207250 2021-02-19 04:03:04,851 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6400.314640 2021-02-19 04:03:05,059 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:05,104 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6535.784038 2021-02-19 04:03:05,444 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:05,565 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3077.290006 2021-02-19 04:03:05,595 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3250.328700 2021-02-19 04:03:05,661 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6109.181033 2021-02-19 04:03:06,201 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4175.100000 2021-02-19 04:03:06,338 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3679.300000 2021-02-19 04:03:06,387 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6447.300000 2021-02-19 04:03:06,471 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6535.200000 2021-02-19 04:03:06,676 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:06,710 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6668.700000 2021-02-19 04:03:07,141 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:07,216 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3022.500000 2021-02-19 04:03:07,273 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3267.800000 2021-02-19 04:03:07,286 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6101.100000 2021-02-19 04:03:07,821 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4175.100000 2021-02-19 04:03:07,986 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3679.300000 2021-02-19 04:03:08,026 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6447.300000 2021-02-19 04:03:08,095 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6535.200000 2021-02-19 04:03:08,312 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:08,342 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6668.700000 2021-02-19 04:03:08,657 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 68.56 % 2021-02-19 04:03:08,657 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 68.5561266104 2021-02-19 04:03:08,799 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:08,845 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3022.500000 2021-02-19 04:03:08,901 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3267.800000 2021-02-19 04:03:08,938 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6101.100000 2021-02-19 04:03:09,467 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4175.100000 2021-02-19 04:03:09,671 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3679.300000 2021-02-19 04:03:09,688 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6447.300000 2021-02-19 04:03:09,723 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6535.200000 2021-02-19 04:03:09,956 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:10,003 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6668.700000 2021-02-19 04:03:10,461 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:10,492 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3022.500000 2021-02-19 04:03:10,528 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3294.000000 2021-02-19 04:03:10,611 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6101.100000 2021-02-19 04:03:11,085 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4175.100000 2021-02-19 04:03:11,315 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3714.800000 2021-02-19 04:03:11,341 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6447.300000 2021-02-19 04:03:11,384 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6535.200000 2021-02-19 04:03:11,575 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:11,624 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6668.700000 2021-02-19 04:03:12,091 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:12,157 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3022.500000 2021-02-19 04:03:12,188 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3294.000000 2021-02-19 04:03:12,250 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6101.100000 2021-02-19 04:03:12,707 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4180.400000 2021-02-19 04:03:12,943 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3740.200000 2021-02-19 04:03:12,980 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6456.900000 2021-02-19 04:03:13,036 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6583.800000 2021-02-19 04:03:13,193 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:13,256 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6648.000000 2021-02-19 04:03:13,707 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 69.37 % 2021-02-19 04:03:13,707 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 69.3696765669 2021-02-19 04:03:13,739 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:13,809 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3082.600000 2021-02-19 04:03:13,823 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3319.300000 2021-02-19 04:03:13,871 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6101.900000 2021-02-19 04:03:14,329 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4180.400000 2021-02-19 04:03:14,572 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3740.200000 2021-02-19 04:03:14,638 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6456.900000 2021-02-19 04:03:14,674 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6583.800000 2021-02-19 04:03:14,813 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:14,877 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6648.000000 2021-02-19 04:03:15,378 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:15,447 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3111.900000 2021-02-19 04:03:15,483 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3293.100000 2021-02-19 04:03:15,526 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6108.100000 2021-02-19 04:03:15,944 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4155.500000 2021-02-19 04:03:16,259 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3757.400000 2021-02-19 04:03:16,341 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6577.900000 2021-02-19 04:03:16,361 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6431.000000 2021-02-19 04:03:16,428 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:16,496 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6627.600000 2021-02-19 04:03:17,003 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:17,092 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3111.900000 2021-02-19 04:03:17,142 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3293.100000 2021-02-19 04:03:17,216 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6108.100000 2021-02-19 04:03:17,562 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4155.500000 2021-02-19 04:03:17,931 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3757.400000 2021-02-19 04:03:18,007 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6577.900000 2021-02-19 04:03:18,036 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6431.000000 2021-02-19 04:03:18,066 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:18,140 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6627.600000 2021-02-19 04:03:18,628 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:18,733 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3111.900000 2021-02-19 04:03:18,776 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 70.00 % 2021-02-19 04:03:18,778 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 70.0 2021-02-19 04:03:18,786 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3293.100000 2021-02-19 04:03:18,848 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6108.100000 2021-02-19 04:03:19,180 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4155.500000 2021-02-19 04:03:19,605 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3757.400000 2021-02-19 04:03:19,703 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6577.900000 2021-02-19 04:03:19,711 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:19,785 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6431.000000 2021-02-19 04:03:19,789 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6627.600000 2021-02-19 04:03:20,302 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:20,415 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3111.900000 2021-02-19 04:03:20,428 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3260.300000 2021-02-19 04:03:20,490 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6108.100000 2021-02-19 04:03:20,802 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4155.500000 2021-02-19 04:03:21,234 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3717.500000 2021-02-19 04:03:21,371 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6577.900000 2021-02-19 04:03:21,381 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:21,461 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6627.600000 2021-02-19 04:03:21,464 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6431.000000 2021-02-19 04:03:21,960 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:22,088 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3111.900000 2021-02-19 04:03:22,094 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3260.300000 2021-02-19 04:03:22,135 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6108.100000 2021-02-19 04:03:22,424 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4234.200000 2021-02-19 04:03:22,849 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3695.800000 2021-02-19 04:03:23,019 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6558.900000 2021-02-19 04:03:23,036 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:23,111 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6577.400000 2021-02-19 04:03:23,147 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6413.500000 2021-02-19 04:03:23,586 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:23,746 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3054.800000 2021-02-19 04:03:23,763 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3221.800000 2021-02-19 04:03:23,785 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6167.200000 2021-02-19 04:03:23,832 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 70.00 % 2021-02-19 04:03:23,832 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 70.0 2021-02-19 04:03:24,049 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4234.200000 2021-02-19 04:03:24,479 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3695.800000 2021-02-19 04:03:24,645 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6558.900000 2021-02-19 04:03:24,664 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:24,753 | infra | INFO | pool-2-thread-25 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 04:03:24,755 | infra | INFO | pool-2-thread-25 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 04:03:24,759 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6577.400000 2021-02-19 04:03:24,792 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6413.500000 2021-02-19 04:03:25,217 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:25,410 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3054.800000 2021-02-19 04:03:25,421 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3221.800000 2021-02-19 04:03:25,437 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6167.200000 2021-02-19 04:03:25,703 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4234.200000 2021-02-19 04:03:26,115 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3679.900000 2021-02-19 04:03:26,288 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6579.700000 2021-02-19 04:03:26,315 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:26,438 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6541.200000 2021-02-19 04:03:26,450 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6465.400000 2021-02-19 04:03:26,858 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:27,055 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3019.800000 2021-02-19 04:03:27,079 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6222.000000 2021-02-19 04:03:27,088 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3194.500000 2021-02-19 04:03:27,329 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4362.700000 2021-02-19 04:03:27,743 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3679.900000 2021-02-19 04:03:27,938 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6579.700000 2021-02-19 04:03:27,957 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:28,086 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6541.200000 2021-02-19 04:03:28,118 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6465.400000 2021-02-19 04:03:28,483 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:28,674 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3019.800000 2021-02-19 04:03:28,703 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6222.000000 2021-02-19 04:03:28,736 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3194.500000 2021-02-19 04:03:28,887 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 70.00 % 2021-02-19 04:03:28,888 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 70.0 2021-02-19 04:03:28,976 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4362.700000 2021-02-19 04:03:29,411 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3679.600000 2021-02-19 04:03:29,599 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6579.700000 2021-02-19 04:03:29,611 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:29,719 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6541.200000 2021-02-19 04:03:29,766 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6465.400000 2021-02-19 04:03:30,099 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:30,305 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3019.800000 2021-02-19 04:03:30,331 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6222.000000 2021-02-19 04:03:30,365 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3197.800000 2021-02-19 04:03:30,592 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4362.700000 2021-02-19 04:03:31,042 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3679.600000 2021-02-19 04:03:31,282 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6579.700000 2021-02-19 04:03:31,289 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:31,365 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6541.200000 2021-02-19 04:03:31,427 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6465.400000 2021-02-19 04:03:31,727 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:31,961 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3019.800000 2021-02-19 04:03:31,980 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6222.000000 2021-02-19 04:03:32,025 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3197.800000 2021-02-19 04:03:32,211 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4362.700000 2021-02-19 04:03:32,688 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3666.500000 2021-02-19 04:03:32,927 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6717.100000 2021-02-19 04:03:32,943 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:33,015 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5691.600000 2021-02-19 04:03:33,095 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6626.400000 2021-02-19 04:03:33,332 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:33,601 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3002.000000 2021-02-19 04:03:33,634 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6157.800000 2021-02-19 04:03:33,684 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3192.200000 2021-02-19 04:03:33,845 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4468.500000 2021-02-19 04:03:33,934 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 70.38 % 2021-02-19 04:03:33,934 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 70.3779990114 2021-02-19 04:03:34,338 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3666.500000 2021-02-19 04:03:34,596 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6717.100000 2021-02-19 04:03:34,601 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:34,690 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5691.600000 2021-02-19 04:03:34,766 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6626.400000 2021-02-19 04:03:34,966 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:35,259 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3002.000000 2021-02-19 04:03:35,299 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6157.800000 2021-02-19 04:03:35,318 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3192.200000 2021-02-19 04:03:35,459 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4526.700000 2021-02-19 04:03:35,994 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3666.200000 2021-02-19 04:03:36,247 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6916.300000 2021-02-19 04:03:36,247 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:36,348 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4376.800000 2021-02-19 04:03:36,391 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6774.200000 2021-02-19 04:03:36,585 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:36,880 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3041.700000 2021-02-19 04:03:36,927 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6096.200000 2021-02-19 04:03:36,980 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3236.500000 2021-02-19 04:03:37,076 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4526.700000 2021-02-19 04:03:37,631 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3666.200000 2021-02-19 04:03:37,895 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6916.300000 2021-02-19 04:03:37,903 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:37,999 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4376.800000 2021-02-19 04:03:38,036 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6774.200000 2021-02-19 04:03:38,217 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:38,532 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3041.700000 2021-02-19 04:03:38,585 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6096.200000 2021-02-19 04:03:38,657 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3236.500000 2021-02-19 04:03:38,709 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4526.700000 2021-02-19 04:03:38,994 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 70.79 % 2021-02-19 04:03:38,994 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 70.7885564577 2021-02-19 04:03:39,286 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3666.200000 2021-02-19 04:03:39,533 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6916.300000 2021-02-19 04:03:39,546 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:39,628 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4376.800000 2021-02-19 04:03:39,697 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6774.200000 2021-02-19 04:03:39,878 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:40,165 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3041.700000 2021-02-19 04:03:40,226 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6096.200000 2021-02-19 04:03:40,342 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3293.400000 2021-02-19 04:03:40,351 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4526.700000 2021-02-19 04:03:40,915 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3690.600000 2021-02-19 04:03:41,174 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:41,194 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6916.300000 2021-02-19 04:03:41,255 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4376.800000 2021-02-19 04:03:41,351 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6774.200000 2021-02-19 04:03:41,507 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:41,788 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3041.700000 2021-02-19 04:03:41,851 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6096.200000 2021-02-19 04:03:41,987 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3293.400000 2021-02-19 04:03:42,000 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4526.700000 2021-02-19 04:03:42,525 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3718.400000 2021-02-19 04:03:42,823 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:42,855 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7061.500000 2021-02-19 04:03:42,917 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3694.700000 2021-02-19 04:03:43,026 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6837.300000 2021-02-19 04:03:43,131 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:43,407 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3132.500000 2021-02-19 04:03:43,480 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6084.100000 2021-02-19 04:03:43,612 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3362.900000 2021-02-19 04:03:43,654 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4526.400000 2021-02-19 04:03:44,042 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 71.18 % 2021-02-19 04:03:44,042 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 71.1828155757 2021-02-19 04:03:44,151 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3718.400000 2021-02-19 04:03:44,467 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:44,509 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7061.500000 2021-02-19 04:03:44,561 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3694.700000 2021-02-19 04:03:44,670 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6837.300000 2021-02-19 04:03:44,759 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:45,056 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3132.500000 2021-02-19 04:03:45,112 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6084.100000 2021-02-19 04:03:45,246 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3362.900000 2021-02-19 04:03:45,272 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4526.400000 2021-02-19 04:03:45,776 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3718.400000 2021-02-19 04:03:46,109 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:46,145 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7068.600000 2021-02-19 04:03:46,200 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3446.300000 2021-02-19 04:03:46,361 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6830.900000 2021-02-19 04:03:46,430 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:46,742 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3188.600000 2021-02-19 04:03:46,753 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6041.300000 2021-02-19 04:03:46,898 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4535.000000 2021-02-19 04:03:46,908 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3379.700000 2021-02-19 04:03:47,401 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3713.400000 2021-02-19 04:03:47,746 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:47,795 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7068.600000 2021-02-19 04:03:47,849 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3446.300000 2021-02-19 04:03:48,000 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6830.900000 2021-02-19 04:03:48,072 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:48,375 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3188.600000 2021-02-19 04:03:48,456 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6041.300000 2021-02-19 04:03:48,533 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3379.700000 2021-02-19 04:03:48,566 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4535.000000 2021-02-19 04:03:49,040 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3713.400000 2021-02-19 04:03:49,099 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 71.59 % 2021-02-19 04:03:49,099 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 71.593373022 2021-02-19 04:03:49,368 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:49,428 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7068.600000 2021-02-19 04:03:49,479 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3446.300000 2021-02-19 04:03:49,661 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6830.900000 2021-02-19 04:03:49,713 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:49,776 | infra | INFO | pool-2-thread-26 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' completed 2021-02-19 04:03:49,776 | infra | INFO | pool-2-thread-26 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 04:03:50,035 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3188.600000 2021-02-19 04:03:50,069 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6041.300000 2021-02-19 04:03:50,177 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3370.700000 2021-02-19 04:03:50,190 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4535.000000 2021-02-19 04:03:50,673 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3674.100000 2021-02-19 04:03:51,000 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:03:51,066 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7068.600000 2021-02-19 04:03:51,108 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3446.300000 2021-02-19 04:03:51,315 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6830.900000 2021-02-19 04:03:51,336 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:51,654 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3188.600000 2021-02-19 04:03:51,710 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6041.300000 2021-02-19 04:03:51,878 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3370.700000 2021-02-19 04:03:51,878 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4535.000000 2021-02-19 04:03:52,357 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3645.400000 2021-02-19 04:03:52,640 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 70.600000 2021-02-19 04:03:52,678 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7031.400000 2021-02-19 04:03:52,740 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3434.300000 2021-02-19 04:03:52,960 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6795.800000 2021-02-19 04:03:53,007 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:53,278 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3171.500000 2021-02-19 04:03:53,352 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6033.900000 2021-02-19 04:03:53,535 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3332.200000 2021-02-19 04:03:53,552 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4590.000000 2021-02-19 04:03:54,000 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3645.400000 2021-02-19 04:03:54,154 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 71.98 % 2021-02-19 04:03:54,154 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 71.9811281122 2021-02-19 04:03:54,273 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 70.600000 2021-02-19 04:03:54,323 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7031.400000 2021-02-19 04:03:54,392 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3434.300000 2021-02-19 04:03:54,591 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6795.800000 2021-02-19 04:03:54,648 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:54,913 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3171.500000 2021-02-19 04:03:54,993 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6033.900000 2021-02-19 04:03:55,174 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3332.200000 2021-02-19 04:03:55,194 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4590.000000 2021-02-19 04:03:55,612 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3645.400000 2021-02-19 04:03:55,901 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 431.200000 2021-02-19 04:03:55,979 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6980.800000 2021-02-19 04:03:56,036 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3427.500000 2021-02-19 04:03:56,234 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6769.200000 2021-02-19 04:03:56,296 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:56,545 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3115.500000 2021-02-19 04:03:56,664 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6088.000000 2021-02-19 04:03:56,805 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3288.500000 2021-02-19 04:03:56,857 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4669.600000 2021-02-19 04:03:57,273 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3641.700000 2021-02-19 04:03:57,536 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 431.200000 2021-02-19 04:03:57,611 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6980.800000 2021-02-19 04:03:57,693 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3427.500000 2021-02-19 04:03:57,877 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6769.200000 2021-02-19 04:03:57,921 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:58,186 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3115.500000 2021-02-19 04:03:58,296 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6088.000000 2021-02-19 04:03:58,426 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3288.500000 2021-02-19 04:03:58,494 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4669.600000 2021-02-19 04:03:58,914 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3641.700000 2021-02-19 04:03:59,176 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 431.200000 2021-02-19 04:03:59,219 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 72.34 % 2021-02-19 04:03:59,219 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 72.3428033143 2021-02-19 04:03:59,259 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6980.800000 2021-02-19 04:03:59,319 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3427.500000 2021-02-19 04:03:59,509 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6769.200000 2021-02-19 04:03:59,575 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:03:59,828 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3115.500000 2021-02-19 04:03:59,971 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6088.000000 2021-02-19 04:04:00,111 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3281.400000 2021-02-19 04:04:00,125 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4669.600000 2021-02-19 04:04:00,565 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3632.600000 2021-02-19 04:04:00,822 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1018.400000 2021-02-19 04:04:00,891 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6980.800000 2021-02-19 04:04:00,938 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3427.500000 2021-02-19 04:04:01,164 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6769.200000 2021-02-19 04:04:01,217 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:01,453 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3115.500000 2021-02-19 04:04:01,598 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6088.000000 2021-02-19 04:04:01,732 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3281.400000 2021-02-19 04:04:01,756 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4669.600000 2021-02-19 04:04:02,209 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3632.600000 2021-02-19 04:04:02,456 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1964.300000 2021-02-19 04:04:02,529 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6828.200000 2021-02-19 04:04:02,591 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3404.700000 2021-02-19 04:04:02,813 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6766.600000 2021-02-19 04:04:02,848 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:03,082 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3112.700000 2021-02-19 04:04:03,246 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6126.400000 2021-02-19 04:04:03,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3284.500000 2021-02-19 04:04:03,394 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4611.300000 2021-02-19 04:04:03,826 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3628.500000 2021-02-19 04:04:04,098 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1964.300000 2021-02-19 04:04:04,153 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6828.200000 2021-02-19 04:04:04,229 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3404.700000 2021-02-19 04:04:04,279 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 72.76 % 2021-02-19 04:04:04,279 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 72.7566127744 2021-02-19 04:04:04,515 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6766.600000 2021-02-19 04:04:04,525 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:04,706 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3112.700000 2021-02-19 04:04:04,885 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6126.400000 2021-02-19 04:04:05,029 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3284.500000 2021-02-19 04:04:05,036 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4611.300000 2021-02-19 04:04:05,464 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3609.600000 2021-02-19 04:04:05,759 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1964.300000 2021-02-19 04:04:05,782 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6828.200000 2021-02-19 04:04:05,871 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3402.800000 2021-02-19 04:04:06,181 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6778.800000 2021-02-19 04:04:06,188 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:06,332 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3145.300000 2021-02-19 04:04:06,520 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6114.000000 2021-02-19 04:04:06,723 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4484.100000 2021-02-19 04:04:06,736 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3333.100000 2021-02-19 04:04:07,078 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3609.600000 2021-02-19 04:04:07,427 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6738.700000 2021-02-19 04:04:07,443 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2629.600000 2021-02-19 04:04:07,563 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3402.800000 2021-02-19 04:04:07,852 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:07,854 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6778.800000 2021-02-19 04:04:07,869 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 73.02 % 2021-02-19 04:04:07,869 | test | INFO | MainThread | [Magma:abort_rebalance:933] Rebalance % = 73.0205616721 2021-02-19 04:04:07,887 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 73.02 % 2021-02-19 04:04:07,901 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:04:07,901 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:04:07,970 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3145.300000 2021-02-19 04:04:08,158 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6114.000000 2021-02-19 04:04:08,361 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4484.100000 2021-02-19 04:04:08,408 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3333.100000 2021-02-19 04:04:08,720 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3609.600000 2021-02-19 04:04:09,085 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6738.700000 2021-02-19 04:04:09,108 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2629.600000 2021-02-19 04:04:09,227 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3402.800000 2021-02-19 04:04:09,332 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 73.11 % 2021-02-19 04:04:09,332 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 73.1052671431 2021-02-19 04:04:09,505 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:09,523 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6778.800000 2021-02-19 04:04:09,657 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3145.300000 2021-02-19 04:04:09,849 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6114.000000 2021-02-19 04:04:10,002 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4484.100000 2021-02-19 04:04:10,045 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3317.800000 2021-02-19 04:04:10,361 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3589.400000 2021-02-19 04:04:10,713 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6738.700000 2021-02-19 04:04:10,740 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2730.200000 2021-02-19 04:04:10,861 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3402.800000 2021-02-19 04:04:11,062 | infra | INFO | pool-2-thread-22 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' completed 2021-02-19 04:04:11,063 | infra | INFO | pool-2-thread-22 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' started 2021-02-19 04:04:11,122 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:11,154 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6778.800000 2021-02-19 04:04:11,309 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3145.300000 2021-02-19 04:04:11,584 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6114.000000 2021-02-19 04:04:11,690 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3317.800000 2021-02-19 04:04:11,743 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4484.100000 2021-02-19 04:04:11,970 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3589.400000 2021-02-19 04:04:12,365 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6626.800000 2021-02-19 04:04:12,394 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2745.600000 2021-02-19 04:04:12,473 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3354.400000 2021-02-19 04:04:12,763 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:12,792 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6709.200000 2021-02-19 04:04:12,924 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3127.800000 2021-02-19 04:04:13,233 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6024.000000 2021-02-19 04:04:13,326 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3300.900000 2021-02-19 04:04:13,368 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4487.900000 2021-02-19 04:04:13,598 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3550.800000 2021-02-19 04:04:13,796 | infra | INFO | pool-2-thread-44 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' completed 2021-02-19 04:04:13,796 | infra | INFO | pool-2-thread-44 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:04:13,992 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6626.800000 2021-02-19 04:04:14,017 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2745.600000 2021-02-19 04:04:14,085 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3354.400000 2021-02-19 04:04:14,381 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 73.50 % 2021-02-19 04:04:14,381 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 73.4995390016 2021-02-19 04:04:14,444 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6709.200000 2021-02-19 04:04:14,457 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:14,552 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3127.800000 2021-02-19 04:04:14,861 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6024.000000 2021-02-19 04:04:14,947 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3300.900000 2021-02-19 04:04:14,993 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4487.900000 2021-02-19 04:04:15,233 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3550.800000 2021-02-19 04:04:15,612 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6626.800000 2021-02-19 04:04:15,686 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2745.600000 2021-02-19 04:04:15,717 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3354.400000 2021-02-19 04:04:16,085 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6333.800000 2021-02-19 04:04:16,104 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:16,174 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3142.700000 2021-02-19 04:04:16,538 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5992.100000 2021-02-19 04:04:16,625 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4512.600000 2021-02-19 04:04:16,631 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3259.000000 2021-02-19 04:04:16,861 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3535.100000 2021-02-19 04:04:17,237 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6594.400000 2021-02-19 04:04:17,325 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2799.400000 2021-02-19 04:04:17,361 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3301.000000 2021-02-19 04:04:17,714 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6333.800000 2021-02-19 04:04:17,785 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:17,861 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3142.700000 2021-02-19 04:04:17,917 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 73.78 % 2021-02-19 04:04:17,936 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:04:17,936 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:04:18,177 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5992.100000 2021-02-19 04:04:18,242 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4512.600000 2021-02-19 04:04:18,266 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3259.000000 2021-02-19 04:04:18,493 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3535.100000 2021-02-19 04:04:18,911 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6594.400000 2021-02-19 04:04:18,973 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2799.400000 2021-02-19 04:04:19,028 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3301.000000 2021-02-19 04:04:19,357 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6333.800000 2021-02-19 04:04:19,408 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:19,424 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 73.90 % 2021-02-19 04:04:19,424 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 73.8971010957 2021-02-19 04:04:19,510 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3142.700000 2021-02-19 04:04:19,799 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5992.100000 2021-02-19 04:04:19,861 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4512.600000 2021-02-19 04:04:19,897 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3264.800000 2021-02-19 04:04:20,128 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3589.000000 2021-02-19 04:04:20,572 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6594.400000 2021-02-19 04:04:20,622 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2787.200000 2021-02-19 04:04:20,698 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3301.000000 2021-02-19 04:04:21,009 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6333.800000 2021-02-19 04:04:21,058 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:21,144 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3142.700000 2021-02-19 04:04:21,446 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5992.100000 2021-02-19 04:04:21,500 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4512.600000 2021-02-19 04:04:21,539 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3264.800000 2021-02-19 04:04:21,769 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3589.000000 2021-02-19 04:04:22,226 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6594.400000 2021-02-19 04:04:22,276 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2787.200000 2021-02-19 04:04:22,332 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4549.100000 2021-02-19 04:04:22,673 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:22,704 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3757.400000 2021-02-19 04:04:22,811 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3174.400000 2021-02-19 04:04:23,098 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6173.600000 2021-02-19 04:04:23,128 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4563.600000 2021-02-19 04:04:23,184 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3322.300000 2021-02-19 04:04:23,394 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3670.400000 2021-02-19 04:04:23,848 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6940.300000 2021-02-19 04:04:23,903 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2924.500000 2021-02-19 04:04:23,948 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4549.100000 2021-02-19 04:04:24,364 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:24,390 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3757.400000 2021-02-19 04:04:24,451 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3174.400000 2021-02-19 04:04:24,489 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 74.29 % 2021-02-19 04:04:24,489 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 74.2913602137 2021-02-19 04:04:24,746 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6173.600000 2021-02-19 04:04:24,763 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4563.600000 2021-02-19 04:04:24,825 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3322.300000 2021-02-19 04:04:25,039 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3670.400000 2021-02-19 04:04:25,532 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7219.099591 2021-02-19 04:04:25,568 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2990.410706 2021-02-19 04:04:25,594 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6258.128193 2021-02-19 04:04:26,003 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:26,049 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 848.166014 2021-02-19 04:04:26,115 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3136.980216 2021-02-19 04:04:26,382 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6307.804474 2021-02-19 04:04:26,440 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4651.762079 2021-02-19 04:04:26,519 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3383.116938 2021-02-19 04:04:26,683 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3719.796455 2021-02-19 04:04:27,163 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7219.099591 2021-02-19 04:04:27,217 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2990.410706 2021-02-19 04:04:27,243 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6258.128193 2021-02-19 04:04:27,617 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:27,720 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 848.166014 2021-02-19 04:04:27,766 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3136.980216 2021-02-19 04:04:27,953 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 74.57 % 2021-02-19 04:04:27,973 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:04:27,974 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:04:28,016 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6307.804474 2021-02-19 04:04:28,108 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4651.762079 2021-02-19 04:04:28,164 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3383.116938 2021-02-19 04:04:28,292 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3719.796455 2021-02-19 04:04:28,785 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7219.099591 2021-02-19 04:04:28,865 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2990.410706 2021-02-19 04:04:28,901 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6258.128193 2021-02-19 04:04:29,236 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:29,351 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 848.166014 2021-02-19 04:04:29,384 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3136.980216 2021-02-19 04:04:29,529 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 74.73 % 2021-02-19 04:04:29,530 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 74.7312368216 2021-02-19 04:04:29,634 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6307.804474 2021-02-19 04:04:29,733 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4651.762079 2021-02-19 04:04:29,776 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3383.116938 2021-02-19 04:04:29,908 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3687.696455 2021-02-19 04:04:30,411 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7219.099591 2021-02-19 04:04:30,529 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2856.610706 2021-02-19 04:04:30,540 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6258.128193 2021-02-19 04:04:30,905 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:30,963 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 848.166014 2021-02-19 04:04:31,010 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3136.980216 2021-02-19 04:04:31,325 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6307.804474 2021-02-19 04:04:31,395 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4651.762079 2021-02-19 04:04:31,464 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3389.916938 2021-02-19 04:04:31,542 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3687.696455 2021-02-19 04:04:32,062 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7219.099591 2021-02-19 04:04:32,165 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2856.610706 2021-02-19 04:04:32,177 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6258.128193 2021-02-19 04:04:32,565 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:32,615 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 103.066014 2021-02-19 04:04:32,681 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3188.380216 2021-02-19 04:04:32,977 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6260.004474 2021-02-19 04:04:33,032 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4681.362079 2021-02-19 04:04:33,111 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3343.716938 2021-02-19 04:04:33,207 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3642.696455 2021-02-19 04:04:33,687 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7170.799591 2021-02-19 04:04:33,805 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2744.210706 2021-02-19 04:04:33,819 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6710.928193 2021-02-19 04:04:34,226 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:34,282 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 103.066014 2021-02-19 04:04:34,326 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3188.380216 2021-02-19 04:04:34,589 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 75.17 % 2021-02-19 04:04:34,589 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 75.1711389105 2021-02-19 04:04:34,604 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6260.004474 2021-02-19 04:04:34,677 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4681.362079 2021-02-19 04:04:34,759 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3343.716938 2021-02-19 04:04:34,855 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3642.696455 2021-02-19 04:04:35,312 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7170.799591 2021-02-19 04:04:35,440 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2744.210706 2021-02-19 04:04:35,460 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6666.914589 2021-02-19 04:04:35,855 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:35,933 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:04:35,963 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3283.743757 2021-02-19 04:04:36,246 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6196.312727 2021-02-19 04:04:36,315 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4676.131120 2021-02-19 04:04:36,388 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3322.755813 2021-02-19 04:04:36,487 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3614.566977 2021-02-19 04:04:36,987 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7037.827546 2021-02-19 04:04:37,068 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2649.966777 2021-02-19 04:04:37,085 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6666.914589 2021-02-19 04:04:37,477 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:37,562 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:04:37,607 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3283.743757 2021-02-19 04:04:37,881 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6196.312727 2021-02-19 04:04:37,936 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4676.131120 2021-02-19 04:04:38,010 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 75.46 % 2021-02-19 04:04:38,026 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:04:38,026 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:04:38,040 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3322.755813 2021-02-19 04:04:38,140 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3614.566977 2021-02-19 04:04:38,625 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7037.827546 2021-02-19 04:04:38,703 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2649.966777 2021-02-19 04:04:38,723 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6666.914589 2021-02-19 04:04:39,102 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:39,190 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:04:39,226 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3283.743757 2021-02-19 04:04:39,562 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6196.312727 2021-02-19 04:04:39,611 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4676.131120 2021-02-19 04:04:39,651 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 75.59 % 2021-02-19 04:04:39,651 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 75.5947044496 2021-02-19 04:04:39,687 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3322.755813 2021-02-19 04:04:39,782 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3614.566977 2021-02-19 04:04:40,246 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7037.827546 2021-02-19 04:04:40,358 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2539.766777 2021-02-19 04:04:40,362 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6666.914589 2021-02-19 04:04:40,716 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:40,812 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:04:40,841 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3283.743757 2021-02-19 04:04:41,190 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6196.312727 2021-02-19 04:04:41,236 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4676.131120 2021-02-19 04:04:41,338 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3370.755813 2021-02-19 04:04:41,418 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3620.666977 2021-02-19 04:04:41,885 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7037.827546 2021-02-19 04:04:41,992 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2539.766777 2021-02-19 04:04:42,007 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6666.914589 2021-02-19 04:04:42,329 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:42,443 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:04:42,473 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3277.343757 2021-02-19 04:04:42,828 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6104.912727 2021-02-19 04:04:42,859 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4574.831120 2021-02-19 04:04:42,957 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3436.655813 2021-02-19 04:04:43,039 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3603.466977 2021-02-19 04:04:43,523 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6949.627546 2021-02-19 04:04:43,631 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6591.514589 2021-02-19 04:04:43,647 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2511.766777 2021-02-19 04:04:43,940 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:44,062 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:04:44,088 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3277.343757 2021-02-19 04:04:44,486 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4574.831120 2021-02-19 04:04:44,486 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6104.912727 2021-02-19 04:04:44,592 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3436.655813 2021-02-19 04:04:44,677 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3603.466977 2021-02-19 04:04:44,697 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 75.98 % 2021-02-19 04:04:44,697 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 75.982485021 2021-02-19 04:04:45,184 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6949.627546 2021-02-19 04:04:45,272 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6591.514589 2021-02-19 04:04:45,296 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2511.766777 2021-02-19 04:04:45,581 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:45,696 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:04:45,737 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3277.343757 2021-02-19 04:04:46,115 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6089.300000 2021-02-19 04:04:46,128 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4500.800000 2021-02-19 04:04:46,233 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3435.700000 2021-02-19 04:04:46,321 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3611.800000 2021-02-19 04:04:46,846 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7059.400000 2021-02-19 04:04:46,911 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6619.800000 2021-02-19 04:04:46,921 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2562.900000 2021-02-19 04:04:47,226 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:47,348 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:04:47,367 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3275.200000 2021-02-19 04:04:47,772 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6089.300000 2021-02-19 04:04:47,782 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4500.800000 2021-02-19 04:04:47,882 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3435.700000 2021-02-19 04:04:47,992 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3611.800000 2021-02-19 04:04:48,039 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 76.28 % 2021-02-19 04:04:48,052 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:04:48,052 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:04:48,476 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7059.400000 2021-02-19 04:04:48,588 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6619.800000 2021-02-19 04:04:48,594 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2562.900000 2021-02-19 04:04:48,868 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:49,006 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:04:49,036 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3275.200000 2021-02-19 04:04:49,407 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6089.300000 2021-02-19 04:04:49,420 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4500.800000 2021-02-19 04:04:49,517 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3399.852179 2021-02-19 04:04:49,608 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3651.501359 2021-02-19 04:04:49,737 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 76.44 % 2021-02-19 04:04:49,739 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 76.4386472166 2021-02-19 04:04:50,111 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7059.400000 2021-02-19 04:04:50,226 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6619.800000 2021-02-19 04:04:50,237 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2530.440344 2021-02-19 04:04:50,496 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:50,671 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:04:50,677 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3275.200000 2021-02-19 04:04:51,075 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6089.300000 2021-02-19 04:04:51,094 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4500.800000 2021-02-19 04:04:51,167 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3399.852179 2021-02-19 04:04:51,244 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3651.501359 2021-02-19 04:04:51,765 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7059.400000 2021-02-19 04:04:51,849 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6619.800000 2021-02-19 04:04:51,864 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2530.440344 2021-02-19 04:04:52,107 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:52,313 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:04:52,319 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3274.700000 2021-02-19 04:04:52,724 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6256.500000 2021-02-19 04:04:52,743 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4615.300000 2021-02-19 04:04:52,802 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3357.552179 2021-02-19 04:04:52,905 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3738.201359 2021-02-19 04:04:53,398 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7282.200000 2021-02-19 04:04:53,490 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6871.600000 2021-02-19 04:04:53,523 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2712.440344 2021-02-19 04:04:53,720 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:54,003 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:04:54,016 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3274.700000 2021-02-19 04:04:54,358 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6256.500000 2021-02-19 04:04:54,361 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4615.300000 2021-02-19 04:04:54,493 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3357.552179 2021-02-19 04:04:54,598 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3738.201359 2021-02-19 04:04:54,788 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 76.87 % 2021-02-19 04:04:54,789 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 76.8654902507 2021-02-19 04:04:55,076 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7282.200000 2021-02-19 04:04:55,114 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6871.600000 2021-02-19 04:04:55,207 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2712.440344 2021-02-19 04:04:55,349 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:55,627 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:04:55,644 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3231.200000 2021-02-19 04:04:55,967 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6334.300000 2021-02-19 04:04:55,987 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4729.500000 2021-02-19 04:04:56,118 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3373.552179 2021-02-19 04:04:56,243 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3782.201359 2021-02-19 04:04:56,736 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7319.900000 2021-02-19 04:04:56,790 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6997.100000 2021-02-19 04:04:56,821 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2784.140344 2021-02-19 04:04:56,951 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:57,326 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3231.200000 2021-02-19 04:04:57,332 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:04:57,628 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6334.300000 2021-02-19 04:04:57,661 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4729.500000 2021-02-19 04:04:57,740 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3373.552179 2021-02-19 04:04:57,885 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3782.201359 2021-02-19 04:04:58,072 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 77.16 % 2021-02-19 04:04:58,085 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:04:58,088 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:04:58,354 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7319.900000 2021-02-19 04:04:58,421 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6997.100000 2021-02-19 04:04:58,474 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2784.140344 2021-02-19 04:04:58,568 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:04:58,954 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3231.200000 2021-02-19 04:04:58,970 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:04:59,276 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6334.300000 2021-02-19 04:04:59,308 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4729.500000 2021-02-19 04:04:59,380 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3373.552179 2021-02-19 04:04:59,539 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3788.620469 2021-02-19 04:04:59,825 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 77.33 % 2021-02-19 04:04:59,825 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 77.3347115012 2021-02-19 04:04:59,980 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7319.900000 2021-02-19 04:05:00,039 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6997.100000 2021-02-19 04:05:00,111 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2692.039441 2021-02-19 04:05:00,216 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:00,611 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3231.200000 2021-02-19 04:05:00,614 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:00,921 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6334.300000 2021-02-19 04:05:00,944 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4729.500000 2021-02-19 04:05:01,015 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3397.384923 2021-02-19 04:05:01,174 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3788.620469 2021-02-19 04:05:01,625 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7319.900000 2021-02-19 04:05:01,667 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6997.100000 2021-02-19 04:05:01,765 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2692.039441 2021-02-19 04:05:01,869 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:02,246 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:02,252 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3231.200000 2021-02-19 04:05:02,539 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6291.300000 2021-02-19 04:05:02,598 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4750.400000 2021-02-19 04:05:02,663 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3400.584923 2021-02-19 04:05:02,812 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3766.720469 2021-02-19 04:05:03,252 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7252.000000 2021-02-19 04:05:03,319 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6859.000000 2021-02-19 04:05:03,420 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2619.039441 2021-02-19 04:05:03,515 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:03,875 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3218.400000 2021-02-19 04:05:03,894 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:04,206 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6291.300000 2021-02-19 04:05:04,266 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4750.400000 2021-02-19 04:05:04,292 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3400.584923 2021-02-19 04:05:04,447 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3766.720469 2021-02-19 04:05:04,884 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 77.76 % 2021-02-19 04:05:04,887 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 77.7550887292 2021-02-19 04:05:04,891 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7252.000000 2021-02-19 04:05:04,964 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6859.000000 2021-02-19 04:05:05,076 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2619.039441 2021-02-19 04:05:05,131 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:05,510 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3240.800000 2021-02-19 04:05:05,529 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:05,842 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6291.300000 2021-02-19 04:05:05,892 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4750.400000 2021-02-19 04:05:05,926 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3387.884923 2021-02-19 04:05:06,092 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3740.920469 2021-02-19 04:05:06,546 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7223.500000 2021-02-19 04:05:06,607 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6763.200000 2021-02-19 04:05:06,737 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2605.339441 2021-02-19 04:05:06,766 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:07,148 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3240.800000 2021-02-19 04:05:07,161 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:07,490 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6290.100000 2021-02-19 04:05:07,562 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4735.500000 2021-02-19 04:05:07,576 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3387.884923 2021-02-19 04:05:07,713 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3740.920469 2021-02-19 04:05:08,125 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 78.03 % 2021-02-19 04:05:08,144 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:05:08,144 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:05:08,177 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7223.500000 2021-02-19 04:05:08,219 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6763.200000 2021-02-19 04:05:08,423 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2605.339441 2021-02-19 04:05:08,424 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:08,772 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3240.800000 2021-02-19 04:05:08,783 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:09,118 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6290.100000 2021-02-19 04:05:09,201 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4735.500000 2021-02-19 04:05:09,213 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3387.884923 2021-02-19 04:05:09,359 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3740.920469 2021-02-19 04:05:09,851 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7223.500000 2021-02-19 04:05:09,865 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6763.200000 2021-02-19 04:05:09,934 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 78.16 % 2021-02-19 04:05:09,934 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 78.1624196427 2021-02-19 04:05:10,042 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2531.543162 2021-02-19 04:05:10,059 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:10,403 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3240.800000 2021-02-19 04:05:10,420 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:10,740 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6290.100000 2021-02-19 04:05:10,839 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4735.500000 2021-02-19 04:05:10,861 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3359.217964 2021-02-19 04:05:11,007 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3730.561056 2021-02-19 04:05:11,321 | infra | INFO | pool-2-thread-23 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' completed 2021-02-19 04:05:11,322 | infra | INFO | pool-2-thread-23 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:05:11,461 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7223.500000 2021-02-19 04:05:11,479 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6763.200000 2021-02-19 04:05:11,677 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2531.543162 2021-02-19 04:05:11,700 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:12,017 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3240.800000 2021-02-19 04:05:12,045 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:12,361 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6316.200000 2021-02-19 04:05:12,486 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4674.600000 2021-02-19 04:05:12,519 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3374.717964 2021-02-19 04:05:12,645 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3749.261056 2021-02-19 04:05:13,095 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7267.600000 2021-02-19 04:05:13,114 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6818.100000 2021-02-19 04:05:13,318 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2606.943162 2021-02-19 04:05:13,348 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:13,651 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3274.900000 2021-02-19 04:05:13,687 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:13,996 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6316.200000 2021-02-19 04:05:14,124 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4674.600000 2021-02-19 04:05:14,154 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3374.717964 2021-02-19 04:05:14,260 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3749.261056 2021-02-19 04:05:14,744 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7267.600000 2021-02-19 04:05:14,756 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6818.100000 2021-02-19 04:05:14,956 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2606.943162 2021-02-19 04:05:14,964 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:14,980 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 78.60 % 2021-02-19 04:05:14,980 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 78.6022962506 2021-02-19 04:05:15,270 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3274.900000 2021-02-19 04:05:15,299 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:15,604 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6410.000000 2021-02-19 04:05:15,740 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4674.600000 2021-02-19 04:05:15,786 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3374.717964 2021-02-19 04:05:15,874 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3749.261056 2021-02-19 04:05:16,403 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7318.800000 2021-02-19 04:05:16,415 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6634.500000 2021-02-19 04:05:16,582 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:16,607 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2731.743162 2021-02-19 04:05:16,901 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3282.600000 2021-02-19 04:05:16,918 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:17,257 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6410.000000 2021-02-19 04:05:17,365 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4654.600000 2021-02-19 04:05:17,411 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3388.817964 2021-02-19 04:05:17,486 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3841.261056 2021-02-19 04:05:18,026 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7318.800000 2021-02-19 04:05:18,036 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6634.500000 2021-02-19 04:05:18,157 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 78.87 % 2021-02-19 04:05:18,174 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:05:18,174 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:05:18,217 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:18,240 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2731.743162 2021-02-19 04:05:18,538 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3282.600000 2021-02-19 04:05:18,558 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:18,868 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6410.000000 2021-02-19 04:05:18,980 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4654.600000 2021-02-19 04:05:19,039 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3388.817964 2021-02-19 04:05:19,131 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3841.261056 2021-02-19 04:05:19,668 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7318.800000 2021-02-19 04:05:19,683 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6634.500000 2021-02-19 04:05:19,851 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:19,875 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2731.743162 2021-02-19 04:05:20,032 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 79.04 % 2021-02-19 04:05:20,032 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 79.0421983395 2021-02-19 04:05:20,226 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3282.600000 2021-02-19 04:05:20,234 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:20,493 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6410.000000 2021-02-19 04:05:20,611 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4654.600000 2021-02-19 04:05:20,693 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3425.100000 2021-02-19 04:05:20,773 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3965.400000 2021-02-19 04:05:21,305 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7318.800000 2021-02-19 04:05:21,334 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6634.500000 2021-02-19 04:05:21,509 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:21,532 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2672.800000 2021-02-19 04:05:21,888 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:21,895 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3282.600000 2021-02-19 04:05:22,115 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6410.000000 2021-02-19 04:05:22,257 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4654.600000 2021-02-19 04:05:22,336 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3478.200000 2021-02-19 04:05:22,400 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4039.200000 2021-02-19 04:05:22,938 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6950.000000 2021-02-19 04:05:22,950 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5217.900000 2021-02-19 04:05:23,137 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:23,184 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2805.600000 2021-02-19 04:05:23,532 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:23,558 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3274.300000 2021-02-19 04:05:23,747 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6574.200000 2021-02-19 04:05:23,880 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4734.700000 2021-02-19 04:05:23,984 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3478.200000 2021-02-19 04:05:24,043 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4039.200000 2021-02-19 04:05:24,579 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6950.000000 2021-02-19 04:05:24,582 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5217.900000 2021-02-19 04:05:24,769 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:24,825 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2805.600000 2021-02-19 04:05:25,079 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 79.44 % 2021-02-19 04:05:25,081 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 79.4429487447 2021-02-19 04:05:25,198 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:25,232 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3274.300000 2021-02-19 04:05:25,374 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6574.200000 2021-02-19 04:05:25,507 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4762.900000 2021-02-19 04:05:25,625 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3511.900000 2021-02-19 04:05:25,658 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4048.200000 2021-02-19 04:05:26,210 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3855.700000 2021-02-19 04:05:26,221 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6510.000000 2021-02-19 04:05:26,381 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:26,457 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2901.400000 2021-02-19 04:05:26,803 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:26,871 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3309.100000 2021-02-19 04:05:27,043 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6670.000000 2021-02-19 04:05:27,167 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4762.900000 2021-02-19 04:05:27,283 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3511.900000 2021-02-19 04:05:27,299 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4048.200000 2021-02-19 04:05:27,854 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3855.700000 2021-02-19 04:05:27,858 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6510.000000 2021-02-19 04:05:28,015 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:28,075 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2901.400000 2021-02-19 04:05:28,190 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 79.74 % 2021-02-19 04:05:28,207 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:05:28,207 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:05:28,411 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:28,506 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3309.100000 2021-02-19 04:05:28,729 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6670.000000 2021-02-19 04:05:28,842 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4762.900000 2021-02-19 04:05:28,953 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3511.900000 2021-02-19 04:05:28,970 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4048.200000 2021-02-19 04:05:29,484 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3855.700000 2021-02-19 04:05:29,507 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6510.000000 2021-02-19 04:05:29,635 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:29,703 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2901.400000 2021-02-19 04:05:30,029 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:30,131 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3309.100000 2021-02-19 04:05:30,134 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 79.89 % 2021-02-19 04:05:30,134 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 79.8860008859 2021-02-19 04:05:30,339 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6670.000000 2021-02-19 04:05:30,493 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4762.900000 2021-02-19 04:05:30,608 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3492.600000 2021-02-19 04:05:30,627 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3983.900000 2021-02-19 04:05:31,105 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3855.700000 2021-02-19 04:05:31,127 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6510.000000 2021-02-19 04:05:31,236 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:31,316 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2823.300000 2021-02-19 04:05:31,677 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:31,786 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3309.100000 2021-02-19 04:05:31,982 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6670.000000 2021-02-19 04:05:32,114 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4762.900000 2021-02-19 04:05:32,227 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3492.600000 2021-02-19 04:05:32,256 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3983.900000 2021-02-19 04:05:32,739 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3654.200000 2021-02-19 04:05:32,759 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6399.100000 2021-02-19 04:05:32,852 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:32,933 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2922.500000 2021-02-19 04:05:33,296 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:33,401 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3315.000000 2021-02-19 04:05:33,592 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6683.300000 2021-02-19 04:05:33,730 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4798.200000 2021-02-19 04:05:33,872 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3437.400000 2021-02-19 04:05:33,895 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3965.100000 2021-02-19 04:05:34,364 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3654.200000 2021-02-19 04:05:34,367 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6399.100000 2021-02-19 04:05:34,480 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:34,578 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2922.500000 2021-02-19 04:05:34,917 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:35,019 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3315.000000 2021-02-19 04:05:35,187 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.00 % 2021-02-19 04:05:35,187 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 80.0 2021-02-19 04:05:35,197 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6683.300000 2021-02-19 04:05:35,345 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4798.200000 2021-02-19 04:05:35,548 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3420.961794 2021-02-19 04:05:35,576 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3989.678270 2021-02-19 04:05:36,009 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3688.021571 2021-02-19 04:05:36,016 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6392.614227 2021-02-19 04:05:36,109 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:36,211 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3150.252033 2021-02-19 04:05:36,516 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:36,638 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3280.929194 2021-02-19 04:05:36,835 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6711.371166 2021-02-19 04:05:36,990 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4902.377650 2021-02-19 04:05:37,200 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3420.961794 2021-02-19 04:05:37,216 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3989.678270 2021-02-19 04:05:37,667 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6392.614227 2021-02-19 04:05:37,674 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3688.021571 2021-02-19 04:05:37,736 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:37,881 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3150.252033 2021-02-19 04:05:38,138 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:38,223 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.00 % 2021-02-19 04:05:38,255 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:05:38,256 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:05:38,282 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3280.929194 2021-02-19 04:05:38,552 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6711.371166 2021-02-19 04:05:38,700 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4902.377650 2021-02-19 04:05:38,844 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3420.961794 2021-02-19 04:05:38,851 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3989.678270 2021-02-19 04:05:39,312 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6392.614227 2021-02-19 04:05:39,352 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3688.021571 2021-02-19 04:05:39,444 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:39,506 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3065.146486 2021-02-19 04:05:39,766 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:39,887 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3280.929194 2021-02-19 04:05:40,154 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6711.371166 2021-02-19 04:05:40,230 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.00 % 2021-02-19 04:05:40,230 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 80.0 2021-02-19 04:05:40,312 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4902.377650 2021-02-19 04:05:40,470 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3469.671589 2021-02-19 04:05:40,480 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4071.985866 2021-02-19 04:05:40,941 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6392.614227 2021-02-19 04:05:40,973 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3688.021571 2021-02-19 04:05:41,061 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:41,125 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3065.146486 2021-02-19 04:05:41,392 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:41,519 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3280.929194 2021-02-19 04:05:41,776 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6711.371166 2021-02-19 04:05:41,936 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4902.377650 2021-02-19 04:05:42,130 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4071.985866 2021-02-19 04:05:42,130 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3469.671589 2021-02-19 04:05:42,555 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6394.114227 2021-02-19 04:05:42,586 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3779.921571 2021-02-19 04:05:42,716 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:42,803 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3542.352033 2021-02-19 04:05:43,029 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:43,164 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3282.529194 2021-02-19 04:05:43,395 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6648.971166 2021-02-19 04:05:43,555 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4855.977650 2021-02-19 04:05:43,806 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4132.185866 2021-02-19 04:05:43,821 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3515.871589 2021-02-19 04:05:44,207 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6394.114227 2021-02-19 04:05:44,232 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3779.921571 2021-02-19 04:05:44,328 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:44,430 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3542.352033 2021-02-19 04:05:44,653 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:44,776 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3282.529194 2021-02-19 04:05:45,022 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6648.971166 2021-02-19 04:05:45,167 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4855.977650 2021-02-19 04:05:45,269 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.20 % 2021-02-19 04:05:45,270 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 80.1987555846 2021-02-19 04:05:45,460 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4052.457571 2021-02-19 04:05:45,476 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3514.746989 2021-02-19 04:05:45,851 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3779.921571 2021-02-19 04:05:45,855 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6394.114227 2021-02-19 04:05:45,951 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:46,058 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3788.069112 2021-02-19 04:05:46,296 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:46,450 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3303.990121 2021-02-19 04:05:46,635 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6500.695386 2021-02-19 04:05:46,783 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4729.908888 2021-02-19 04:05:47,099 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4052.457571 2021-02-19 04:05:47,102 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3514.746989 2021-02-19 04:05:47,525 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6334.231879 2021-02-19 04:05:47,543 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3827.020819 2021-02-19 04:05:47,585 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:47,697 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3788.069112 2021-02-19 04:05:47,904 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:48,068 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3303.990121 2021-02-19 04:05:48,256 | test | INFO | MainThread | [rest_client:rebalance_reached:108] Rebalance reached >80.0% in 100.386000156 seconds 2021-02-19 04:05:48,272 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6500.695386 2021-02-19 04:05:48,273 | test | DEBUG | MainThread | [rest_client:diag_eval:1363] /diag/eval status on 172.23.110.64:8091: 1 content: true command: ns_orchestrator:needs_rebalance() 2021-02-19 04:05:48,275 | test | INFO | MainThread | [Magma:abort_rebalance:912] Abort rebalance 2021-02-19 04:05:48,413 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4729.908888 2021-02-19 04:05:48,713 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4052.457571 2021-02-19 04:05:48,726 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3514.746989 2021-02-19 04:05:48,733 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L914 2021-02-19 04:05:48,733 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 60 seconds. Reason: Sleep after error introduction 2021-02-19 04:05:49,165 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6334.231879 2021-02-19 04:05:49,184 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:49,200 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3827.020819 2021-02-19 04:05:49,293 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3788.069112 2021-02-19 04:05:49,490 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:49,650 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3303.990121 2021-02-19 04:05:49,861 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6500.695386 2021-02-19 04:05:50,002 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4729.908888 2021-02-19 04:05:50,313 | test | DEBUG | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.44 % 2021-02-19 04:05:50,313 | test | INFO | pool-1-thread-27 | [task:check:330] Rebalance - status: running, progress: 80.4398893858 2021-02-19 04:05:50,315 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3711.271786 2021-02-19 04:05:50,331 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3494.317183 2021-02-19 04:05:50,763 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6334.231879 2021-02-19 04:05:50,775 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:50,802 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3827.020819 2021-02-19 04:05:50,895 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3788.069112 2021-02-19 04:05:51,161 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:51,240 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3303.990121 2021-02-19 04:05:51,469 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6500.695386 2021-02-19 04:05:51,632 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4729.908888 2021-02-19 04:05:51,947 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3711.271786 2021-02-19 04:05:51,983 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3494.317183 2021-02-19 04:05:52,381 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3146.531879 2021-02-19 04:05:52,427 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:52,513 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1912.020819 2021-02-19 04:05:52,552 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1854.569112 2021-02-19 04:05:52,786 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:52,868 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1655.690121 2021-02-19 04:05:53,079 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3217.095386 2021-02-19 04:05:53,223 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2343.208888 2021-02-19 04:05:53,555 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2321.371786 2021-02-19 04:05:53,592 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2312.417183 2021-02-19 04:05:53,970 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3146.531879 2021-02-19 04:05:54,017 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:54,111 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1912.020819 2021-02-19 04:05:54,148 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1854.569112 2021-02-19 04:05:54,378 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:54,470 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1655.690121 2021-02-19 04:05:54,668 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3217.095386 2021-02-19 04:05:54,802 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2343.208888 2021-02-19 04:05:55,154 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2321.371786 2021-02-19 04:05:55,191 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2312.417183 2021-02-19 04:05:55,351 | test | ERROR | pool-1-thread-27 | [rest_client:_rebalance_status_and_progress:1494] {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 04:05:55,378 | test | INFO | pool-1-thread-27 | [rest_client:print_UI_logs:2599] Latest logs from UI on 172.23.110.64: 2021-02-19 04:05:55,378 | test | ERROR | pool-1-thread-27 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_orchestrator', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613736349671L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:05:49.671Z', u'text': u'Rebalance exited with reason {mover_crashed,\n {unexpected_exit,\n {\'EXIT\',<0.17433.41>,\n {{{badmatch,{error,closed}},\n [{mc_client_binary,cmd_vocal_recv,5,\n [{file,"src/mc_client_binary.erl"},\n {line,158}]},\n {mc_client_binary,select_bucket,2,\n [{file,"src/mc_client_binary.erl"},\n {line,350}]},\n {ns_memcached_sockets_pool,take_socket,2,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,46}]},\n {ns_memcached_sockets_pool,\n \'-executing_on_socket/3-fun-0-\',3,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,88}]},\n {async,\'-async_init/4-fun-1-\',3,\n [{file,"src/async.erl"},{line,197}]}]},\n {gen_server,call,\n [{\'janitor_agent-GleamBookUsers8\',\n \'ns_1@172.23.110.64\'},\n {if_rebalance,<0.13742.41>,\n {wait_dcp_data_move,\n [\'ns_1@172.23.110.65\'],\n 843}},\n infinity]}}}}}.\nRebalance Operation Id = 81e137ec5aaa289cb27eca4558839b9d'} 2021-02-19 04:05:55,378 | test | ERROR | pool-1-thread-27 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_log', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613736349638L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:05:49.638Z', u'text': u"Service 'memcached' exited with status 137. Restarting. Messages:\nWARNING: Logging before InitGoogleLogging() is written to STDERR\nW0219 04:01:06.022506 41002 HazptrDomain.h:671] Using the default inline executor for asynchronous reclamation may be susceptible to deadlock if the current thread happens to hold a resource needed by the deleter of a reclaimable object"} 2021-02-19 04:05:55,378 | test | ERROR | pool-1-thread-27 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613736349636L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:05:49.636Z', u'text': u"Control connection to memcached on 'ns_1@172.23.110.64' disconnected. Check logs for details."} 2021-02-19 04:05:55,380 | test | ERROR | pool-1-thread-27 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613736349635L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:05:49.635Z', u'text': u'Worker <0.17361.41> (for action {move,{843,\n [\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.69\'],\n [\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.65\'],\n []}}) exited with reason {unexpected_exit,\n {\'EXIT\',\n <0.17433.41>,\n {{{badmatch,\n {error,\n closed}},\n [{mc_client_binary,\n cmd_vocal_recv,\n 5,\n [{file,\n "src/mc_client_binary.erl"},\n {line,\n 158}]},\n {mc_client_binary,\n select_bucket,\n 2,\n [{file,\n "src/mc_client_binary.erl"},\n {line,\n 350}]},\n {ns_memcached_sockets_pool,\n take_socket,\n 2,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,\n 46}]},\n {ns_memcached_sockets_pool,\n \'-executing_on_socket/3-fun-0-\',\n 3,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,\n 88}]},\n {async,\n \'-async_init/4-fun-1-\',\n 3,\n [{file,\n "src/async.erl"},\n {line,\n 197}]}]},\n {gen_server,\n call,\n [{\'janitor_agent-GleamBookUsers8\',\n \'ns_1@172.23.110.64\'},\n {if_rebalance,\n <0.13742.41>,\n {wait_dcp_data_move,\n [\'ns_1@172.23.110.65\'],\n 843}},\n infinity]}}}}'} 2021-02-19 04:05:55,380 | test | ERROR | pool-1-thread-27 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613736341516L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:05:41.516Z', u'text': u'Shutting down bucket "GleamBookUsers7" on \'ns_1@172.23.110.69\' for deletion'} 2021-02-19 04:05:55,380 | test | ERROR | pool-1-thread-27 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613736341063L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:05:41.063Z', u'text': u'Bucket "GleamBookUsers8" rebalance does not seem to be swap rebalance'} 2021-02-19 04:05:55,380 | test | ERROR | pool-1-thread-27 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_rebalancer', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613736340943L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:05:40.943Z', u'text': u'Started rebalancing bucket GleamBookUsers8'} 2021-02-19 04:05:55,380 | test | ERROR | pool-1-thread-27 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613736208261L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:03:28.261Z', u'text': u'Shutting down bucket "GleamBookUsers6" on \'ns_1@172.23.110.69\' for deletion'} 2021-02-19 04:05:55,381 | test | ERROR | pool-1-thread-27 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613736207819L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:03:27.819Z', u'text': u'Bucket "GleamBookUsers7" rebalance does not seem to be swap rebalance'} 2021-02-19 04:05:55,381 | test | ERROR | pool-1-thread-27 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_rebalancer', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613736207691L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:03:27.691Z', u'text': u'Started rebalancing bucket GleamBookUsers7'} 2021-02-19 04:05:55,381 | test | ERROR | pool-1-thread-27 | [task:call:242] Rebalance Failed: {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 04:05:55,556 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1700.789763 2021-02-19 04:05:55,598 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:55,703 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1912.020819 2021-02-19 04:05:55,750 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1854.569112 2021-02-19 04:05:55,983 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:56,063 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 938.018594 2021-02-19 04:05:56,269 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1796.960912 2021-02-19 04:05:56,408 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1350.994702 2021-02-19 04:05:56,792 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1815.183429 2021-02-19 04:05:56,806 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1497.585622 2021-02-19 04:05:57,145 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1700.789763 2021-02-19 04:05:57,210 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:57,292 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1020.493852 2021-02-19 04:05:57,342 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1029.191243 2021-02-19 04:05:57,553 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:57,641 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 938.018594 2021-02-19 04:05:57,898 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1796.960912 2021-02-19 04:05:58,029 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1350.994702 2021-02-19 04:05:58,414 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1815.183429 2021-02-19 04:05:58,430 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1497.585622 2021-02-19 04:05:58,721 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1700.789763 2021-02-19 04:05:58,778 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:05:58,874 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1020.493852 2021-02-19 04:05:58,944 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1029.191243 2021-02-19 04:05:59,144 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:05:59,221 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 938.018594 2021-02-19 04:05:59,496 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1796.960912 2021-02-19 04:05:59,617 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1350.994702 2021-02-19 04:06:00,019 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 787.403439 2021-02-19 04:06:00,039 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 534.163811 2021-02-19 04:06:00,301 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1700.789763 2021-02-19 04:06:00,351 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:00,450 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1020.493852 2021-02-19 04:06:00,588 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1029.191243 2021-02-19 04:06:00,710 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:00,796 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 938.018594 2021-02-19 04:06:01,065 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1796.960912 2021-02-19 04:06:01,210 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1350.994702 2021-02-19 04:06:01,618 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 787.403439 2021-02-19 04:06:01,647 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 534.163811 2021-02-19 04:06:01,891 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1700.789763 2021-02-19 04:06:01,924 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:02,071 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1020.493852 2021-02-19 04:06:02,259 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1029.191243 2021-02-19 04:06:02,328 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:02,359 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 938.018594 2021-02-19 04:06:02,627 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1796.960912 2021-02-19 04:06:02,795 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1350.994702 2021-02-19 04:06:03,206 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 787.403439 2021-02-19 04:06:03,233 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 535.263811 2021-02-19 04:06:03,466 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1700.789763 2021-02-19 04:06:03,486 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:03,651 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1020.493852 2021-02-19 04:06:03,838 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1029.591243 2021-02-19 04:06:03,885 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:03,936 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 938.018594 2021-02-19 04:06:04,191 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1796.960912 2021-02-19 04:06:04,371 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1350.994702 2021-02-19 04:06:04,785 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 787.403439 2021-02-19 04:06:04,809 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 535.263811 2021-02-19 04:06:05,028 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1700.789763 2021-02-19 04:06:05,099 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:05,223 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1020.493852 2021-02-19 04:06:05,417 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.400000 2021-02-19 04:06:05,461 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:05,517 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:05,752 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1796.960912 2021-02-19 04:06:05,948 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:06,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 132.200000 2021-02-19 04:06:06,388 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 81.300000 2021-02-19 04:06:06,592 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:06,678 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:06,802 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:06:06,987 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.400000 2021-02-19 04:06:07,071 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:07,086 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:07,319 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:06:07,526 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:07,961 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 132.200000 2021-02-19 04:06:07,980 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 81.300000 2021-02-19 04:06:08,174 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:08,244 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:08,368 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:06:08,569 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.400000 2021-02-19 04:06:08,645 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:08,663 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:08,900 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:06:09,107 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:09,556 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:06:09,569 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1.100000 2021-02-19 04:06:09,747 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:09,812 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:09,944 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:06:10,151 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.400000 2021-02-19 04:06:10,230 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:10,263 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:10,473 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:06:10,724 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:11,132 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:06:11,147 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1.100000 2021-02-19 04:06:11,326 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:11,381 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:11,516 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:06:11,753 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.400000 2021-02-19 04:06:11,805 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:11,867 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:12,032 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:06:12,302 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:12,701 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:06:12,719 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6.000000 2021-02-19 04:06:12,905 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:12,956 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:13,088 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:06:13,313 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 10.000000 2021-02-19 04:06:13,371 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:13,427 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:13,601 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:06:13,898 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:14,273 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:06:14,292 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6.000000 2021-02-19 04:06:14,470 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:14,522 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:14,664 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:06:14,894 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 10.000000 2021-02-19 04:06:14,944 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:14,999 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:15,176 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:06:15,457 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:15,845 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:06:15,867 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6.000000 2021-02-19 04:06:16,040 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:16,084 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:16,224 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:06:16,466 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 10.000000 2021-02-19 04:06:16,519 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:16,553 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:16,736 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:06:17,010 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:17,411 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:06:17,430 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6.000000 2021-02-19 04:06:17,601 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:17,635 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:17,792 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:06:18,032 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 10.000000 2021-02-19 04:06:18,084 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:18,109 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:18,298 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:06:18,569 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:18,993 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:06:19,007 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6.000000 2021-02-19 04:06:19,161 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:19,200 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:19,355 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:06:19,601 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 10.000000 2021-02-19 04:06:19,651 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:19,676 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:19,855 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:06:20,151 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:20,575 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:06:20,588 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6.000000 2021-02-19 04:06:20,736 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:20,769 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:20,926 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:06:21,178 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 10.000000 2021-02-19 04:06:21,216 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:21,240 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:21,414 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:06:21,713 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:22,174 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:06:22,193 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6.000000 2021-02-19 04:06:22,325 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:22,365 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:22,500 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 579.400000 2021-02-19 04:06:22,740 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9.400000 2021-02-19 04:06:22,786 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:22,802 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:22,976 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 442.000000 2021-02-19 04:06:23,295 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:23,770 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:06:23,785 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5.700000 2021-02-19 04:06:23,890 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:23,931 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:24,078 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 579.400000 2021-02-19 04:06:24,319 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9.400000 2021-02-19 04:06:24,361 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:24,375 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:24,543 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 442.000000 2021-02-19 04:06:24,862 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:25,384 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:06:25,397 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5.700000 2021-02-19 04:06:25,480 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:25,546 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:25,703 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1806.400000 2021-02-19 04:06:25,895 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9.400000 2021-02-19 04:06:25,938 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:25,950 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:26,118 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2175.000000 2021-02-19 04:06:26,451 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:26,982 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.900000 2021-02-19 04:06:27,000 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 358.000000 2021-02-19 04:06:27,055 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:27,114 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:27,299 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1806.400000 2021-02-19 04:06:27,463 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 361.400000 2021-02-19 04:06:27,516 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:27,526 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:27,684 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2175.000000 2021-02-19 04:06:28,053 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:28,571 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.900000 2021-02-19 04:06:28,588 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 358.000000 2021-02-19 04:06:28,628 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:28,678 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:28,872 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1806.400000 2021-02-19 04:06:29,036 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 361.400000 2021-02-19 04:06:29,101 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:29,107 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:29,252 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2175.000000 2021-02-19 04:06:29,625 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:30,171 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.900000 2021-02-19 04:06:30,193 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1359.100000 2021-02-19 04:06:30,220 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:30,256 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:30,463 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1806.400000 2021-02-19 04:06:30,627 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 361.400000 2021-02-19 04:06:30,686 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:30,700 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:30,838 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2175.000000 2021-02-19 04:06:31,200 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:06:31,776 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1359.100000 2021-02-19 04:06:31,786 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.900000 2021-02-19 04:06:31,802 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:06:31,823 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:32,052 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1806.400000 2021-02-19 04:06:32,213 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 361.400000 2021-02-19 04:06:32,259 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:32,286 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 6.000000 2021-02-19 04:06:32,424 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6320.000000 2021-02-19 04:06:32,772 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4.600000 2021-02-19 04:06:33,371 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2.300000 2021-02-19 04:06:33,426 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8.800000 2021-02-19 04:06:33,428 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:33,430 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2735.000000 2021-02-19 04:06:33,630 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3595.700000 2021-02-19 04:06:33,819 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1553.000000 2021-02-19 04:06:33,865 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:33,882 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 6.000000 2021-02-19 04:06:34,013 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6320.000000 2021-02-19 04:06:34,349 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4.600000 2021-02-19 04:06:34,971 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2.300000 2021-02-19 04:06:35,026 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8.800000 2021-02-19 04:06:35,036 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:35,055 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2735.000000 2021-02-19 04:06:35,203 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3595.700000 2021-02-19 04:06:35,420 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1553.000000 2021-02-19 04:06:35,479 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 7.498053 2021-02-19 04:06:35,499 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:35,601 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9063.780186 2021-02-19 04:06:35,923 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4.600000 2021-02-19 04:06:36,598 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 24.569879 2021-02-19 04:06:36,644 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:36,661 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3765.102876 2021-02-19 04:06:36,673 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1018.886887 2021-02-19 04:06:36,813 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4691.680126 2021-02-19 04:06:37,019 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2530.771297 2021-02-19 04:06:37,065 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 7.498053 2021-02-19 04:06:37,088 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:37,187 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9063.780186 2021-02-19 04:06:37,493 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 24.074683 2021-02-19 04:06:38,219 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 24.569879 2021-02-19 04:06:38,246 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:38,279 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1018.886887 2021-02-19 04:06:38,303 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3765.102876 2021-02-19 04:06:38,403 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4691.680126 2021-02-19 04:06:38,602 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2530.771297 2021-02-19 04:06:38,655 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 7.498053 2021-02-19 04:06:38,700 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:38,775 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9063.780186 2021-02-19 04:06:39,071 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 24.074683 2021-02-19 04:06:39,861 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 24.569879 2021-02-19 04:06:39,882 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1018.886887 2021-02-19 04:06:39,898 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3765.102876 2021-02-19 04:06:39,930 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:40,043 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4691.680126 2021-02-19 04:06:40,204 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2530.771297 2021-02-19 04:06:40,242 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 7.498053 2021-02-19 04:06:40,276 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:40,359 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9063.780186 2021-02-19 04:06:40,658 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 24.074683 2021-02-19 04:06:41,463 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 540.869879 2021-02-19 04:06:41,487 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1018.886887 2021-02-19 04:06:41,502 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4020.502876 2021-02-19 04:06:41,522 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:41,645 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4691.680126 2021-02-19 04:06:41,822 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2530.771297 2021-02-19 04:06:41,838 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 7.498053 2021-02-19 04:06:41,887 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:41,984 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9063.780186 2021-02-19 04:06:42,240 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1730.674683 2021-02-19 04:06:43,092 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4040.786887 2021-02-19 04:06:43,115 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1341.669879 2021-02-19 04:06:43,131 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:43,167 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4098.202876 2021-02-19 04:06:43,236 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4434.080126 2021-02-19 04:06:43,466 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.498053 2021-02-19 04:06:43,474 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3350.371297 2021-02-19 04:06:43,516 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:43,578 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8421.480186 2021-02-19 04:06:43,828 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1730.674683 2021-02-19 04:06:43,891 | infra | INFO | pool-2-thread-27 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' completed 2021-02-19 04:06:43,891 | infra | INFO | pool-2-thread-27 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:06:44,717 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4040.786887 2021-02-19 04:06:44,736 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:44,792 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1341.669879 2021-02-19 04:06:44,805 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4098.202876 2021-02-19 04:06:44,815 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4434.080126 2021-02-19 04:06:45,069 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.498053 2021-02-19 04:06:45,098 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3350.371297 2021-02-19 04:06:45,109 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:45,173 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8421.480186 2021-02-19 04:06:45,388 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1730.674683 2021-02-19 04:06:46,328 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5773.565725 2021-02-19 04:06:46,354 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:46,401 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2388.991639 2021-02-19 04:06:46,418 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4269.920356 2021-02-19 04:06:46,434 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4227.951907 2021-02-19 04:06:46,648 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:46,688 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:46,703 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4170.394733 2021-02-19 04:06:46,772 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7810.024922 2021-02-19 04:06:46,954 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4102.508701 2021-02-19 04:06:47,926 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5773.565725 2021-02-19 04:06:47,941 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:48,003 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2388.991639 2021-02-19 04:06:48,019 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4269.920356 2021-02-19 04:06:48,052 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4227.951907 2021-02-19 04:06:48,229 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:48,265 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:48,305 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4170.394733 2021-02-19 04:06:48,367 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7810.024922 2021-02-19 04:06:48,523 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4102.508701 2021-02-19 04:06:48,752 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.64:8091 2021-02-19 04:06:48,752 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 04:06:48,767 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.64:8091 is running 2021-02-19 04:06:48,767 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:49,207 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.4390001297. 2021-02-19 04:06:49,207 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:49,532 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5773.565725 2021-02-19 04:06:49,546 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:49,615 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3979.220356 2021-02-19 04:06:49,635 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.428999900818. 2021-02-19 04:06:49,637 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:49,641 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2931.391639 2021-02-19 04:06:49,651 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4227.951907 2021-02-19 04:06:49,809 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:49,848 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:49,885 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4170.394733 2021-02-19 04:06:49,956 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7810.024922 2021-02-19 04:06:50,084 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.447000026703. 2021-02-19 04:06:50,085 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:50,105 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4102.508701 2021-02-19 04:06:50,553 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.468999862671. 2021-02-19 04:06:50,555 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:50,983 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.427999973297. 2021-02-19 04:06:50,983 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:51,141 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:51,164 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5773.565725 2021-02-19 04:06:51,242 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3979.220356 2021-02-19 04:06:51,256 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2931.391639 2021-02-19 04:06:51,275 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4227.951907 2021-02-19 04:06:51,411 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.427000045776. 2021-02-19 04:06:51,411 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:51,418 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:06:51,484 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4170.394733 2021-02-19 04:06:51,496 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:51,576 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7810.024922 2021-02-19 04:06:51,678 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4102.508701 2021-02-19 04:06:51,862 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.450999975204. 2021-02-19 04:06:51,862 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:52,315 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.453000068665. 2021-02-19 04:06:52,316 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:52,742 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.425000190735. 2021-02-19 04:06:52,743 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:52,776 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:52,826 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5109.165725 2021-02-19 04:06:52,898 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3072.520356 2021-02-19 04:06:52,923 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4392.251907 2021-02-19 04:06:52,964 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3170.491639 2021-02-19 04:06:53,092 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.100000 2021-02-19 04:06:53,140 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:53,154 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4305.194733 2021-02-19 04:06:53,174 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.430999994278. 2021-02-19 04:06:53,190 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.65:8091 2021-02-19 04:06:53,190 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 04:06:53,207 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.65:8091 is running 2021-02-19 04:06:53,207 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:53,217 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7686.324922 2021-02-19 04:06:53,302 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4856.508701 2021-02-19 04:06:53,657 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.449000120163. 2021-02-19 04:06:53,657 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:54,117 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.460000038147. 2021-02-19 04:06:54,117 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:54,408 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:54,454 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5109.165725 2021-02-19 04:06:54,572 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3072.520356 2021-02-19 04:06:54,572 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.455999851227. 2021-02-19 04:06:54,573 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:54,601 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4392.251907 2021-02-19 04:06:54,651 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3170.491639 2021-02-19 04:06:54,798 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:54,815 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.100000 2021-02-19 04:06:54,825 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4305.194733 2021-02-19 04:06:54,921 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7686.324922 2021-02-19 04:06:54,934 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4856.508701 2021-02-19 04:06:55,062 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.488000154495. 2021-02-19 04:06:55,062 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:55,509 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.447999954224. 2021-02-19 04:06:55,509 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:55,959 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.447999954224. 2021-02-19 04:06:55,959 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:56,065 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:56,089 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4640.900000 2021-02-19 04:06:56,269 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1624.600000 2021-02-19 04:06:56,286 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4596.800000 2021-02-19 04:06:56,345 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3148.900000 2021-02-19 04:06:56,407 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.447999954224. 2021-02-19 04:06:56,407 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:56,441 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:56,470 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2.000000 2021-02-19 04:06:56,489 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4352.700000 2021-02-19 04:06:56,575 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4973.200000 2021-02-19 04:06:56,595 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7606.800000 2021-02-19 04:06:56,884 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.477999925613. 2021-02-19 04:06:56,884 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:57,335 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.450000047684. 2021-02-19 04:06:57,335 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:06:57,696 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:57,726 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4640.900000 2021-02-19 04:06:57,834 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.499000072479. 2021-02-19 04:06:57,835 | test | INFO | MainThread | [Magma:abort_rebalance:927] Restarting Rebalance after killing at 80 2021-02-19 04:06:57,872 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[]_OUT=[172.23.110.69]_1613736417.84 2021-02-19 04:06:57,872 | infra | INFO | pool-1-thread-28 | [task:start_task:84] Thread 'Rebalance_task_IN=[]_OUT=[172.23.110.69]_1613736417.84' started 2021-02-19 04:06:57,887 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L932 2021-02-19 04:06:57,887 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 120 seconds. Reason: Let the rebalance begin after abort 2021-02-19 04:06:57,911 | test | DEBUG | pool-1-thread-28 | [task:start_rebalance:301] Removing node 172.23.110.69:8091 from cluster 2021-02-19 04:06:57,911 | test | DEBUG | pool-1-thread-28 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': u'ns_1@172.23.110.69', 'user': 'Administrator'} 2021-02-19 04:06:57,950 | test | DEBUG | pool-1-thread-28 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 04:06:57,960 | test | INFO | pool-1-thread-28 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+---------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 14.2001265734 | Cluster node | | 172.23.110.69 | kv | 7.0.0-4498-enterprise | 3.76457817241 | --- OUT ---> | | 172.23.110.65 | kv | 7.0.0-4498-enterprise | 15.447566017 | Cluster node | +---------------+----------+-----------------------+---------------+--------------+ 2021-02-19 04:06:57,970 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1624.600000 2021-02-19 04:06:57,973 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 04:06:57,973 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 04:06:57,993 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4596.800000 2021-02-19 04:06:58,020 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3148.900000 2021-02-19 04:06:58,098 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:58,176 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4352.700000 2021-02-19 04:06:58,191 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2.000000 2021-02-19 04:06:58,247 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4973.200000 2021-02-19 04:06:58,269 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7606.800000 2021-02-19 04:06:59,339 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:06:59,371 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4640.900000 2021-02-19 04:06:59,638 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 658.800000 2021-02-19 04:06:59,694 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3103.800000 2021-02-19 04:06:59,709 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4596.800000 2021-02-19 04:06:59,806 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:06:59,851 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4352.700000 2021-02-19 04:06:59,887 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2.000000 2021-02-19 04:06:59,903 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4973.200000 2021-02-19 04:06:59,950 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7606.800000 2021-02-19 04:07:01,029 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:01,056 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4640.900000 2021-02-19 04:07:01,345 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 658.800000 2021-02-19 04:07:01,407 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3103.800000 2021-02-19 04:07:01,430 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4596.800000 2021-02-19 04:07:01,513 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:01,540 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4352.700000 2021-02-19 04:07:01,598 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4973.200000 2021-02-19 04:07:01,612 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2.000000 2021-02-19 04:07:01,634 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7606.800000 2021-02-19 04:07:02,651 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:02,696 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4434.800000 2021-02-19 04:07:02,983 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 106.200000 2021-02-19 04:07:03,010 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.18 % 2021-02-19 04:07:03,010 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 80.1840633734 2021-02-19 04:07:03,059 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3070.200000 2021-02-19 04:07:03,065 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4621.100000 2021-02-19 04:07:03,144 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:03,171 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4503.700000 2021-02-19 04:07:03,229 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.900000 2021-02-19 04:07:03,273 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5013.400000 2021-02-19 04:07:03,285 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7628.500000 2021-02-19 04:07:04,282 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:04,319 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4434.800000 2021-02-19 04:07:04,599 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 106.200000 2021-02-19 04:07:04,709 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4621.100000 2021-02-19 04:07:04,726 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3070.200000 2021-02-19 04:07:04,763 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:04,881 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4503.700000 2021-02-19 04:07:04,910 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5013.400000 2021-02-19 04:07:04,918 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.900000 2021-02-19 04:07:04,930 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7628.500000 2021-02-19 04:07:05,908 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:05,941 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4434.800000 2021-02-19 04:07:06,236 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:06,385 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4535.700000 2021-02-19 04:07:06,397 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3060.900000 2021-02-19 04:07:06,421 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:06,516 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4570.500000 2021-02-19 04:07:06,542 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5039.100000 2021-02-19 04:07:06,588 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 151.300000 2021-02-19 04:07:06,607 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7568.700000 2021-02-19 04:07:07,530 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:07,559 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4576.200000 2021-02-19 04:07:07,898 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:08,065 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4535.700000 2021-02-19 04:07:08,068 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.60 % 2021-02-19 04:07:08,068 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 80.596598941 2021-02-19 04:07:08,078 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3060.900000 2021-02-19 04:07:08,102 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:08,190 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4570.500000 2021-02-19 04:07:08,197 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5039.100000 2021-02-19 04:07:08,250 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 151.300000 2021-02-19 04:07:08,280 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7568.700000 2021-02-19 04:07:09,168 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:09,187 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4576.200000 2021-02-19 04:07:09,561 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:09,677 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4535.700000 2021-02-19 04:07:09,759 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:09,776 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3174.100000 2021-02-19 04:07:09,835 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5039.100000 2021-02-19 04:07:09,851 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4570.500000 2021-02-19 04:07:09,911 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7568.700000 2021-02-19 04:07:09,915 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 151.300000 2021-02-19 04:07:10,803 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:10,832 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4576.200000 2021-02-19 04:07:11,190 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:11,308 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4535.700000 2021-02-19 04:07:11,411 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:11,424 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3174.100000 2021-02-19 04:07:11,470 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5039.100000 2021-02-19 04:07:11,512 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4570.500000 2021-02-19 04:07:11,581 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7568.700000 2021-02-19 04:07:11,589 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 151.300000 2021-02-19 04:07:12,433 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:12,447 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5781.300000 2021-02-19 04:07:12,849 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:12,960 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4208.200000 2021-02-19 04:07:13,063 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:13,095 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3338.700000 2021-02-19 04:07:13,121 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.98 % 2021-02-19 04:07:13,122 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 80.981784226 2021-02-19 04:07:13,125 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5207.800000 2021-02-19 04:07:13,188 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4246.300000 2021-02-19 04:07:13,221 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6971.300000 2021-02-19 04:07:13,266 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1576.400000 2021-02-19 04:07:14,055 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:14,069 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5781.300000 2021-02-19 04:07:14,490 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:14,595 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4208.200000 2021-02-19 04:07:14,694 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:14,750 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3338.700000 2021-02-19 04:07:14,793 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5207.800000 2021-02-19 04:07:14,819 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4246.300000 2021-02-19 04:07:14,901 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6971.300000 2021-02-19 04:07:14,940 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1576.400000 2021-02-19 04:07:15,674 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:15,709 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6847.700000 2021-02-19 04:07:16,121 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:16,233 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3917.500000 2021-02-19 04:07:16,319 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:16,407 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3497.200000 2021-02-19 04:07:16,457 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5320.200000 2021-02-19 04:07:16,496 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3919.200000 2021-02-19 04:07:16,562 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6443.300000 2021-02-19 04:07:16,588 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3187.900000 2021-02-19 04:07:17,334 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:17,339 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6847.700000 2021-02-19 04:07:17,747 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:17,861 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3917.500000 2021-02-19 04:07:17,937 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:18,026 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3497.200000 2021-02-19 04:07:18,092 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5320.200000 2021-02-19 04:07:18,144 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3919.200000 2021-02-19 04:07:18,171 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 81.43 % 2021-02-19 04:07:18,171 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 81.4282392929 2021-02-19 04:07:18,207 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6443.300000 2021-02-19 04:07:18,220 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3187.900000 2021-02-19 04:07:18,959 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6847.700000 2021-02-19 04:07:18,973 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:19,417 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:19,509 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3917.500000 2021-02-19 04:07:19,588 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:19,673 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3621.800000 2021-02-19 04:07:19,720 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5320.200000 2021-02-19 04:07:19,782 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3919.200000 2021-02-19 04:07:19,839 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6443.300000 2021-02-19 04:07:19,851 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3187.900000 2021-02-19 04:07:20,582 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6847.700000 2021-02-19 04:07:20,599 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:21,071 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:21,147 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3917.500000 2021-02-19 04:07:21,220 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:21,309 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3621.800000 2021-02-19 04:07:21,358 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5320.200000 2021-02-19 04:07:21,414 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3919.200000 2021-02-19 04:07:21,513 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6443.300000 2021-02-19 04:07:21,523 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3187.900000 2021-02-19 04:07:22,187 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6847.700000 2021-02-19 04:07:22,204 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:22,700 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:22,770 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3937.200000 2021-02-19 04:07:22,855 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:22,937 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3724.800000 2021-02-19 04:07:23,009 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5253.800000 2021-02-19 04:07:23,046 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3981.900000 2021-02-19 04:07:23,148 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6447.800000 2021-02-19 04:07:23,165 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3504.100000 2021-02-19 04:07:23,230 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 81.89 % 2021-02-19 04:07:23,230 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 81.8883553886 2021-02-19 04:07:23,808 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7034.900000 2021-02-19 04:07:23,819 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:24,344 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:24,417 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3937.200000 2021-02-19 04:07:24,497 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:24,585 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3724.800000 2021-02-19 04:07:24,660 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5253.800000 2021-02-19 04:07:24,698 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3981.900000 2021-02-19 04:07:24,808 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6447.800000 2021-02-19 04:07:24,815 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3504.100000 2021-02-19 04:07:25,463 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7073.900000 2021-02-19 04:07:25,473 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:25,950 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:26,042 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3937.200000 2021-02-19 04:07:26,128 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:26,221 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3811.300000 2021-02-19 04:07:26,301 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5194.300000 2021-02-19 04:07:26,332 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4103.100000 2021-02-19 04:07:26,431 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3493.400000 2021-02-19 04:07:26,447 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6539.800000 2021-02-19 04:07:27,086 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7073.900000 2021-02-19 04:07:27,092 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:27,588 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:27,657 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3990.900000 2021-02-19 04:07:27,757 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:27,884 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3811.300000 2021-02-19 04:07:27,934 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5194.300000 2021-02-19 04:07:27,983 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4103.100000 2021-02-19 04:07:28,065 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3493.400000 2021-02-19 04:07:28,084 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6539.800000 2021-02-19 04:07:28,269 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 82.33 % 2021-02-19 04:07:28,269 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 82.3315822977 2021-02-19 04:07:28,753 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:28,766 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7073.900000 2021-02-19 04:07:29,223 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:29,295 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3990.900000 2021-02-19 04:07:29,395 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:29,513 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3851.000000 2021-02-19 04:07:29,575 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5194.300000 2021-02-19 04:07:29,644 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4103.100000 2021-02-19 04:07:29,711 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6539.800000 2021-02-19 04:07:29,737 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3493.400000 2021-02-19 04:07:30,372 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:30,413 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7073.900000 2021-02-19 04:07:30,846 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:30,923 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3990.900000 2021-02-19 04:07:31,016 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:31,178 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3851.000000 2021-02-19 04:07:31,223 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5194.300000 2021-02-19 04:07:31,273 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4103.100000 2021-02-19 04:07:31,368 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3493.400000 2021-02-19 04:07:31,371 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6539.800000 2021-02-19 04:07:31,983 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:32,053 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7073.900000 2021-02-19 04:07:32,473 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:32,553 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4007.300000 2021-02-19 04:07:32,638 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:32,818 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3871.400000 2021-02-19 04:07:32,861 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5129.900000 2021-02-19 04:07:32,911 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4071.600000 2021-02-19 04:07:33,003 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6615.000000 2021-02-19 04:07:33,012 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3471.800000 2021-02-19 04:07:33,306 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 82.76 % 2021-02-19 04:07:33,308 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 82.7610635024 2021-02-19 04:07:33,595 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:33,684 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6906.100000 2021-02-19 04:07:34,088 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:34,216 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4007.300000 2021-02-19 04:07:34,312 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:34,444 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3871.400000 2021-02-19 04:07:34,549 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5129.900000 2021-02-19 04:07:34,568 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4071.600000 2021-02-19 04:07:34,628 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6615.000000 2021-02-19 04:07:34,644 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3471.800000 2021-02-19 04:07:35,194 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:35,309 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6906.100000 2021-02-19 04:07:35,711 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:35,842 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4007.300000 2021-02-19 04:07:35,924 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:36,062 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3862.100000 2021-02-19 04:07:36,160 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5086.600000 2021-02-19 04:07:36,194 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3996.300000 2021-02-19 04:07:36,246 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6618.700000 2021-02-19 04:07:36,282 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3431.100000 2021-02-19 04:07:36,792 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:36,904 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6760.800000 2021-02-19 04:07:37,334 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:37,480 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3991.200000 2021-02-19 04:07:37,540 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:37,676 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3862.100000 2021-02-19 04:07:37,776 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5086.600000 2021-02-19 04:07:37,822 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3996.300000 2021-02-19 04:07:37,864 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6618.700000 2021-02-19 04:07:37,897 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3431.100000 2021-02-19 04:07:38,359 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 83.22 % 2021-02-19 04:07:38,361 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 83.2244642064 2021-02-19 04:07:38,398 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:38,510 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6760.800000 2021-02-19 04:07:38,950 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:39,101 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3991.200000 2021-02-19 04:07:39,153 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:39,338 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3862.100000 2021-02-19 04:07:39,453 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3996.300000 2021-02-19 04:07:39,470 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5086.600000 2021-02-19 04:07:39,507 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6618.700000 2021-02-19 04:07:39,517 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3431.100000 2021-02-19 04:07:39,990 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:40,128 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6760.800000 2021-02-19 04:07:40,582 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:40,717 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3991.200000 2021-02-19 04:07:40,757 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:40,953 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3855.300000 2021-02-19 04:07:41,104 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3996.300000 2021-02-19 04:07:41,153 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3431.100000 2021-02-19 04:07:41,167 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5086.600000 2021-02-19 04:07:41,174 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6618.700000 2021-02-19 04:07:41,585 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:41,757 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6760.800000 2021-02-19 04:07:42,206 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:42,351 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3964.318581 2021-02-19 04:07:42,384 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:42,578 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3838.122478 2021-02-19 04:07:42,723 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3987.595305 2021-02-19 04:07:42,793 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3481.229171 2021-02-19 04:07:42,808 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6623.170529 2021-02-19 04:07:42,826 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5125.118182 2021-02-19 04:07:43,191 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:43,381 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6815.061039 2021-02-19 04:07:43,397 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 83.67 % 2021-02-19 04:07:43,398 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 83.667634665 2021-02-19 04:07:43,811 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:44,003 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3964.318581 2021-02-19 04:07:44,019 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:44,180 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3838.122478 2021-02-19 04:07:44,362 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3987.595305 2021-02-19 04:07:44,415 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3481.229171 2021-02-19 04:07:44,457 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6623.170529 2021-02-19 04:07:44,463 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5125.118182 2021-02-19 04:07:44,785 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:45,016 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6815.061039 2021-02-19 04:07:45,459 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:45,615 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3959.918581 2021-02-19 04:07:45,671 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:45,864 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3838.122478 2021-02-19 04:07:45,983 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3987.595305 2021-02-19 04:07:46,035 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3481.229171 2021-02-19 04:07:46,092 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6667.170529 2021-02-19 04:07:46,101 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5160.618182 2021-02-19 04:07:46,391 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:46,648 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6864.261039 2021-02-19 04:07:47,078 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:47,220 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3959.918581 2021-02-19 04:07:47,279 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:47,519 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3843.822478 2021-02-19 04:07:47,608 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4017.495305 2021-02-19 04:07:47,665 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3524.629171 2021-02-19 04:07:47,721 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6667.170529 2021-02-19 04:07:47,740 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5160.618182 2021-02-19 04:07:47,986 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:48,256 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6864.261039 2021-02-19 04:07:48,437 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 84.08 % 2021-02-19 04:07:48,438 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 84.0770549758 2021-02-19 04:07:48,684 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:48,828 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3959.918581 2021-02-19 04:07:48,885 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:49,153 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3843.822478 2021-02-19 04:07:49,226 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4017.495305 2021-02-19 04:07:49,289 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3524.629171 2021-02-19 04:07:49,355 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6667.170529 2021-02-19 04:07:49,371 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5160.618182 2021-02-19 04:07:49,596 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:49,865 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6864.261039 2021-02-19 04:07:50,341 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:50,446 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3959.918581 2021-02-19 04:07:50,493 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:50,770 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3810.722478 2021-02-19 04:07:50,836 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4017.495305 2021-02-19 04:07:50,963 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3524.629171 2021-02-19 04:07:50,976 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6667.170529 2021-02-19 04:07:51,049 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5160.618182 2021-02-19 04:07:51,198 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:51,470 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6864.261039 2021-02-19 04:07:52,006 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:52,101 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:52,119 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3959.918581 2021-02-19 04:07:52,392 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3806.573373 2021-02-19 04:07:52,473 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3976.864064 2021-02-19 04:07:52,617 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6511.774074 2021-02-19 04:07:52,618 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3500.046246 2021-02-19 04:07:52,676 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5150.771972 2021-02-19 04:07:52,805 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:53,078 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6758.533233 2021-02-19 04:07:53,477 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 84.52 % 2021-02-19 04:07:53,477 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 84.5235100427 2021-02-19 04:07:53,618 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:53,723 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:53,759 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3948.570070 2021-02-19 04:07:54,009 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3806.573373 2021-02-19 04:07:54,085 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3976.864064 2021-02-19 04:07:54,234 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6511.774074 2021-02-19 04:07:54,276 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3500.046246 2021-02-19 04:07:54,319 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5150.771972 2021-02-19 04:07:54,404 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:54,684 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6758.533233 2021-02-19 04:07:55,242 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:55,346 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:55,381 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3948.570070 2021-02-19 04:07:55,625 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3798.573373 2021-02-19 04:07:55,716 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3926.664064 2021-02-19 04:07:55,903 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6511.774074 2021-02-19 04:07:55,921 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3500.046246 2021-02-19 04:07:55,943 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5150.771972 2021-02-19 04:07:56,046 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:56,309 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6691.833233 2021-02-19 04:07:56,881 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:56,996 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3962.170070 2021-02-19 04:07:57,009 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:57,233 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3798.573373 2021-02-19 04:07:57,338 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3926.664064 2021-02-19 04:07:57,513 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6336.374074 2021-02-19 04:07:57,546 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3521.046246 2021-02-19 04:07:57,565 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5151.271972 2021-02-19 04:07:57,654 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:57,967 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6691.833233 2021-02-19 04:07:58,516 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:07:58,529 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 84.97 % 2021-02-19 04:07:58,529 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 84.9699368845 2021-02-19 04:07:58,676 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3962.170070 2021-02-19 04:07:58,681 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:07:58,852 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3798.573373 2021-02-19 04:07:58,946 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3926.664064 2021-02-19 04:07:59,130 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6336.374074 2021-02-19 04:07:59,176 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3521.046246 2021-02-19 04:07:59,194 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5151.271972 2021-02-19 04:07:59,256 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:07:59,576 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6691.833233 2021-02-19 04:08:00,148 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:08:00,308 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:00,348 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3962.170070 2021-02-19 04:08:00,494 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3825.773373 2021-02-19 04:08:00,582 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3926.664064 2021-02-19 04:08:00,756 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6336.374074 2021-02-19 04:08:00,796 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3521.046246 2021-02-19 04:08:00,822 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5151.271972 2021-02-19 04:08:00,869 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:08:01,201 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6691.833233 2021-02-19 04:08:01,763 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:08:01,937 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:01,971 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3962.170070 2021-02-19 04:08:02,173 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3825.773373 2021-02-19 04:08:02,247 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3926.664064 2021-02-19 04:08:02,390 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6431.900000 2021-02-19 04:08:02,447 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3573.500000 2021-02-19 04:08:02,480 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5102.900000 2021-02-19 04:08:02,513 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:08:02,805 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6692.800000 2021-02-19 04:08:03,378 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:08:03,555 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:03,565 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 85.43 % 2021-02-19 04:08:03,565 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 85.4268530475 2021-02-19 04:08:03,602 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3997.400000 2021-02-19 04:08:03,819 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3839.300000 2021-02-19 04:08:03,897 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3923.500000 2021-02-19 04:08:04,025 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6431.900000 2021-02-19 04:08:04,127 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3573.500000 2021-02-19 04:08:04,167 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:08:04,174 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5102.900000 2021-02-19 04:08:04,431 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6692.800000 2021-02-19 04:08:05,006 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:08:05,191 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:05,232 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3997.400000 2021-02-19 04:08:05,454 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3848.300000 2021-02-19 04:08:05,507 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3896.200000 2021-02-19 04:08:05,654 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6546.600000 2021-02-19 04:08:05,753 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3579.700000 2021-02-19 04:08:05,802 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:08:05,813 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5032.800000 2021-02-19 04:08:06,032 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6692.800000 2021-02-19 04:08:06,490 | infra | INFO | pool-2-thread-63 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' completed 2021-02-19 04:08:06,490 | infra | INFO | pool-2-thread-63 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:08:06,627 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:08:06,809 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:06,859 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3987.800000 2021-02-19 04:08:07,124 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3896.200000 2021-02-19 04:08:07,142 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3848.300000 2021-02-19 04:08:07,335 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6546.600000 2021-02-19 04:08:07,424 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3579.700000 2021-02-19 04:08:07,460 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:08:07,470 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5032.800000 2021-02-19 04:08:07,664 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6630.300000 2021-02-19 04:08:08,263 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:08:08,446 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:08,499 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3987.800000 2021-02-19 04:08:08,614 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 85.83 % 2021-02-19 04:08:08,615 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 85.8288992937 2021-02-19 04:08:08,792 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3896.200000 2021-02-19 04:08:08,825 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3848.300000 2021-02-19 04:08:08,980 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6546.600000 2021-02-19 04:08:09,066 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3579.700000 2021-02-19 04:08:09,098 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:08:09,115 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5032.800000 2021-02-19 04:08:09,285 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6630.300000 2021-02-19 04:08:09,884 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:08:10,075 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:10,168 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3987.800000 2021-02-19 04:08:10,174 | infra | INFO | pool-2-thread-18 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' completed 2021-02-19 04:08:10,174 | infra | INFO | pool-2-thread-18 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:08:10,436 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3896.200000 2021-02-19 04:08:10,482 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3814.350910 2021-02-19 04:08:10,632 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6546.600000 2021-02-19 04:08:10,690 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3579.700000 2021-02-19 04:08:10,769 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:08:10,795 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5032.800000 2021-02-19 04:08:10,904 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6630.300000 2021-02-19 04:08:11,506 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:08:11,706 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:11,786 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3987.800000 2021-02-19 04:08:12,062 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3896.200000 2021-02-19 04:08:12,124 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3814.350910 2021-02-19 04:08:12,269 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6546.600000 2021-02-19 04:08:12,332 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3443.900000 2021-02-19 04:08:12,410 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 734.300000 2021-02-19 04:08:12,460 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4976.300000 2021-02-19 04:08:12,528 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6588.700000 2021-02-19 04:08:13,132 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 11.900000 2021-02-19 04:08:13,357 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:13,469 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3875.200000 2021-02-19 04:08:13,654 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 86.22 % 2021-02-19 04:08:13,654 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 86.217976458 2021-02-19 04:08:13,720 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3797.900000 2021-02-19 04:08:13,785 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3734.850910 2021-02-19 04:08:13,900 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6517.100000 2021-02-19 04:08:13,986 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3443.900000 2021-02-19 04:08:14,028 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 734.300000 2021-02-19 04:08:14,098 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4976.300000 2021-02-19 04:08:14,153 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6588.700000 2021-02-19 04:08:14,770 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 11.900000 2021-02-19 04:08:14,992 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:15,111 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3875.200000 2021-02-19 04:08:15,338 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3797.900000 2021-02-19 04:08:15,440 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3734.850910 2021-02-19 04:08:15,549 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6531.100000 2021-02-19 04:08:15,654 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3285.100000 2021-02-19 04:08:15,677 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1964.800000 2021-02-19 04:08:15,733 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4898.700000 2021-02-19 04:08:15,799 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6495.500000 2021-02-19 04:08:16,411 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 302.100000 2021-02-19 04:08:16,605 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:16,734 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3726.000000 2021-02-19 04:08:16,953 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3665.900000 2021-02-19 04:08:17,084 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3604.850910 2021-02-19 04:08:17,200 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6531.100000 2021-02-19 04:08:17,321 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3285.100000 2021-02-19 04:08:17,344 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1964.800000 2021-02-19 04:08:17,390 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4898.700000 2021-02-19 04:08:17,436 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6495.500000 2021-02-19 04:08:18,055 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 302.100000 2021-02-19 04:08:18,240 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:18,364 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3726.000000 2021-02-19 04:08:18,572 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3665.900000 2021-02-19 04:08:18,700 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 86.59 % 2021-02-19 04:08:18,700 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 86.5861032048 2021-02-19 04:08:18,716 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3604.850910 2021-02-19 04:08:18,828 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6531.100000 2021-02-19 04:08:18,940 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3285.100000 2021-02-19 04:08:18,964 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1964.800000 2021-02-19 04:08:19,039 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4898.700000 2021-02-19 04:08:19,055 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6495.500000 2021-02-19 04:08:19,684 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 496.438868 2021-02-19 04:08:19,868 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:19,974 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3726.000000 2021-02-19 04:08:20,207 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3665.900000 2021-02-19 04:08:20,354 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3498.527826 2021-02-19 04:08:20,470 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6531.100000 2021-02-19 04:08:20,579 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3285.100000 2021-02-19 04:08:20,598 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1964.800000 2021-02-19 04:08:20,691 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4898.700000 2021-02-19 04:08:20,714 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6495.500000 2021-02-19 04:08:21,315 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 496.438868 2021-02-19 04:08:21,496 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:21,601 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3726.000000 2021-02-19 04:08:21,829 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3665.900000 2021-02-19 04:08:21,979 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3498.527826 2021-02-19 04:08:22,075 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6531.100000 2021-02-19 04:08:22,220 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3285.100000 2021-02-19 04:08:22,230 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1964.800000 2021-02-19 04:08:22,365 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4795.100000 2021-02-19 04:08:22,381 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6157.500000 2021-02-19 04:08:22,927 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1413.938868 2021-02-19 04:08:23,125 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:23,244 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3539.200000 2021-02-19 04:08:23,513 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3484.100000 2021-02-19 04:08:23,648 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3439.827826 2021-02-19 04:08:23,694 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6799.600000 2021-02-19 04:08:23,747 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 86.98 % 2021-02-19 04:08:23,749 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 86.9848648427 2021-02-19 04:08:23,858 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3238.100000 2021-02-19 04:08:23,871 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2968.600000 2021-02-19 04:08:24,046 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6157.500000 2021-02-19 04:08:24,071 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4795.100000 2021-02-19 04:08:24,540 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1413.938868 2021-02-19 04:08:24,757 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:24,903 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3539.200000 2021-02-19 04:08:25,151 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3484.100000 2021-02-19 04:08:25,273 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3439.827826 2021-02-19 04:08:25,319 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6799.600000 2021-02-19 04:08:25,500 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3239.800000 2021-02-19 04:08:25,526 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3484.100000 2021-02-19 04:08:25,680 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5892.300000 2021-02-19 04:08:25,733 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4731.800000 2021-02-19 04:08:26,173 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1987.138868 2021-02-19 04:08:26,392 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:26,536 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3428.900000 2021-02-19 04:08:26,782 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3369.900000 2021-02-19 04:08:26,901 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3464.727826 2021-02-19 04:08:26,947 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7076.800000 2021-02-19 04:08:27,132 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3239.800000 2021-02-19 04:08:27,161 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3484.100000 2021-02-19 04:08:27,345 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5892.300000 2021-02-19 04:08:27,358 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4731.800000 2021-02-19 04:08:27,813 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1987.138868 2021-02-19 04:08:28,010 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:28,155 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3428.900000 2021-02-19 04:08:28,401 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3369.900000 2021-02-19 04:08:28,548 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3464.727826 2021-02-19 04:08:28,596 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7076.800000 2021-02-19 04:08:28,766 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3239.800000 2021-02-19 04:08:28,796 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3484.100000 2021-02-19 04:08:28,801 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 87.37 % 2021-02-19 04:08:28,801 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 87.3667090687 2021-02-19 04:08:28,974 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5892.300000 2021-02-19 04:08:29,003 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4731.800000 2021-02-19 04:08:29,430 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1996.900000 2021-02-19 04:08:29,640 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:29,776 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3428.900000 2021-02-19 04:08:30,022 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3369.900000 2021-02-19 04:08:30,187 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3503.000000 2021-02-19 04:08:30,220 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7076.800000 2021-02-19 04:08:30,381 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3239.800000 2021-02-19 04:08:30,417 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3484.100000 2021-02-19 04:08:30,598 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5892.300000 2021-02-19 04:08:30,634 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4731.800000 2021-02-19 04:08:31,072 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1996.900000 2021-02-19 04:08:31,250 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:31,397 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3428.900000 2021-02-19 04:08:31,627 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3369.900000 2021-02-19 04:08:31,842 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3503.000000 2021-02-19 04:08:31,852 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7076.800000 2021-02-19 04:08:32,022 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3484.100000 2021-02-19 04:08:32,049 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3239.800000 2021-02-19 04:08:32,234 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5892.300000 2021-02-19 04:08:32,276 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4731.800000 2021-02-19 04:08:32,750 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1873.800000 2021-02-19 04:08:32,960 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:33,073 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3461.400000 2021-02-19 04:08:33,256 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3346.200000 2021-02-19 04:08:33,499 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7128.600000 2021-02-19 04:08:33,503 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3545.800000 2021-02-19 04:08:33,690 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3258.200000 2021-02-19 04:08:33,696 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3493.700000 2021-02-19 04:08:33,849 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 87.78 % 2021-02-19 04:08:33,851 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 87.7825292447 2021-02-19 04:08:33,924 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5918.500000 2021-02-19 04:08:33,934 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4735.800000 2021-02-19 04:08:34,378 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1873.800000 2021-02-19 04:08:34,561 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:34,687 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3461.400000 2021-02-19 04:08:34,877 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3346.200000 2021-02-19 04:08:35,134 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7128.600000 2021-02-19 04:08:35,161 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3545.800000 2021-02-19 04:08:35,346 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3258.200000 2021-02-19 04:08:35,354 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3493.700000 2021-02-19 04:08:35,572 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6022.400000 2021-02-19 04:08:35,598 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4723.700000 2021-02-19 04:08:36,026 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1873.800000 2021-02-19 04:08:36,160 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:36,316 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3475.100000 2021-02-19 04:08:36,502 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3313.900000 2021-02-19 04:08:36,776 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7099.700000 2021-02-19 04:08:36,806 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3534.000000 2021-02-19 04:08:36,996 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3293.800000 2021-02-19 04:08:37,012 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3494.700000 2021-02-19 04:08:37,213 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6022.400000 2021-02-19 04:08:37,243 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4723.700000 2021-02-19 04:08:37,645 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1784.500000 2021-02-19 04:08:37,783 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:37,943 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3475.100000 2021-02-19 04:08:38,124 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3313.900000 2021-02-19 04:08:38,390 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7099.700000 2021-02-19 04:08:38,437 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3534.000000 2021-02-19 04:08:38,618 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3293.800000 2021-02-19 04:08:38,630 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3494.700000 2021-02-19 04:08:38,828 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6022.400000 2021-02-19 04:08:38,880 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4723.700000 2021-02-19 04:08:38,900 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 87.99 % 2021-02-19 04:08:38,901 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 87.9939429007 2021-02-19 04:08:39,296 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1784.500000 2021-02-19 04:08:39,421 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:39,588 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3475.100000 2021-02-19 04:08:39,746 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3313.900000 2021-02-19 04:08:40,009 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7099.700000 2021-02-19 04:08:40,071 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3534.000000 2021-02-19 04:08:40,246 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3293.800000 2021-02-19 04:08:40,279 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3494.700000 2021-02-19 04:08:40,490 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6022.400000 2021-02-19 04:08:40,530 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4723.700000 2021-02-19 04:08:40,960 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1727.800000 2021-02-19 04:08:41,051 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:41,213 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3475.100000 2021-02-19 04:08:41,367 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3313.900000 2021-02-19 04:08:41,634 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7099.700000 2021-02-19 04:08:41,707 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3520.500000 2021-02-19 04:08:41,867 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3293.800000 2021-02-19 04:08:41,905 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3494.700000 2021-02-19 04:08:42,105 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6022.400000 2021-02-19 04:08:42,163 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4723.700000 2021-02-19 04:08:42,624 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1837.600000 2021-02-19 04:08:42,701 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:42,868 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3467.500000 2021-02-19 04:08:42,967 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3312.400000 2021-02-19 04:08:43,255 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7103.100000 2021-02-19 04:08:43,428 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3484.400000 2021-02-19 04:08:43,490 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3295.900000 2021-02-19 04:08:43,594 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3486.300000 2021-02-19 04:08:43,780 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6068.600000 2021-02-19 04:08:43,812 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4757.200000 2021-02-19 04:08:43,960 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 88.41 % 2021-02-19 04:08:43,960 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 88.4064220178 2021-02-19 04:08:44,240 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1837.600000 2021-02-19 04:08:44,325 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:44,486 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3467.500000 2021-02-19 04:08:44,595 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3312.400000 2021-02-19 04:08:44,871 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7103.100000 2021-02-19 04:08:45,069 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3484.400000 2021-02-19 04:08:45,117 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3295.900000 2021-02-19 04:08:45,198 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3486.300000 2021-02-19 04:08:45,426 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6068.600000 2021-02-19 04:08:45,446 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4814.800000 2021-02-19 04:08:45,865 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2033.600000 2021-02-19 04:08:45,960 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:46,104 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3467.500000 2021-02-19 04:08:46,210 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3304.300000 2021-02-19 04:08:46,489 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7129.900000 2021-02-19 04:08:46,698 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3480.600000 2021-02-19 04:08:46,756 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3254.900000 2021-02-19 04:08:46,819 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3474.100000 2021-02-19 04:08:47,042 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5998.000000 2021-02-19 04:08:47,072 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4814.800000 2021-02-19 04:08:47,510 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2033.600000 2021-02-19 04:08:47,582 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:47,720 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3453.600000 2021-02-19 04:08:47,825 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3304.300000 2021-02-19 04:08:48,104 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7129.900000 2021-02-19 04:08:48,315 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3480.600000 2021-02-19 04:08:48,365 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3254.900000 2021-02-19 04:08:48,444 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3474.100000 2021-02-19 04:08:48,506 | infra | INFO | pool-2-thread-19 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.28' completed 2021-02-19 04:08:48,506 | infra | INFO | pool-2-thread-19 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:08:48,506 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 22 docs from 0 to 1000000 2021-02-19 04:08:48,569 | infra | INFO | pool-2-thread-45 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.34' completed 2021-02-19 04:08:48,569 | infra | INFO | pool-2-thread-45 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:08:48,691 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5998.000000 2021-02-19 04:08:48,719 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4814.800000 2021-02-19 04:08:49,006 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 88.79 % 2021-02-19 04:08:49,006 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 88.7915226269 2021-02-19 04:08:49,131 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2033.600000 2021-02-19 04:08:49,207 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:49,349 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3453.600000 2021-02-19 04:08:49,473 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3304.300000 2021-02-19 04:08:49,743 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7129.900000 2021-02-19 04:08:49,990 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3254.900000 2021-02-19 04:08:50,026 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3480.600000 2021-02-19 04:08:50,183 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3474.100000 2021-02-19 04:08:50,335 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4814.800000 2021-02-19 04:08:50,342 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5998.000000 2021-02-19 04:08:50,766 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2019.200000 2021-02-19 04:08:50,823 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:50,980 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3453.600000 2021-02-19 04:08:51,078 | infra | INFO | pool-2-thread-40 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.33' completed 2021-02-19 04:08:51,078 | infra | INFO | pool-2-thread-40 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:08:51,085 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3304.300000 2021-02-19 04:08:51,388 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7129.900000 2021-02-19 04:08:51,608 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3254.900000 2021-02-19 04:08:51,647 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3484.400000 2021-02-19 04:08:51,815 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3474.100000 2021-02-19 04:08:51,960 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4814.800000 2021-02-19 04:08:51,997 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5998.000000 2021-02-19 04:08:52,165 | infra | INFO | pool-2-thread-29 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.32' completed 2021-02-19 04:08:52,165 | infra | INFO | pool-2-thread-29 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:08:52,391 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2040.924870 2021-02-19 04:08:52,444 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:52,605 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3503.687645 2021-02-19 04:08:52,710 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3659.295762 2021-02-19 04:08:53,025 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7131.973651 2021-02-19 04:08:53,229 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3227.156537 2021-02-19 04:08:53,273 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3472.242703 2021-02-19 04:08:53,459 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3815.767613 2021-02-19 04:08:53,601 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4774.355778 2021-02-19 04:08:53,661 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5934.014794 2021-02-19 04:08:54,029 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2040.924870 2021-02-19 04:08:54,061 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 89.16 % 2021-02-19 04:08:54,062 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 89.1597058243 2021-02-19 04:08:54,082 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:54,226 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3503.687645 2021-02-19 04:08:54,332 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3659.295762 2021-02-19 04:08:54,651 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7131.973651 2021-02-19 04:08:54,848 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3227.156537 2021-02-19 04:08:54,890 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3472.242703 2021-02-19 04:08:55,076 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3815.767613 2021-02-19 04:08:55,243 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4774.355778 2021-02-19 04:08:55,305 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5934.014794 2021-02-19 04:08:55,644 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2028.924870 2021-02-19 04:08:55,716 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:55,723 | infra | INFO | pool-2-thread-54 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.35' completed 2021-02-19 04:08:55,723 | infra | INFO | pool-2-thread-54 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:08:55,865 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3555.187645 2021-02-19 04:08:55,966 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3659.295762 2021-02-19 04:08:56,313 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6956.273651 2021-02-19 04:08:56,497 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3117.756537 2021-02-19 04:08:56,519 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3418.942703 2021-02-19 04:08:56,681 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4626.167613 2021-02-19 04:08:56,865 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4667.155778 2021-02-19 04:08:56,933 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5850.514794 2021-02-19 04:08:57,308 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2028.924870 2021-02-19 04:08:57,357 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:57,493 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3555.187645 2021-02-19 04:08:57,609 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4488.195762 2021-02-19 04:08:57,657 | infra | INFO | pool-2-thread-32 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.32' completed 2021-02-19 04:08:57,657 | infra | INFO | pool-2-thread-32 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:08:57,908 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 89.45 % 2021-02-19 04:08:57,910 | test | INFO | MainThread | [Magma:abort_rebalance:933] Rebalance % = 89.4495324763 2021-02-19 04:08:57,938 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6956.273651 2021-02-19 04:08:58,141 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3117.756537 2021-02-19 04:08:58,155 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3418.942703 2021-02-19 04:08:58,357 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4626.167613 2021-02-19 04:08:58,516 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4667.155778 2021-02-19 04:08:58,555 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5850.514794 2021-02-19 04:08:58,960 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2028.924870 2021-02-19 04:08:58,969 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:08:59,111 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 89.50 % 2021-02-19 04:08:59,111 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 89.4971412296 2021-02-19 04:08:59,135 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3555.187645 2021-02-19 04:08:59,246 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4488.195762 2021-02-19 04:08:59,558 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6956.273651 2021-02-19 04:08:59,788 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3117.756537 2021-02-19 04:08:59,799 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3338.142703 2021-02-19 04:08:59,992 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4626.167613 2021-02-19 04:09:00,141 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4667.155778 2021-02-19 04:09:00,186 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5850.514794 2021-02-19 04:09:00,627 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:00,628 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1966.524870 2021-02-19 04:09:00,778 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3555.187645 2021-02-19 04:09:00,891 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4488.195762 2021-02-19 04:09:01,194 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6956.273651 2021-02-19 04:09:01,403 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3117.756537 2021-02-19 04:09:01,444 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3338.142703 2021-02-19 04:09:01,618 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4626.167613 2021-02-19 04:09:01,803 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4667.155778 2021-02-19 04:09:01,821 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5850.514794 2021-02-19 04:09:02,262 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1966.524870 2021-02-19 04:09:02,282 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:02,411 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3475.180352 2021-02-19 04:09:02,519 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5749.808884 2021-02-19 04:09:02,819 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6112.388796 2021-02-19 04:09:03,040 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2779.007963 2021-02-19 04:09:03,127 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3297.441016 2021-02-19 04:09:03,236 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5875.332053 2021-02-19 04:09:03,453 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4279.289076 2021-02-19 04:09:03,496 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5500.745298 2021-02-19 04:09:03,940 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:03,950 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1946.367067 2021-02-19 04:09:04,065 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3475.180352 2021-02-19 04:09:04,148 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5749.808884 2021-02-19 04:09:04,173 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 89.90 % 2021-02-19 04:09:04,173 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 89.8982132765 2021-02-19 04:09:04,431 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6112.388796 2021-02-19 04:09:04,663 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2779.007963 2021-02-19 04:09:04,763 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3297.441016 2021-02-19 04:09:04,882 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5875.332053 2021-02-19 04:09:05,105 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4279.289076 2021-02-19 04:09:05,155 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5500.745298 2021-02-19 04:09:05,594 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:05,595 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1883.167067 2021-02-19 04:09:05,707 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3353.280352 2021-02-19 04:09:05,802 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6474.908884 2021-02-19 04:09:06,059 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6112.388796 2021-02-19 04:09:06,305 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2526.607963 2021-02-19 04:09:06,446 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3318.941016 2021-02-19 04:09:06,556 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6598.532053 2021-02-19 04:09:06,767 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3834.689076 2021-02-19 04:09:06,819 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5177.845298 2021-02-19 04:09:07,243 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:07,257 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1883.167067 2021-02-19 04:09:07,338 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3353.280352 2021-02-19 04:09:07,446 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6474.908884 2021-02-19 04:09:07,704 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5267.188796 2021-02-19 04:09:07,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2526.607963 2021-02-19 04:09:08,000 | infra | INFO | pool-2-thread-44 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:09:08,002 | infra | INFO | pool-2-thread-44 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:09:08,082 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3318.941016 2021-02-19 04:09:08,184 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6598.532053 2021-02-19 04:09:08,459 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3834.689076 2021-02-19 04:09:08,483 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5177.845298 2021-02-19 04:09:08,796 | infra | INFO | pool-2-thread-57 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.35' completed 2021-02-19 04:09:08,798 | infra | INFO | pool-2-thread-57 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:09:08,892 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:08,941 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1883.167067 2021-02-19 04:09:09,005 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3353.280352 2021-02-19 04:09:09,085 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6474.908884 2021-02-19 04:09:09,239 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 90.00 % 2021-02-19 04:09:09,239 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 90.0 2021-02-19 04:09:09,323 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5267.188796 2021-02-19 04:09:09,503 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2526.607963 2021-02-19 04:09:09,710 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3352.341016 2021-02-19 04:09:09,798 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6598.532053 2021-02-19 04:09:10,052 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3834.689076 2021-02-19 04:09:10,078 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5177.845298 2021-02-19 04:09:10,522 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:10,553 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1837.567067 2021-02-19 04:09:10,609 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3353.280352 2021-02-19 04:09:10,711 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6474.908884 2021-02-19 04:09:10,921 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5267.188796 2021-02-19 04:09:11,096 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2526.607963 2021-02-19 04:09:11,306 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3352.341016 2021-02-19 04:09:11,388 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6598.532053 2021-02-19 04:09:11,641 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3834.689076 2021-02-19 04:09:11,665 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5177.845298 2021-02-19 04:09:12,114 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:12,158 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1837.567067 2021-02-19 04:09:12,209 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3353.280352 2021-02-19 04:09:12,312 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5794.100000 2021-02-19 04:09:12,510 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4728.700000 2021-02-19 04:09:12,694 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2362.300000 2021-02-19 04:09:12,934 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3263.700000 2021-02-19 04:09:13,006 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5963.000000 2021-02-19 04:09:13,279 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3429.700000 2021-02-19 04:09:13,295 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4699.200000 2021-02-19 04:09:13,723 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:13,802 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1949.100000 2021-02-19 04:09:13,845 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2918.000000 2021-02-19 04:09:13,940 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5794.100000 2021-02-19 04:09:14,111 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4728.700000 2021-02-19 04:09:14,279 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 90.00 % 2021-02-19 04:09:14,279 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 90.0 2021-02-19 04:09:14,328 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2362.300000 2021-02-19 04:09:14,585 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3263.700000 2021-02-19 04:09:14,634 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5963.000000 2021-02-19 04:09:14,921 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4699.200000 2021-02-19 04:09:14,944 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3429.700000 2021-02-19 04:09:15,378 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:15,421 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1924.100000 2021-02-19 04:09:15,463 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2089.200000 2021-02-19 04:09:15,568 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4311.600000 2021-02-19 04:09:15,729 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3704.000000 2021-02-19 04:09:15,979 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2362.300000 2021-02-19 04:09:16,207 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2822.400000 2021-02-19 04:09:16,239 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4487.100000 2021-02-19 04:09:16,526 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3563.000000 2021-02-19 04:09:16,565 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2619.100000 2021-02-19 04:09:16,990 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:17,038 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1815.700000 2021-02-19 04:09:17,086 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2089.200000 2021-02-19 04:09:17,207 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4311.600000 2021-02-19 04:09:17,411 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3704.000000 2021-02-19 04:09:17,614 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1859.900000 2021-02-19 04:09:17,838 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2822.400000 2021-02-19 04:09:17,891 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4487.100000 2021-02-19 04:09:18,148 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3563.000000 2021-02-19 04:09:18,209 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2619.100000 2021-02-19 04:09:18,605 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:18,660 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1815.700000 2021-02-19 04:09:18,729 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2089.200000 2021-02-19 04:09:18,858 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4311.600000 2021-02-19 04:09:19,062 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3704.000000 2021-02-19 04:09:19,253 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1859.900000 2021-02-19 04:09:19,312 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 90.12 % 2021-02-19 04:09:19,312 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 90.1173276086 2021-02-19 04:09:19,467 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2180.700000 2021-02-19 04:09:19,515 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4487.100000 2021-02-19 04:09:19,796 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3563.000000 2021-02-19 04:09:19,842 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2619.100000 2021-02-19 04:09:20,286 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:20,329 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1815.700000 2021-02-19 04:09:20,364 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2089.200000 2021-02-19 04:09:20,469 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4311.600000 2021-02-19 04:09:20,726 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3704.000000 2021-02-19 04:09:20,914 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1859.900000 2021-02-19 04:09:21,095 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2180.700000 2021-02-19 04:09:21,140 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4487.100000 2021-02-19 04:09:21,460 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3563.000000 2021-02-19 04:09:21,464 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2619.100000 2021-02-19 04:09:21,924 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:21,961 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1815.700000 2021-02-19 04:09:21,993 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2089.200000 2021-02-19 04:09:22,115 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4311.600000 2021-02-19 04:09:22,355 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1523.500000 2021-02-19 04:09:22,540 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1677.900000 2021-02-19 04:09:22,721 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1772.500000 2021-02-19 04:09:22,786 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2906.800000 2021-02-19 04:09:23,096 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2718.300000 2021-02-19 04:09:23,112 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1053.400000 2021-02-19 04:09:23,588 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:23,641 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1365.000000 2021-02-19 04:09:23,668 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1810.200000 2021-02-19 04:09:23,792 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2965.600000 2021-02-19 04:09:23,983 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1523.500000 2021-02-19 04:09:24,190 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1677.900000 2021-02-19 04:09:24,378 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 90.26 % 2021-02-19 04:09:24,378 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 90.2607096244 2021-02-19 04:09:24,381 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1772.500000 2021-02-19 04:09:24,453 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2906.800000 2021-02-19 04:09:24,802 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2718.300000 2021-02-19 04:09:24,812 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1053.400000 2021-02-19 04:09:25,232 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:25,318 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1365.000000 2021-02-19 04:09:25,328 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1810.200000 2021-02-19 04:09:25,421 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2965.600000 2021-02-19 04:09:25,663 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 700.700000 2021-02-19 04:09:25,851 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2206.300000 2021-02-19 04:09:26,002 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1772.500000 2021-02-19 04:09:26,095 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2906.800000 2021-02-19 04:09:26,453 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 200.400000 2021-02-19 04:09:26,460 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3210.300000 2021-02-19 04:09:26,884 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:26,957 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1596.800000 2021-02-19 04:09:26,971 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2408.400000 2021-02-19 04:09:27,046 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3369.800000 2021-02-19 04:09:27,292 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 700.700000 2021-02-19 04:09:27,494 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2206.300000 2021-02-19 04:09:27,628 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1987.100000 2021-02-19 04:09:27,726 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3109.600000 2021-02-19 04:09:28,128 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 200.400000 2021-02-19 04:09:28,153 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3210.300000 2021-02-19 04:09:28,506 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:28,619 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1596.800000 2021-02-19 04:09:28,637 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2408.400000 2021-02-19 04:09:28,703 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3369.800000 2021-02-19 04:09:28,943 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 700.700000 2021-02-19 04:09:29,142 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2206.300000 2021-02-19 04:09:29,253 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1987.100000 2021-02-19 04:09:29,359 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3109.600000 2021-02-19 04:09:29,433 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 90.53 % 2021-02-19 04:09:29,434 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 90.5311370687 2021-02-19 04:09:29,750 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 200.400000 2021-02-19 04:09:29,798 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3210.300000 2021-02-19 04:09:30,114 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:30,280 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1596.800000 2021-02-19 04:09:30,298 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2408.400000 2021-02-19 04:09:30,345 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3369.800000 2021-02-19 04:09:30,565 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 700.700000 2021-02-19 04:09:30,769 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2206.300000 2021-02-19 04:09:30,907 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2508.600000 2021-02-19 04:09:31,000 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3109.600000 2021-02-19 04:09:31,420 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 200.400000 2021-02-19 04:09:31,523 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3210.300000 2021-02-19 04:09:31,753 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:31,934 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2408.400000 2021-02-19 04:09:32,010 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1596.800000 2021-02-19 04:09:32,043 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3369.800000 2021-02-19 04:09:32,183 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 700.700000 2021-02-19 04:09:32,414 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2458.000000 2021-02-19 04:09:32,549 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2816.900000 2021-02-19 04:09:32,632 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5099.900000 2021-02-19 04:09:33,072 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1643.200000 2021-02-19 04:09:33,164 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4197.000000 2021-02-19 04:09:33,359 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:33,569 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2958.800000 2021-02-19 04:09:33,651 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2586.100000 2021-02-19 04:09:33,696 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5262.600000 2021-02-19 04:09:33,809 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3217.800000 2021-02-19 04:09:34,066 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2458.000000 2021-02-19 04:09:34,197 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2816.900000 2021-02-19 04:09:34,257 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5099.900000 2021-02-19 04:09:34,483 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 90.90 % 2021-02-19 04:09:34,483 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 90.9026065339 2021-02-19 04:09:34,687 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1643.200000 2021-02-19 04:09:34,773 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4197.000000 2021-02-19 04:09:34,967 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:35,240 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2958.800000 2021-02-19 04:09:35,335 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2586.100000 2021-02-19 04:09:35,338 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5262.600000 2021-02-19 04:09:35,457 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3217.800000 2021-02-19 04:09:35,687 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2313.800000 2021-02-19 04:09:35,849 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2784.500000 2021-02-19 04:09:35,911 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6169.100000 2021-02-19 04:09:36,315 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3154.200000 2021-02-19 04:09:36,401 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4516.000000 2021-02-19 04:09:36,601 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:36,878 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3023.500000 2021-02-19 04:09:36,973 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6253.700000 2021-02-19 04:09:36,974 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3094.400000 2021-02-19 04:09:37,107 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5029.800000 2021-02-19 04:09:37,342 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2313.800000 2021-02-19 04:09:37,526 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2784.500000 2021-02-19 04:09:37,572 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6169.100000 2021-02-19 04:09:37,973 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3154.200000 2021-02-19 04:09:38,026 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4516.000000 2021-02-19 04:09:38,209 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:38,516 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3023.500000 2021-02-19 04:09:38,634 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6253.700000 2021-02-19 04:09:38,664 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3094.400000 2021-02-19 04:09:38,752 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5029.800000 2021-02-19 04:09:38,772 | infra | INFO | pool-2-thread-26 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' completed 2021-02-19 04:09:38,772 | infra | INFO | pool-2-thread-26 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:09:38,979 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2313.800000 2021-02-19 04:09:39,148 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2784.500000 2021-02-19 04:09:39,206 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6169.100000 2021-02-19 04:09:39,552 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 91.27 % 2021-02-19 04:09:39,553 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 91.2707985042 2021-02-19 04:09:39,588 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3154.200000 2021-02-19 04:09:39,647 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4516.000000 2021-02-19 04:09:39,836 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:40,163 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3023.500000 2021-02-19 04:09:40,269 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6253.700000 2021-02-19 04:09:40,338 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3094.400000 2021-02-19 04:09:40,401 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5029.800000 2021-02-19 04:09:40,615 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2313.800000 2021-02-19 04:09:40,789 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2450.900000 2021-02-19 04:09:40,868 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6169.100000 2021-02-19 04:09:41,207 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3154.200000 2021-02-19 04:09:41,279 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4516.000000 2021-02-19 04:09:41,450 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:41,828 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3023.500000 2021-02-19 04:09:41,971 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6253.700000 2021-02-19 04:09:42,013 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3094.400000 2021-02-19 04:09:42,076 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5029.800000 2021-02-19 04:09:42,257 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2313.800000 2021-02-19 04:09:42,440 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2251.300000 2021-02-19 04:09:42,490 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6074.300000 2021-02-19 04:09:42,868 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3451.000000 2021-02-19 04:09:42,933 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4408.300000 2021-02-19 04:09:43,131 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:43,459 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3139.800000 2021-02-19 04:09:43,647 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6122.200000 2021-02-19 04:09:43,676 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2991.300000 2021-02-19 04:09:43,719 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5041.800000 2021-02-19 04:09:43,926 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2285.700000 2021-02-19 04:09:44,072 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2251.300000 2021-02-19 04:09:44,157 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6074.300000 2021-02-19 04:09:44,529 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3451.000000 2021-02-19 04:09:44,555 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4408.300000 2021-02-19 04:09:44,641 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 91.69 % 2021-02-19 04:09:44,641 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 91.6911120294 2021-02-19 04:09:44,760 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:45,115 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3139.800000 2021-02-19 04:09:45,309 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6122.200000 2021-02-19 04:09:45,339 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2991.300000 2021-02-19 04:09:45,372 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5041.800000 2021-02-19 04:09:45,559 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2308.600000 2021-02-19 04:09:45,726 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2041.900000 2021-02-19 04:09:45,795 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6000.400000 2021-02-19 04:09:46,154 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3451.000000 2021-02-19 04:09:46,188 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4408.300000 2021-02-19 04:09:46,401 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:46,769 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3713.100000 2021-02-19 04:09:46,957 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5967.000000 2021-02-19 04:09:47,000 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2966.300000 2021-02-19 04:09:47,006 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5062.700000 2021-02-19 04:09:47,177 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2308.600000 2021-02-19 04:09:47,371 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2041.900000 2021-02-19 04:09:47,436 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6000.400000 2021-02-19 04:09:47,772 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3505.800000 2021-02-19 04:09:47,821 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4387.600000 2021-02-19 04:09:48,006 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:48,450 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3713.100000 2021-02-19 04:09:48,602 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5967.000000 2021-02-19 04:09:48,667 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5062.700000 2021-02-19 04:09:48,673 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2966.300000 2021-02-19 04:09:48,803 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2308.600000 2021-02-19 04:09:49,028 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2041.900000 2021-02-19 04:09:49,078 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6000.400000 2021-02-19 04:09:49,414 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3505.800000 2021-02-19 04:09:49,470 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4387.600000 2021-02-19 04:09:49,628 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:49,713 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 92.05 % 2021-02-19 04:09:49,713 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 92.052799972 2021-02-19 04:09:50,071 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3713.100000 2021-02-19 04:09:50,220 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5967.000000 2021-02-19 04:09:50,305 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5062.700000 2021-02-19 04:09:50,325 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2966.300000 2021-02-19 04:09:50,448 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2308.600000 2021-02-19 04:09:50,667 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1959.600000 2021-02-19 04:09:50,713 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6000.400000 2021-02-19 04:09:51,058 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3505.800000 2021-02-19 04:09:51,092 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4387.600000 2021-02-19 04:09:51,246 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:51,706 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3713.100000 2021-02-19 04:09:51,855 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5967.000000 2021-02-19 04:09:51,963 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5062.700000 2021-02-19 04:09:51,992 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2966.300000 2021-02-19 04:09:52,081 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2308.600000 2021-02-19 04:09:52,305 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2003.200000 2021-02-19 04:09:52,338 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5978.000000 2021-02-19 04:09:52,703 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3524.700000 2021-02-19 04:09:52,740 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4393.500000 2021-02-19 04:09:52,881 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:53,334 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4943.200000 2021-02-19 04:09:53,493 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5885.700000 2021-02-19 04:09:53,592 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4986.500000 2021-02-19 04:09:53,668 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3022.700000 2021-02-19 04:09:53,780 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2297.900000 2021-02-19 04:09:53,950 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2003.200000 2021-02-19 04:09:53,967 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5978.000000 2021-02-19 04:09:54,344 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3524.700000 2021-02-19 04:09:54,390 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4393.500000 2021-02-19 04:09:54,507 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:54,766 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 92.45 % 2021-02-19 04:09:54,766 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 92.4502983633 2021-02-19 04:09:54,976 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4943.200000 2021-02-19 04:09:55,145 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5885.700000 2021-02-19 04:09:55,250 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4986.500000 2021-02-19 04:09:55,309 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3022.700000 2021-02-19 04:09:55,431 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2297.900000 2021-02-19 04:09:55,578 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2150.700000 2021-02-19 04:09:55,622 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6016.800000 2021-02-19 04:09:55,986 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3524.700000 2021-02-19 04:09:56,022 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4393.500000 2021-02-19 04:09:56,153 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:56,586 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5837.400000 2021-02-19 04:09:56,779 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5861.600000 2021-02-19 04:09:56,900 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4942.200000 2021-02-19 04:09:56,960 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3041.600000 2021-02-19 04:09:57,069 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2276.400000 2021-02-19 04:09:57,260 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2150.700000 2021-02-19 04:09:57,298 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6016.800000 2021-02-19 04:09:57,602 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3521.700000 2021-02-19 04:09:57,657 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4338.000000 2021-02-19 04:09:57,806 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:58,200 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5837.400000 2021-02-19 04:09:58,417 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5861.600000 2021-02-19 04:09:58,595 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3041.600000 2021-02-19 04:09:58,601 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4942.200000 2021-02-19 04:09:58,734 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2276.400000 2021-02-19 04:09:58,940 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2150.700000 2021-02-19 04:09:58,999 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6016.800000 2021-02-19 04:09:59,232 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3521.700000 2021-02-19 04:09:59,308 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4338.000000 2021-02-19 04:09:59,436 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:09:59,832 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 92.83 % 2021-02-19 04:09:59,832 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 92.8315239074 2021-02-19 04:09:59,888 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5837.400000 2021-02-19 04:10:00,030 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5861.600000 2021-02-19 04:10:00,230 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3041.600000 2021-02-19 04:10:00,234 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4942.200000 2021-02-19 04:10:00,364 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2276.400000 2021-02-19 04:10:00,608 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2082.700000 2021-02-19 04:10:00,654 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6016.800000 2021-02-19 04:10:00,872 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3521.700000 2021-02-19 04:10:00,941 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4338.000000 2021-02-19 04:10:01,066 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:01,555 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5837.400000 2021-02-19 04:10:01,665 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5861.600000 2021-02-19 04:10:01,848 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3041.600000 2021-02-19 04:10:01,874 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4942.200000 2021-02-19 04:10:02,023 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2276.400000 2021-02-19 04:10:02,246 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2082.700000 2021-02-19 04:10:02,292 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6048.200000 2021-02-19 04:10:02,496 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3522.300000 2021-02-19 04:10:02,598 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4345.200000 2021-02-19 04:10:02,736 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:03,187 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5867.200000 2021-02-19 04:10:03,276 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5835.400000 2021-02-19 04:10:03,510 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3010.900000 2021-02-19 04:10:03,519 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4993.000000 2021-02-19 04:10:03,664 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2330.700000 2021-02-19 04:10:03,885 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2075.300000 2021-02-19 04:10:03,904 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6048.200000 2021-02-19 04:10:04,108 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3522.300000 2021-02-19 04:10:04,246 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4345.200000 2021-02-19 04:10:04,361 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:04,821 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5867.200000 2021-02-19 04:10:04,897 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 93.20 % 2021-02-19 04:10:04,897 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 93.1964766044 2021-02-19 04:10:04,898 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5835.400000 2021-02-19 04:10:05,164 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3010.900000 2021-02-19 04:10:05,193 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4993.000000 2021-02-19 04:10:05,313 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2330.700000 2021-02-19 04:10:05,519 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6011.600000 2021-02-19 04:10:05,542 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2059.900000 2021-02-19 04:10:05,755 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3510.800000 2021-02-19 04:10:05,891 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4336.300000 2021-02-19 04:10:05,990 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:06,453 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5791.600000 2021-02-19 04:10:06,539 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5819.800000 2021-02-19 04:10:06,838 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4934.300000 2021-02-19 04:10:06,884 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2965.800000 2021-02-19 04:10:06,977 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2393.300000 2021-02-19 04:10:07,151 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6011.600000 2021-02-19 04:10:07,180 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2059.900000 2021-02-19 04:10:07,434 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3510.800000 2021-02-19 04:10:07,529 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4336.300000 2021-02-19 04:10:07,619 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:08,115 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5791.600000 2021-02-19 04:10:08,201 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5819.800000 2021-02-19 04:10:08,471 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4934.300000 2021-02-19 04:10:08,513 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2965.800000 2021-02-19 04:10:08,604 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2393.300000 2021-02-19 04:10:08,786 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6011.600000 2021-02-19 04:10:08,821 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2059.900000 2021-02-19 04:10:09,082 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3510.800000 2021-02-19 04:10:09,165 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4336.300000 2021-02-19 04:10:09,230 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:09,746 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5791.600000 2021-02-19 04:10:09,851 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5819.800000 2021-02-19 04:10:09,947 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 93.56 % 2021-02-19 04:10:09,947 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 93.5613910797 2021-02-19 04:10:10,174 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4934.300000 2021-02-19 04:10:10,234 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2965.800000 2021-02-19 04:10:10,332 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2393.300000 2021-02-19 04:10:10,420 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6011.600000 2021-02-19 04:10:10,457 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2031.600000 2021-02-19 04:10:10,709 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3510.800000 2021-02-19 04:10:10,821 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4336.300000 2021-02-19 04:10:10,888 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:11,387 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5791.600000 2021-02-19 04:10:11,470 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5819.800000 2021-02-19 04:10:11,796 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4934.300000 2021-02-19 04:10:11,871 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2965.800000 2021-02-19 04:10:11,963 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2393.300000 2021-02-19 04:10:12,068 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6011.600000 2021-02-19 04:10:12,104 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2031.600000 2021-02-19 04:10:12,322 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3519.500000 2021-02-19 04:10:12,453 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4357.600000 2021-02-19 04:10:12,542 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:12,997 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5811.400000 2021-02-19 04:10:13,108 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5902.700000 2021-02-19 04:10:13,446 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4815.000000 2021-02-19 04:10:13,517 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2989.600000 2021-02-19 04:10:13,625 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2349.900000 2021-02-19 04:10:13,750 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6009.000000 2021-02-19 04:10:13,779 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2091.600000 2021-02-19 04:10:13,934 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3519.500000 2021-02-19 04:10:14,092 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4357.600000 2021-02-19 04:10:14,196 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:14,617 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5811.400000 2021-02-19 04:10:14,770 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5902.700000 2021-02-19 04:10:14,993 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 93.96 % 2021-02-19 04:10:14,994 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 93.9557139004 2021-02-19 04:10:15,128 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4815.000000 2021-02-19 04:10:15,157 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2989.600000 2021-02-19 04:10:15,269 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2349.900000 2021-02-19 04:10:15,407 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6009.000000 2021-02-19 04:10:15,418 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2091.600000 2021-02-19 04:10:15,572 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3557.248786 2021-02-19 04:10:15,732 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4393.067163 2021-02-19 04:10:15,838 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:16,230 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5841.763865 2021-02-19 04:10:16,401 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5938.230709 2021-02-19 04:10:16,789 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4856.171860 2021-02-19 04:10:16,789 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3015.049405 2021-02-19 04:10:16,908 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2292.598361 2021-02-19 04:10:17,045 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2060.266763 2021-02-19 04:10:17,082 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6049.776496 2021-02-19 04:10:17,233 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3557.248786 2021-02-19 04:10:17,375 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4393.067163 2021-02-19 04:10:17,500 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:17,861 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5841.763865 2021-02-19 04:10:18,035 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5938.230709 2021-02-19 04:10:18,433 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3015.049405 2021-02-19 04:10:18,479 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4856.171860 2021-02-19 04:10:18,526 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2292.598361 2021-02-19 04:10:18,674 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2060.266763 2021-02-19 04:10:18,717 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6049.776496 2021-02-19 04:10:18,894 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3557.248786 2021-02-19 04:10:19,035 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4393.067163 2021-02-19 04:10:19,131 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:19,476 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5841.763865 2021-02-19 04:10:19,663 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5938.230709 2021-02-19 04:10:20,040 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 94.35 % 2021-02-19 04:10:20,042 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 94.3532250323 2021-02-19 04:10:20,065 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3015.049405 2021-02-19 04:10:20,173 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4856.171860 2021-02-19 04:10:20,188 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2292.598361 2021-02-19 04:10:20,311 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1987.166763 2021-02-19 04:10:20,391 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6049.776496 2021-02-19 04:10:20,575 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3557.248786 2021-02-19 04:10:20,660 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4393.067163 2021-02-19 04:10:20,755 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:21,098 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5841.763865 2021-02-19 04:10:21,280 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5938.230709 2021-02-19 04:10:21,724 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3015.049405 2021-02-19 04:10:21,826 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2292.598361 2021-02-19 04:10:21,835 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4856.171860 2021-02-19 04:10:21,963 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1987.166763 2021-02-19 04:10:22,032 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6049.776496 2021-02-19 04:10:22,204 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3557.248786 2021-02-19 04:10:22,286 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4352.167163 2021-02-19 04:10:22,387 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:22,736 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5757.063865 2021-02-19 04:10:22,923 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5845.630709 2021-02-19 04:10:23,346 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2951.749405 2021-02-19 04:10:23,480 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2324.498361 2021-02-19 04:10:23,487 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4921.471860 2021-02-19 04:10:23,598 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1932.366763 2021-02-19 04:10:23,677 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6041.676496 2021-02-19 04:10:23,862 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3562.948786 2021-02-19 04:10:23,970 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4352.167163 2021-02-19 04:10:24,028 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:24,364 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5757.063865 2021-02-19 04:10:24,552 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5845.630709 2021-02-19 04:10:24,966 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2951.749405 2021-02-19 04:10:25,125 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2324.498361 2021-02-19 04:10:25,138 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 94.71 % 2021-02-19 04:10:25,138 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 94.7051314148 2021-02-19 04:10:25,151 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4921.471860 2021-02-19 04:10:25,220 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1932.366763 2021-02-19 04:10:25,316 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6041.676496 2021-02-19 04:10:25,512 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3556.821868 2021-02-19 04:10:25,651 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4338.482392 2021-02-19 04:10:25,683 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:25,970 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5757.063865 2021-02-19 04:10:26,165 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5845.630709 2021-02-19 04:10:26,592 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2901.954895 2021-02-19 04:10:26,760 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2335.984332 2021-02-19 04:10:26,809 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4891.956074 2021-02-19 04:10:26,907 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1986.818378 2021-02-19 04:10:26,982 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6003.300480 2021-02-19 04:10:27,125 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3556.821868 2021-02-19 04:10:27,270 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4338.482392 2021-02-19 04:10:27,302 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:27,586 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5701.014729 2021-02-19 04:10:27,776 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5765.712379 2021-02-19 04:10:28,201 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2901.954895 2021-02-19 04:10:28,405 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2335.984332 2021-02-19 04:10:28,447 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4891.956074 2021-02-19 04:10:28,536 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1986.818378 2021-02-19 04:10:28,598 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6003.300480 2021-02-19 04:10:28,762 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3556.821868 2021-02-19 04:10:28,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4338.482392 2021-02-19 04:10:28,957 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:29,224 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5701.014729 2021-02-19 04:10:29,385 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5765.712379 2021-02-19 04:10:29,854 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2901.954895 2021-02-19 04:10:30,056 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2335.984332 2021-02-19 04:10:30,099 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4891.956074 2021-02-19 04:10:30,190 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 95.08 % 2021-02-19 04:10:30,190 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 95.0831049451 2021-02-19 04:10:30,198 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1986.818378 2021-02-19 04:10:30,230 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6003.300480 2021-02-19 04:10:30,404 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3556.821868 2021-02-19 04:10:30,582 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:30,621 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4338.482392 2021-02-19 04:10:30,841 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5701.014729 2021-02-19 04:10:31,039 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5765.712379 2021-02-19 04:10:31,479 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2901.954895 2021-02-19 04:10:31,691 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2335.984332 2021-02-19 04:10:31,776 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4891.956074 2021-02-19 04:10:31,852 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1966.318378 2021-02-19 04:10:31,885 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6003.300480 2021-02-19 04:10:32,046 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3556.821868 2021-02-19 04:10:32,197 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:32,236 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4338.482392 2021-02-19 04:10:32,450 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5829.714729 2021-02-19 04:10:32,719 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5839.612379 2021-02-19 04:10:33,117 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2971.754895 2021-02-19 04:10:33,326 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2286.884332 2021-02-19 04:10:33,447 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4942.856074 2021-02-19 04:10:33,484 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2103.618378 2021-02-19 04:10:33,549 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6048.600480 2021-02-19 04:10:33,684 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3615.521868 2021-02-19 04:10:33,875 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:33,884 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4343.782392 2021-02-19 04:10:34,089 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5829.714729 2021-02-19 04:10:34,339 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5839.612379 2021-02-19 04:10:34,747 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2971.754895 2021-02-19 04:10:34,950 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2286.884332 2021-02-19 04:10:35,099 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4942.856074 2021-02-19 04:10:35,153 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2103.618378 2021-02-19 04:10:35,191 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6048.600480 2021-02-19 04:10:35,240 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 95.47 % 2021-02-19 04:10:35,242 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 95.4676207247 2021-02-19 04:10:35,308 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3615.521868 2021-02-19 04:10:35,496 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:35,555 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4356.094197 2021-02-19 04:10:35,726 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5963.593297 2021-02-19 04:10:35,951 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5921.178889 2021-02-19 04:10:36,358 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3048.163732 2021-02-19 04:10:36,578 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2294.582191 2021-02-19 04:10:36,740 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5005.951176 2021-02-19 04:10:36,795 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2172.442521 2021-02-19 04:10:36,851 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6076.611606 2021-02-19 04:10:36,933 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3665.215508 2021-02-19 04:10:37,127 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:37,210 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4356.094197 2021-02-19 04:10:37,368 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5963.593297 2021-02-19 04:10:37,569 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5921.178889 2021-02-19 04:10:37,967 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3048.163732 2021-02-19 04:10:38,214 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2294.582191 2021-02-19 04:10:38,394 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5005.951176 2021-02-19 04:10:38,437 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2172.442521 2021-02-19 04:10:38,512 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6076.611606 2021-02-19 04:10:38,575 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3665.215508 2021-02-19 04:10:38,744 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:38,855 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4356.094197 2021-02-19 04:10:38,990 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5963.593297 2021-02-19 04:10:39,191 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5921.178889 2021-02-19 04:10:39,601 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3048.163732 2021-02-19 04:10:39,845 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2294.582191 2021-02-19 04:10:40,039 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5005.951176 2021-02-19 04:10:40,082 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2172.442521 2021-02-19 04:10:40,163 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6076.611606 2021-02-19 04:10:40,211 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3665.215508 2021-02-19 04:10:40,288 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 95.81 % 2021-02-19 04:10:40,289 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 95.8129848579 2021-02-19 04:10:40,403 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:40,538 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4356.094197 2021-02-19 04:10:40,628 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5963.593297 2021-02-19 04:10:40,815 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5921.178889 2021-02-19 04:10:41,255 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3048.163732 2021-02-19 04:10:41,503 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2294.582191 2021-02-19 04:10:41,693 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5005.951176 2021-02-19 04:10:41,736 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2085.542521 2021-02-19 04:10:41,809 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6076.611606 2021-02-19 04:10:41,878 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3665.215508 2021-02-19 04:10:42,026 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:42,163 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4356.094197 2021-02-19 04:10:42,253 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5963.593297 2021-02-19 04:10:42,447 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5978.978889 2021-02-19 04:10:42,872 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3079.263732 2021-02-19 04:10:43,112 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2370.782191 2021-02-19 04:10:43,338 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5012.851176 2021-02-19 04:10:43,414 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1983.742521 2021-02-19 04:10:43,460 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6049.011606 2021-02-19 04:10:43,526 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3631.215508 2021-02-19 04:10:43,664 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:43,857 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4332.994197 2021-02-19 04:10:43,928 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5975.493297 2021-02-19 04:10:44,096 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5978.978889 2021-02-19 04:10:44,489 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3079.263732 2021-02-19 04:10:44,747 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2370.782191 2021-02-19 04:10:45,039 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5012.851176 2021-02-19 04:10:45,111 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6049.011606 2021-02-19 04:10:45,176 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3631.215508 2021-02-19 04:10:45,183 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1983.742521 2021-02-19 04:10:45,351 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 96.16 % 2021-02-19 04:10:45,351 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 96.1616137455 2021-02-19 04:10:45,372 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:45,528 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4287.742344 2021-02-19 04:10:45,576 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5940.886424 2021-02-19 04:10:45,750 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6030.682931 2021-02-19 04:10:46,150 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3079.263732 2021-02-19 04:10:46,378 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2402.846396 2021-02-19 04:10:46,673 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4980.254442 2021-02-19 04:10:46,757 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6064.430465 2021-02-19 04:10:46,819 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3609.543182 2021-02-19 04:10:46,834 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1890.275165 2021-02-19 04:10:47,016 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:47,161 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4287.742344 2021-02-19 04:10:47,213 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5940.886424 2021-02-19 04:10:47,404 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6030.682931 2021-02-19 04:10:47,796 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3102.808185 2021-02-19 04:10:48,032 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2402.846396 2021-02-19 04:10:48,332 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4980.254442 2021-02-19 04:10:48,395 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6064.430465 2021-02-19 04:10:48,489 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3609.543182 2021-02-19 04:10:48,500 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1890.275165 2021-02-19 04:10:48,665 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:48,795 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4287.742344 2021-02-19 04:10:48,844 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5940.886424 2021-02-19 04:10:49,040 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6030.682931 2021-02-19 04:10:49,417 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3102.808185 2021-02-19 04:10:49,661 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2402.846396 2021-02-19 04:10:50,016 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4980.254442 2021-02-19 04:10:50,058 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6064.430465 2021-02-19 04:10:50,121 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3609.543182 2021-02-19 04:10:50,132 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1890.275165 2021-02-19 04:10:50,298 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:50,431 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 96.53 % 2021-02-19 04:10:50,433 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4287.742344 2021-02-19 04:10:50,433 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 96.5298184563 2021-02-19 04:10:50,480 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5940.886424 2021-02-19 04:10:50,677 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6030.682931 2021-02-19 04:10:51,063 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3102.808185 2021-02-19 04:10:51,345 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2402.846396 2021-02-19 04:10:51,713 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4980.254442 2021-02-19 04:10:51,763 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6064.430465 2021-02-19 04:10:51,792 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3609.543182 2021-02-19 04:10:51,795 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1850.275165 2021-02-19 04:10:51,983 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:52,072 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4287.742344 2021-02-19 04:10:52,161 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5940.886424 2021-02-19 04:10:52,302 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5664.982931 2021-02-19 04:10:52,724 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.208185 2021-02-19 04:10:52,979 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2407.846396 2021-02-19 04:10:53,365 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4859.454442 2021-02-19 04:10:53,414 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5828.130465 2021-02-19 04:10:53,486 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1884.775165 2021-02-19 04:10:53,490 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3556.243182 2021-02-19 04:10:53,604 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:53,720 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4248.742344 2021-02-19 04:10:53,783 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5565.686424 2021-02-19 04:10:53,914 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5664.982931 2021-02-19 04:10:54,351 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.208185 2021-02-19 04:10:54,592 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2407.846396 2021-02-19 04:10:55,081 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4859.454442 2021-02-19 04:10:55,088 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5828.130465 2021-02-19 04:10:55,200 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3556.243182 2021-02-19 04:10:55,221 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1884.775165 2021-02-19 04:10:55,288 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:55,355 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4248.742344 2021-02-19 04:10:55,421 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5565.686424 2021-02-19 04:10:55,483 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 96.91 % 2021-02-19 04:10:55,483 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 96.9110694815 2021-02-19 04:10:55,565 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5245.590090 2021-02-19 04:10:56,005 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2668.711512 2021-02-19 04:10:56,275 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2407.846396 2021-02-19 04:10:56,726 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4797.908208 2021-02-19 04:10:56,772 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5491.101602 2021-02-19 04:10:56,900 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3453.907007 2021-02-19 04:10:56,918 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1927.133934 2021-02-19 04:10:56,957 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:57,002 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4191.085485 2021-02-19 04:10:57,075 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5144.630931 2021-02-19 04:10:57,184 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5245.590090 2021-02-19 04:10:57,671 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2668.711512 2021-02-19 04:10:57,917 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2406.194795 2021-02-19 04:10:58,361 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4797.908208 2021-02-19 04:10:58,438 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5491.101602 2021-02-19 04:10:58,529 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3453.907007 2021-02-19 04:10:58,572 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:10:58,653 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1927.133934 2021-02-19 04:10:58,680 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4191.085485 2021-02-19 04:10:58,746 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5144.630931 2021-02-19 04:10:58,812 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5245.590090 2021-02-19 04:10:59,316 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2668.711512 2021-02-19 04:10:59,542 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2406.194795 2021-02-19 04:11:00,015 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4797.908208 2021-02-19 04:11:00,075 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5491.101602 2021-02-19 04:11:00,230 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3453.907007 2021-02-19 04:11:00,247 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:00,311 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1867.933934 2021-02-19 04:11:00,374 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4191.085485 2021-02-19 04:11:00,414 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5144.630931 2021-02-19 04:11:00,461 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5245.590090 2021-02-19 04:11:00,558 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 97.31 % 2021-02-19 04:11:00,558 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 97.3118453678 2021-02-19 04:11:00,923 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2668.711512 2021-02-19 04:11:01,153 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2406.194795 2021-02-19 04:11:01,654 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4797.908208 2021-02-19 04:11:01,710 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5491.101602 2021-02-19 04:11:01,898 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:01,915 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3453.907007 2021-02-19 04:11:01,970 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1867.933934 2021-02-19 04:11:02,043 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4191.085485 2021-02-19 04:11:02,078 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5144.630931 2021-02-19 04:11:02,108 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5245.590090 2021-02-19 04:11:02,542 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2639.611512 2021-02-19 04:11:02,753 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2337.794795 2021-02-19 04:11:03,286 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4733.808208 2021-02-19 04:11:03,362 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5390.001602 2021-02-19 04:11:03,569 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:03,592 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3399.807007 2021-02-19 04:11:03,638 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1876.533934 2021-02-19 04:11:03,703 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4195.185485 2021-02-19 04:11:03,732 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5072.130931 2021-02-19 04:11:03,756 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5202.090090 2021-02-19 04:11:04,203 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2639.611512 2021-02-19 04:11:04,371 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2337.794795 2021-02-19 04:11:04,948 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4733.808208 2021-02-19 04:11:05,022 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5390.001602 2021-02-19 04:11:05,227 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:05,269 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3399.807007 2021-02-19 04:11:05,286 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1876.533934 2021-02-19 04:11:05,375 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4195.185485 2021-02-19 04:11:05,404 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5072.130931 2021-02-19 04:11:05,430 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5202.090090 2021-02-19 04:11:05,632 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 97.63 % 2021-02-19 04:11:05,632 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 97.6279667827 2021-02-19 04:11:05,829 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2701.400000 2021-02-19 04:11:06,002 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2337.794795 2021-02-19 04:11:06,611 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4686.200000 2021-02-19 04:11:06,687 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5476.200000 2021-02-19 04:11:06,927 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:06,940 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3415.900000 2021-02-19 04:11:06,993 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1947.600000 2021-02-19 04:11:07,055 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4218.400000 2021-02-19 04:11:07,075 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5308.800000 2021-02-19 04:11:07,078 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5192.100000 2021-02-19 04:11:07,506 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2701.400000 2021-02-19 04:11:07,611 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2262.100000 2021-02-19 04:11:08,260 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4686.200000 2021-02-19 04:11:08,315 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5476.200000 2021-02-19 04:11:08,595 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:08,627 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3415.900000 2021-02-19 04:11:08,660 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1947.600000 2021-02-19 04:11:08,750 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5308.800000 2021-02-19 04:11:08,759 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4218.400000 2021-02-19 04:11:08,776 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5192.100000 2021-02-19 04:11:09,124 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2701.400000 2021-02-19 04:11:09,227 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2262.100000 2021-02-19 04:11:09,871 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4686.200000 2021-02-19 04:11:09,957 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5476.200000 2021-02-19 04:11:10,255 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:10,296 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3415.900000 2021-02-19 04:11:10,312 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1917.600000 2021-02-19 04:11:10,444 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5192.100000 2021-02-19 04:11:10,457 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4218.400000 2021-02-19 04:11:10,461 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5308.800000 2021-02-19 04:11:10,704 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 97.99 % 2021-02-19 04:11:10,706 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 97.9928939985 2021-02-19 04:11:10,753 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2701.400000 2021-02-19 04:11:10,934 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2262.100000 2021-02-19 04:11:11,487 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4686.200000 2021-02-19 04:11:11,621 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5476.200000 2021-02-19 04:11:11,887 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:11,947 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3415.900000 2021-02-19 04:11:11,996 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1917.600000 2021-02-19 04:11:12,128 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5192.100000 2021-02-19 04:11:12,140 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4218.400000 2021-02-19 04:11:12,184 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5308.800000 2021-02-19 04:11:12,368 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2819.200000 2021-02-19 04:11:12,569 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2277.900000 2021-02-19 04:11:13,138 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4797.700000 2021-02-19 04:11:13,296 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5690.800000 2021-02-19 04:11:13,509 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:13,596 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3447.600000 2021-02-19 04:11:13,637 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2073.500000 2021-02-19 04:11:13,792 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4312.000000 2021-02-19 04:11:13,805 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5480.400000 2021-02-19 04:11:13,813 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5575.600000 2021-02-19 04:11:14,009 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2819.200000 2021-02-19 04:11:14,188 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2277.900000 2021-02-19 04:11:14,776 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4797.700000 2021-02-19 04:11:14,937 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5690.800000 2021-02-19 04:11:15,170 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:15,267 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3447.600000 2021-02-19 04:11:15,397 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2073.500000 2021-02-19 04:11:15,473 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4363.376084 2021-02-19 04:11:15,499 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5765.375233 2021-02-19 04:11:15,512 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5654.407398 2021-02-19 04:11:15,641 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.408760 2021-02-19 04:11:15,760 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 98.39 % 2021-02-19 04:11:15,762 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 98.3904306115 2021-02-19 04:11:15,818 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2353.213855 2021-02-19 04:11:16,400 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4818.719782 2021-02-19 04:11:16,586 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5773.757834 2021-02-19 04:11:16,839 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:16,960 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3482.333617 2021-02-19 04:11:17,148 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2121.948794 2021-02-19 04:11:17,167 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5654.407398 2021-02-19 04:11:17,168 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5765.375233 2021-02-19 04:11:17,194 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4363.376084 2021-02-19 04:11:17,309 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.408760 2021-02-19 04:11:17,483 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2353.213855 2021-02-19 04:11:18,038 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4818.719782 2021-02-19 04:11:18,246 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5773.757834 2021-02-19 04:11:18,443 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:18,585 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3482.333617 2021-02-19 04:11:18,834 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2121.948794 2021-02-19 04:11:18,834 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5765.375233 2021-02-19 04:11:18,858 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4363.376084 2021-02-19 04:11:18,868 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5654.407398 2021-02-19 04:11:18,967 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.408760 2021-02-19 04:11:19,115 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2353.213855 2021-02-19 04:11:19,671 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4818.719782 2021-02-19 04:11:19,885 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5773.757834 2021-02-19 04:11:20,098 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:20,230 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3482.333617 2021-02-19 04:11:20,535 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5654.407398 2021-02-19 04:11:20,601 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4363.376084 2021-02-19 04:11:20,602 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5765.375233 2021-02-19 04:11:20,608 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2078.848794 2021-02-19 04:11:20,638 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.408760 2021-02-19 04:11:20,766 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2353.213855 2021-02-19 04:11:20,816 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 98.74 % 2021-02-19 04:11:20,816 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 98.7390722396 2021-02-19 04:11:21,323 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4818.719782 2021-02-19 04:11:21,516 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5773.757834 2021-02-19 04:11:21,729 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:21,871 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3482.333617 2021-02-19 04:11:22,181 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5654.407398 2021-02-19 04:11:22,259 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5765.375233 2021-02-19 04:11:22,280 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2078.848794 2021-02-19 04:11:22,302 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4363.376084 2021-02-19 04:11:22,315 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2881.108760 2021-02-19 04:11:22,382 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2387.913855 2021-02-19 04:11:22,957 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4744.419782 2021-02-19 04:11:23,153 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5637.357834 2021-02-19 04:11:23,345 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:23,507 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3609.633617 2021-02-19 04:11:23,822 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5534.107398 2021-02-19 04:11:23,986 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4253.276084 2021-02-19 04:11:24,006 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2881.108760 2021-02-19 04:11:24,007 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2020.948794 2021-02-19 04:11:24,007 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5670.275233 2021-02-19 04:11:24,038 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2387.913855 2021-02-19 04:11:24,608 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4744.419782 2021-02-19 04:11:24,786 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5637.357834 2021-02-19 04:11:24,963 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:25,145 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3609.633617 2021-02-19 04:11:25,453 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5426.467552 2021-02-19 04:11:25,658 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4260.882013 2021-02-19 04:11:25,680 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5612.123050 2021-02-19 04:11:25,696 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2831.663018 2021-02-19 04:11:25,706 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2373.366174 2021-02-19 04:11:25,709 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2013.969590 2021-02-19 04:11:25,881 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 99.08 % 2021-02-19 04:11:25,881 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 99.0779832699 2021-02-19 04:11:26,236 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4744.419782 2021-02-19 04:11:26,433 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5547.185239 2021-02-19 04:11:26,582 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:26,783 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3657.153041 2021-02-19 04:11:27,092 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5426.467552 2021-02-19 04:11:27,319 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4260.882013 2021-02-19 04:11:27,364 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5612.123050 2021-02-19 04:11:27,375 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2831.663018 2021-02-19 04:11:27,382 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2013.969590 2021-02-19 04:11:27,405 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2373.366174 2021-02-19 04:11:27,848 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4732.619235 2021-02-19 04:11:28,062 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5547.185239 2021-02-19 04:11:28,217 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:28,407 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3657.153041 2021-02-19 04:11:28,729 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5426.467552 2021-02-19 04:11:28,957 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4260.882013 2021-02-19 04:11:29,045 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5612.123050 2021-02-19 04:11:29,062 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2831.663018 2021-02-19 04:11:29,082 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2373.366174 2021-02-19 04:11:29,105 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2013.969590 2021-02-19 04:11:29,471 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4732.619235 2021-02-19 04:11:29,680 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5547.185239 2021-02-19 04:11:29,836 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:30,036 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3657.153041 2021-02-19 04:11:30,358 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5426.467552 2021-02-19 04:11:30,592 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4260.882013 2021-02-19 04:11:30,696 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5612.123050 2021-02-19 04:11:30,763 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2831.663018 2021-02-19 04:11:30,767 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2373.366174 2021-02-19 04:11:30,786 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1954.669590 2021-02-19 04:11:30,943 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 99.48 % 2021-02-19 04:11:30,944 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 99.4754689207 2021-02-19 04:11:31,098 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4732.619235 2021-02-19 04:11:31,371 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5547.185239 2021-02-19 04:11:31,451 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:31,678 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3657.153041 2021-02-19 04:11:31,983 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5426.467552 2021-02-19 04:11:32,230 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4260.882013 2021-02-19 04:11:32,388 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5812.023050 2021-02-19 04:11:32,414 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2913.763018 2021-02-19 04:11:32,424 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1932.469590 2021-02-19 04:11:32,474 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2362.366174 2021-02-19 04:11:32,740 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4855.719235 2021-02-19 04:11:33,000 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5731.685239 2021-02-19 04:11:33,066 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:33,311 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3616.353041 2021-02-19 04:11:33,607 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5603.467552 2021-02-19 04:11:33,858 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4364.382013 2021-02-19 04:11:34,065 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5812.023050 2021-02-19 04:11:34,088 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1932.469590 2021-02-19 04:11:34,138 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2913.763018 2021-02-19 04:11:34,197 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2362.366174 2021-02-19 04:11:34,358 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4855.719235 2021-02-19 04:11:34,621 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5731.685239 2021-02-19 04:11:34,717 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:34,931 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3616.353041 2021-02-19 04:11:35,220 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5603.467552 2021-02-19 04:11:35,479 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4367.421939 2021-02-19 04:11:35,694 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5913.108361 2021-02-19 04:11:35,772 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1923.819165 2021-02-19 04:11:35,818 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2989.335226 2021-02-19 04:11:35,835 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2351.119205 2021-02-19 04:11:35,964 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4975.736788 2021-02-19 04:11:36,009 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 99.86 % 2021-02-19 04:11:36,009 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 99.8599464787 2021-02-19 04:11:36,253 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5731.685239 2021-02-19 04:11:36,392 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:36,582 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3634.370381 2021-02-19 04:11:36,878 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5742.012556 2021-02-19 04:11:37,148 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4367.421939 2021-02-19 04:11:37,368 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5913.108361 2021-02-19 04:11:37,463 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1923.819165 2021-02-19 04:11:37,494 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2989.335226 2021-02-19 04:11:37,496 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2351.119205 2021-02-19 04:11:37,630 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4975.736788 2021-02-19 04:11:37,898 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5877.704586 2021-02-19 04:11:38,013 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:38,201 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3634.370381 2021-02-19 04:11:38,526 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5742.012556 2021-02-19 04:11:38,778 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4367.421939 2021-02-19 04:11:38,982 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5913.108361 2021-02-19 04:11:39,081 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1923.819165 2021-02-19 04:11:39,121 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2989.335226 2021-02-19 04:11:39,151 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2351.119205 2021-02-19 04:11:39,266 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4975.736788 2021-02-19 04:11:39,568 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5877.704586 2021-02-19 04:11:39,674 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:39,865 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3634.370381 2021-02-19 04:11:40,164 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5742.012556 2021-02-19 04:11:40,405 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4367.421939 2021-02-19 04:11:40,624 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5913.108361 2021-02-19 04:11:40,749 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1881.019165 2021-02-19 04:11:40,782 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2989.335226 2021-02-19 04:11:40,809 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2351.119205 2021-02-19 04:11:40,933 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4975.736788 2021-02-19 04:11:41,062 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 100.00 % 2021-02-19 04:11:41,062 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 100 2021-02-19 04:11:41,198 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5877.704586 2021-02-19 04:11:41,302 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:41,484 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3634.370381 2021-02-19 04:11:41,786 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5742.012556 2021-02-19 04:11:42,049 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4367.421939 2021-02-19 04:11:42,255 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5913.108361 2021-02-19 04:11:42,424 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2282.819165 2021-02-19 04:11:42,467 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2956.935226 2021-02-19 04:11:42,473 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2304.219205 2021-02-19 04:11:42,595 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4974.636788 2021-02-19 04:11:42,878 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5870.704586 2021-02-19 04:11:42,957 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:43,131 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3560.170381 2021-02-19 04:11:43,433 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5722.512556 2021-02-19 04:11:43,674 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4304.721939 2021-02-19 04:11:43,891 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5854.008361 2021-02-19 04:11:44,154 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2282.819165 2021-02-19 04:11:44,161 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2956.935226 2021-02-19 04:11:44,187 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2304.219205 2021-02-19 04:11:44,234 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4974.636788 2021-02-19 04:11:44,532 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5870.704586 2021-02-19 04:11:44,585 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:44,783 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3560.170381 2021-02-19 04:11:45,134 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5722.512556 2021-02-19 04:11:45,319 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4304.721939 2021-02-19 04:11:45,561 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5868.761313 2021-02-19 04:11:45,823 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2806.592249 2021-02-19 04:11:45,829 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2945.774778 2021-02-19 04:11:45,875 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2270.951114 2021-02-19 04:11:45,905 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4973.961922 2021-02-19 04:11:46,115 | test | DEBUG | pool-1-thread-28 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 100.00 % 2021-02-19 04:11:46,117 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: running, progress: 100 2021-02-19 04:11:46,200 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5870.704586 2021-02-19 04:11:46,282 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:46,436 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3468.395245 2021-02-19 04:11:46,763 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5774.001968 2021-02-19 04:11:46,934 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4263.157926 2021-02-19 04:11:47,197 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5868.761313 2021-02-19 04:11:47,480 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2945.774778 2021-02-19 04:11:47,500 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2806.592249 2021-02-19 04:11:47,526 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2270.951114 2021-02-19 04:11:47,553 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4973.961922 2021-02-19 04:11:47,825 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5948.495165 2021-02-19 04:11:47,917 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:48,065 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3468.395245 2021-02-19 04:11:48,407 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5774.001968 2021-02-19 04:11:48,551 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4263.157926 2021-02-19 04:11:48,821 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5868.761313 2021-02-19 04:11:49,131 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2945.774778 2021-02-19 04:11:49,167 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2773.592249 2021-02-19 04:11:49,197 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4973.961922 2021-02-19 04:11:49,233 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2270.951114 2021-02-19 04:11:49,489 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5948.495165 2021-02-19 04:11:49,568 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:49,707 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3468.395245 2021-02-19 04:11:50,039 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5774.001968 2021-02-19 04:11:50,121 | infra | INFO | pool-2-thread-46 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' completed 2021-02-19 04:11:50,122 | infra | INFO | pool-2-thread-46 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:11:50,170 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4263.157926 2021-02-19 04:11:50,486 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5868.761313 2021-02-19 04:11:50,801 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2945.774778 2021-02-19 04:11:50,845 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2773.592249 2021-02-19 04:11:50,888 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4973.961922 2021-02-19 04:11:50,904 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2270.951114 2021-02-19 04:11:51,121 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5948.495165 2021-02-19 04:11:51,219 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:51,404 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3468.395245 2021-02-19 04:11:51,677 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5774.001968 2021-02-19 04:11:51,793 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4263.157926 2021-02-19 04:11:52,105 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5868.761313 2021-02-19 04:11:52,533 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2882.374778 2021-02-19 04:11:52,540 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2984.392249 2021-02-19 04:11:52,589 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4856.261922 2021-02-19 04:11:52,618 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2269.851114 2021-02-19 04:11:52,756 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5941.095165 2021-02-19 04:11:52,865 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:53,072 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3439.495245 2021-02-19 04:11:53,315 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5667.801968 2021-02-19 04:11:53,426 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4263.157926 2021-02-19 04:11:53,730 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5668.261313 2021-02-19 04:11:54,201 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2882.374778 2021-02-19 04:11:54,213 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2984.392249 2021-02-19 04:11:54,246 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4856.261922 2021-02-19 04:11:54,279 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2269.851114 2021-02-19 04:11:54,408 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5941.095165 2021-02-19 04:11:54,516 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:54,714 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3439.495245 2021-02-19 04:11:54,951 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5667.801968 2021-02-19 04:11:55,086 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4263.157926 2021-02-19 04:11:55,391 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5668.261313 2021-02-19 04:11:55,890 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2726.053269 2021-02-19 04:11:55,904 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3024.051377 2021-02-19 04:11:55,914 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4663.626179 2021-02-19 04:11:55,928 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2258.136000 2021-02-19 04:11:56,091 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5780.728431 2021-02-19 04:11:56,186 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:56,220 | test | INFO | pool-1-thread-28 | [task:check:330] Rebalance - status: none, progress: 100 2021-02-19 04:11:56,362 | test | INFO | pool-1-thread-28 | [task:check:389] Rebalance completed with progress: 100% in 298.411999941 sec 2021-02-19 04:11:56,364 | infra | INFO | pool-1-thread-28 | [task:complete_task:99] Thread 'Rebalance_task_IN=[]_OUT=[172.23.110.69]_1613736417.84' completed 2021-02-19 04:11:56,371 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3369.127350 2021-02-19 04:11:56,539 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 4271.551306437081, u'diskFetches': 0, u'dataUsed': 4150957553L, u'itemCount': 5100093, u'quotaPercentUsed': 9.672141417534354, u'storageTotals': {u'hdd': {u'usedByData': 126580345530L, u'used': 249283047586L, u'quotaTotal': 23983873327104L, u'total': 23983873327104L, u'free': 23734590279518L}, u'ram': {u'usedByData': 41014657280L, u'used': 185507053568L, u'quotaTotal': 388663083008L, u'total': 540075327488L, u'quotaUsed': 388434493440L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 11206066193L, u'vbActiveNumNonResident': 0, u'memUsed': 3756993352L} 2021-02-19 04:11:56,543 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 2258.135999599559, u'diskFetches': 0, u'dataUsed': 3181313261L, u'itemCount': 3919083, u'quotaPercentUsed': 7.712047788214058, u'storageTotals': {u'hdd': {u'usedByData': 126580345530L, u'used': 249283047586L, u'quotaTotal': 23983873327104L, u'total': 23983873327104L, u'free': 23734590279518L}, u'ram': {u'usedByData': 41014657280L, u'used': 185507053568L, u'quotaTotal': 388663083008L, u'total': 540075327488L, u'quotaUsed': 388434493440L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 7195056188L, u'vbActiveNumNonResident': 0, u'memUsed': 2995625376L} 2021-02-19 04:11:56,546 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 3369.127350085094, u'diskFetches': 0, u'dataUsed': 6031076046L, u'itemCount': 7483328, u'quotaPercentUsed': 13.86370436958072, u'storageTotals': {u'hdd': {u'usedByData': 126580345530L, u'used': 249283047586L, u'quotaTotal': 23983873327104L, u'total': 23983873327104L, u'free': 23734590279518L}, u'ram': {u'usedByData': 41014657280L, u'used': 185507053568L, u'quotaTotal': 388663083008L, u'total': 540075327488L, u'quotaUsed': 388434493440L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 20410199484L, u'vbActiveNumNonResident': 0, u'memUsed': 5385140984L} 2021-02-19 04:11:56,549 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 0, u'diskFetches': 0, u'dataUsed': 6044501732L, u'itemCount': 6360723, u'quotaPercentUsed': 13.01801630235776, u'storageTotals': {u'hdd': {u'usedByData': 126580345530L, u'used': 249283047586L, u'quotaTotal': 23983873327104L, u'total': 23983873327104L, u'free': 23734590279518L}, u'ram': {u'usedByData': 41014657280L, u'used': 185507053568L, u'quotaTotal': 388663083008L, u'total': 540075327488L, u'quotaUsed': 388434493440L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 19351576012L, u'vbActiveNumNonResident': 0, u'memUsed': 5056646568L} 2021-02-19 04:11:56,552 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 5430.136600260286, u'diskFetches': 0, u'dataUsed': 5352754023L, u'itemCount': 6816284, u'quotaPercentUsed': 12.7908694513698, u'storageTotals': {u'hdd': {u'usedByData': 126580345530L, u'used': 249283047586L, u'quotaTotal': 23983873327104L, u'total': 23983873327104L, u'free': 23734590279518L}, u'ram': {u'usedByData': 41014657280L, u'used': 185507053568L, u'quotaTotal': 388663083008L, u'total': 540075327488L, u'quotaUsed': 388434493440L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 14377192321L, u'vbActiveNumNonResident': 0, u'memUsed': 4968414896L} 2021-02-19 04:11:56,555 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 4663.626178796676, u'diskFetches': 0, u'dataUsed': 6264936238L, u'itemCount': 7805295, u'quotaPercentUsed': 14.48130457772767, u'storageTotals': {u'hdd': {u'usedByData': 126580345530L, u'used': 249283047586L, u'quotaTotal': 23983873327104L, u'total': 23983873327104L, u'free': 23734590279518L}, u'ram': {u'usedByData': 41014657280L, u'used': 185507053568L, u'quotaTotal': 388663083008L, u'total': 540075327488L, u'quotaUsed': 388434493440L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 16752377696L, u'vbActiveNumNonResident': 0, u'memUsed': 5625038208L} 2021-02-19 04:11:56,556 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 5780.728431274401, u'diskFetches': 0, u'dataUsed': 4420895929L, u'itemCount': 5670634, u'quotaPercentUsed': 10.76016439988384, u'storageTotals': {u'hdd': {u'usedByData': 126580345530L, u'used': 249283047586L, u'quotaTotal': 23983873327104L, u'total': 23983873327104L, u'free': 23734590279518L}, u'ram': {u'usedByData': 41014657280L, u'used': 185507053568L, u'quotaTotal': 388663083008L, u'total': 540075327488L, u'quotaUsed': 388434493440L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 10765062531L, u'vbActiveNumNonResident': 0, u'memUsed': 4179619008L} 2021-02-19 04:11:56,562 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 5302.736610271299, u'diskFetches': 0, u'dataUsed': 2560406213L, u'itemCount': 2664483, u'quotaPercentUsed': 5.441547431282626, u'storageTotals': {u'hdd': {u'usedByData': 126580345530L, u'used': 249283047586L, u'quotaTotal': 23983873327104L, u'total': 23983873327104L, u'free': 23734590279518L}, u'ram': {u'usedByData': 41014657280L, u'used': 185507053568L, u'quotaTotal': 388663083008L, u'total': 540075327488L, u'quotaUsed': 388434493440L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 7014907410L, u'vbActiveNumNonResident': 0, u'memUsed': 2113684720} 2021-02-19 04:11:56,565 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 2726.053268595455, u'diskFetches': 0, u'dataUsed': 4176540148L, u'itemCount': 5030513, u'quotaPercentUsed': 9.543405991498549, u'storageTotals': {u'hdd': {u'usedByData': 126580345530L, u'used': 249283047586L, u'quotaTotal': 23983873327104L, u'total': 23983873327104L, u'free': 23734590279518L}, u'ram': {u'usedByData': 41014657280L, u'used': 185507053568L, u'quotaTotal': 388663083008L, u'total': 540075327488L, u'quotaUsed': 388434493440L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 9578907134L, u'vbActiveNumNonResident': 0, u'memUsed': 3706988072L} 2021-02-19 04:11:56,566 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 3024.051376514165, u'diskFetches': 0, u'dataUsed': 3635852308L, u'itemCount': 4331007, u'quotaPercentUsed': 8.306435577916528, u'storageTotals': {u'hdd': {u'usedByData': 126580345530L, u'used': 249283047586L, u'quotaTotal': 23983873327104L, u'total': 23983873327104L, u'free': 23734590279518L}, u'ram': {u'usedByData': 41014657280L, u'used': 185507053568L, u'quotaTotal': 388663083008L, u'total': 540075327488L, u'quotaUsed': 388434493440L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 9929000561L, u'vbActiveNumNonResident': 0, u'memUsed': 3226506096L} 2021-02-19 04:11:56,568 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +-----------------+-----------+----------+------------+-----+---------+-------------+------------+-------------+ | Bucket | Type | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | +-----------------+-----------+----------+------------+-----+---------+-------------+------------+-------------+ | GleamBookUsers0 | couchbase | 1 | none | 0 | 5100093 | 38843449344 | 3756993352 | 11206066193 | | GleamBookUsers1 | couchbase | 1 | none | 0 | 3919083 | 38843449344 | 2995625376 | 7195056188 | | GleamBookUsers2 | couchbase | 1 | none | 0 | 7483328 | 38843449344 | 5385140984 | 20410199484 | | GleamBookUsers3 | couchbase | 1 | none | 0 | 6360723 | 38843449344 | 5056646568 | 19351576012 | | GleamBookUsers4 | couchbase | 1 | none | 0 | 6816284 | 38843449344 | 4968414896 | 14377192321 | | GleamBookUsers5 | couchbase | 1 | none | 0 | 7805295 | 38843449344 | 5625038208 | 16752377696 | | GleamBookUsers6 | couchbase | 1 | none | 0 | 5670634 | 38843449344 | 4179619008 | 10765062531 | | GleamBookUsers7 | couchbase | 1 | none | 0 | 2664483 | 38843449344 | 2113684720 | 7014907410 | | GleamBookUsers8 | couchbase | 1 | none | 0 | 5030513 | 38843449344 | 3706988072 | 9578907134 | | GleamBookUsers9 | couchbase | 1 | none | 0 | 4331007 | 38843449344 | 3226506096 | 9929000561 | +-----------------+-----------+----------+------------+-----+---------+-------------+------------+-------------+ 2021-02-19 04:11:56,569 | test | INFO | MainThread | [table_view:display:72] Docs statistics +---------------+---------------+-----------------+-----------------+---------------+---------------+ | Initial Items | Current Items | Items Updated | Items Created | Items Deleted | Items Expired | +---------------+---------------+-----------------+-----------------+---------------+---------------+ | 0 | -30000000 | 2000000-3000000 | 1000000-2000000 | 0-1000000 | 0-1000000 | +---------------+---------------+-----------------+-----------------+---------------+---------------+ 2021-02-19 04:11:56,605 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5430.136600 2021-02-19 04:11:56,720 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4271.551306 2021-02-19 04:11:57,051 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5302.736610 2021-02-19 04:11:57,240 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers0 is 100 2021-02-19 04:11:57,621 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2258.136000 2021-02-19 04:11:57,621 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2726.053269 2021-02-19 04:11:57,634 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4663.626179 2021-02-19 04:11:57,653 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3024.051377 2021-02-19 04:11:57,757 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5780.728431 2021-02-19 04:11:57,818 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:57,911 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers1 is 100 2021-02-19 04:11:58,032 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3369.127350 2021-02-19 04:11:58,311 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5430.136600 2021-02-19 04:11:58,391 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4271.551306 2021-02-19 04:11:58,605 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers2 is 100 2021-02-19 04:11:58,667 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5302.736610 2021-02-19 04:11:59,323 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers3 is 100 2021-02-19 04:11:59,348 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2258.136000 2021-02-19 04:11:59,352 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2726.053269 2021-02-19 04:11:59,367 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4663.626179 2021-02-19 04:11:59,377 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3024.051377 2021-02-19 04:11:59,440 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5780.728431 2021-02-19 04:11:59,520 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:11:59,683 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3369.127350 2021-02-19 04:11:59,966 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5430.136600 2021-02-19 04:12:00,023 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4271.551306 2021-02-19 04:12:00,286 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers4 is 100 2021-02-19 04:12:00,341 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5302.736610 2021-02-19 04:12:01,039 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2726.053269 2021-02-19 04:12:01,049 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2258.136000 2021-02-19 04:12:01,059 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers5 is 100 2021-02-19 04:12:01,094 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3024.051377 2021-02-19 04:12:01,105 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5780.728431 2021-02-19 04:12:01,150 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:01,295 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4663.626179 2021-02-19 04:12:01,326 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3369.127350 2021-02-19 04:12:01,676 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5430.136600 2021-02-19 04:12:01,698 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4271.551306 2021-02-19 04:12:01,740 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers6 is 100 2021-02-19 04:12:01,983 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5302.736610 2021-02-19 04:12:02,382 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers7 is 100 2021-02-19 04:12:02,730 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2226.736000 2021-02-19 04:12:02,734 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2999.851377 2021-02-19 04:12:02,767 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2488.253269 2021-02-19 04:12:02,786 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5452.728431 2021-02-19 04:12:02,798 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:02,963 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3310.427350 2021-02-19 04:12:03,016 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4483.126179 2021-02-19 04:12:03,107 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers8 is 100 2021-02-19 04:12:03,361 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5238.136600 2021-02-19 04:12:03,392 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4306.551306 2021-02-19 04:12:03,650 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4924.136610 2021-02-19 04:12:03,760 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers9 is 100 ############################################################ # # RAM FootPrint: 4108.75390625 # ############################################################ 2021-02-19 04:12:03,826 | test | DEBUG | Thread-372 | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> crash_thread():L729 2021-02-19 04:12:03,826 | test | INFO | Thread-372 | [common_lib:sleep:22] Sleep 111 seconds. Reason: Iteration:0 waiting to kill memc on all nodes 2021-02-19 04:12:04,427 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2999.851377 2021-02-19 04:12:04,463 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2488.253269 2021-02-19 04:12:04,477 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5452.728431 2021-02-19 04:12:04,483 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2226.736000 2021-02-19 04:12:04,496 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:04,619 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3310.427350 2021-02-19 04:12:04,703 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4483.126179 2021-02-19 04:12:05,009 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5238.136600 2021-02-19 04:12:05,013 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4306.551306 2021-02-19 04:12:05,273 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4924.136610 2021-02-19 04:12:06,065 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3046.100000 2021-02-19 04:12:06,190 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2226.736000 2021-02-19 04:12:06,207 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2488.253269 2021-02-19 04:12:06,219 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5452.728431 2021-02-19 04:12:06,230 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:06,316 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3310.427350 2021-02-19 04:12:06,404 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4483.126179 2021-02-19 04:12:06,632 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4314.100000 2021-02-19 04:12:06,650 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5123.900000 2021-02-19 04:12:06,895 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4654.600000 2021-02-19 04:12:07,778 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3046.100000 2021-02-19 04:12:07,848 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2218.400000 2021-02-19 04:12:07,914 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2320.200000 2021-02-19 04:12:07,926 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:07,937 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5140.600000 2021-02-19 04:12:07,971 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3323.800000 2021-02-19 04:12:08,069 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4369.900000 2021-02-19 04:12:08,263 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4314.100000 2021-02-19 04:12:08,308 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5123.900000 2021-02-19 04:12:08,538 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4654.600000 2021-02-19 04:12:09,440 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3046.100000 2021-02-19 04:12:09,522 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2218.400000 2021-02-19 04:12:09,598 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5140.600000 2021-02-19 04:12:09,619 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2320.200000 2021-02-19 04:12:09,621 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:09,667 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3323.800000 2021-02-19 04:12:09,727 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4369.900000 2021-02-19 04:12:09,921 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4314.100000 2021-02-19 04:12:09,976 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5123.900000 2021-02-19 04:12:10,161 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4654.600000 2021-02-19 04:12:11,157 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3046.100000 2021-02-19 04:12:11,178 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2218.400000 2021-02-19 04:12:11,285 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5140.600000 2021-02-19 04:12:11,286 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:11,322 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3323.800000 2021-02-19 04:12:11,345 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2320.200000 2021-02-19 04:12:11,381 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4369.900000 2021-02-19 04:12:11,559 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4314.100000 2021-02-19 04:12:11,647 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5123.900000 2021-02-19 04:12:11,776 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4654.600000 2021-02-19 04:12:12,808 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2297.400000 2021-02-19 04:12:12,816 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3102.700000 2021-02-19 04:12:12,948 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5074.600000 2021-02-19 04:12:13,023 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:13,049 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3379.100000 2021-02-19 04:12:13,066 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4400.800000 2021-02-19 04:12:13,078 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2328.300000 2021-02-19 04:12:13,217 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4222.900000 2021-02-19 04:12:13,259 | infra | INFO | pool-2-thread-39 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' completed 2021-02-19 04:12:13,260 | infra | INFO | pool-2-thread-39 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:12:13,288 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5111.900000 2021-02-19 04:12:13,410 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4643.800000 2021-02-19 04:12:14,450 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2297.400000 2021-02-19 04:12:14,480 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3102.700000 2021-02-19 04:12:14,595 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5074.600000 2021-02-19 04:12:14,647 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:14,733 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4400.800000 2021-02-19 04:12:14,756 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3379.100000 2021-02-19 04:12:14,760 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2328.300000 2021-02-19 04:12:14,884 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4222.900000 2021-02-19 04:12:14,911 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5111.900000 2021-02-19 04:12:15,058 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4643.800000 2021-02-19 04:12:16,108 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2297.400000 2021-02-19 04:12:16,157 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3102.700000 2021-02-19 04:12:16,276 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:16,299 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5074.600000 2021-02-19 04:12:16,407 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3401.700000 2021-02-19 04:12:16,437 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4465.300000 2021-02-19 04:12:16,473 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2382.700000 2021-02-19 04:12:16,594 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4218.900000 2021-02-19 04:12:16,624 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5188.500000 2021-02-19 04:12:16,670 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4758.300000 2021-02-19 04:12:17,769 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2375.000000 2021-02-19 04:12:17,844 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3095.500000 2021-02-19 04:12:17,914 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:17,980 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5171.700000 2021-02-19 04:12:18,105 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4465.300000 2021-02-19 04:12:18,127 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3401.700000 2021-02-19 04:12:18,151 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2382.700000 2021-02-19 04:12:18,239 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4218.900000 2021-02-19 04:12:18,306 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5188.500000 2021-02-19 04:12:18,326 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4758.300000 2021-02-19 04:12:19,400 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2375.000000 2021-02-19 04:12:19,473 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3095.500000 2021-02-19 04:12:19,551 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:19,618 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5171.700000 2021-02-19 04:12:19,772 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4465.300000 2021-02-19 04:12:19,809 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2382.700000 2021-02-19 04:12:19,822 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3401.700000 2021-02-19 04:12:19,891 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4218.900000 2021-02-19 04:12:20,013 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5188.500000 2021-02-19 04:12:20,016 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4758.300000 2021-02-19 04:12:21,025 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2375.000000 2021-02-19 04:12:21,111 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3095.500000 2021-02-19 04:12:21,180 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:21,283 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5171.700000 2021-02-19 04:12:21,464 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4465.300000 2021-02-19 04:12:21,469 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3401.700000 2021-02-19 04:12:21,487 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2382.700000 2021-02-19 04:12:21,529 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4218.900000 2021-02-19 04:12:21,707 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5188.500000 2021-02-19 04:12:21,713 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4758.300000 2021-02-19 04:12:22,674 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2376.400000 2021-02-19 04:12:22,747 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3105.200000 2021-02-19 04:12:22,832 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:22,937 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5395.400000 2021-02-19 04:12:23,124 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4855.400000 2021-02-19 04:12:23,167 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2469.800000 2021-02-19 04:12:23,190 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3314.900000 2021-02-19 04:12:23,200 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4252.000000 2021-02-19 04:12:23,385 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5412.600000 2021-02-19 04:12:23,408 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4973.900000 2021-02-19 04:12:24,309 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2376.400000 2021-02-19 04:12:24,401 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3105.200000 2021-02-19 04:12:24,453 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:24,559 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5395.400000 2021-02-19 04:12:24,798 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4855.400000 2021-02-19 04:12:24,838 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2469.800000 2021-02-19 04:12:24,901 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4252.000000 2021-02-19 04:12:24,905 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3314.900000 2021-02-19 04:12:25,049 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4973.900000 2021-02-19 04:12:25,095 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5412.600000 2021-02-19 04:12:25,964 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2377.041937 2021-02-19 04:12:26,073 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3114.735049 2021-02-19 04:12:26,088 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:26,210 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5395.400000 2021-02-19 04:12:26,486 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5318.186824 2021-02-19 04:12:26,497 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2517.923313 2021-02-19 04:12:26,568 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4145.389653 2021-02-19 04:12:26,595 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3242.012706 2021-02-19 04:12:26,698 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5058.647466 2021-02-19 04:12:26,733 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5537.672878 2021-02-19 04:12:27,658 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2377.041937 2021-02-19 04:12:27,792 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3114.735049 2021-02-19 04:12:27,799 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:27,901 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5499.879956 2021-02-19 04:12:28,131 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5318.186824 2021-02-19 04:12:28,213 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2517.923313 2021-02-19 04:12:28,250 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4145.389653 2021-02-19 04:12:28,288 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3242.012706 2021-02-19 04:12:28,394 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5537.672878 2021-02-19 04:12:28,404 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5058.647466 2021-02-19 04:12:29,313 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2377.041937 2021-02-19 04:12:29,486 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:29,509 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3114.735049 2021-02-19 04:12:29,533 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5499.879956 2021-02-19 04:12:29,780 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5318.186824 2021-02-19 04:12:29,881 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2517.923313 2021-02-19 04:12:29,921 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4145.389653 2021-02-19 04:12:29,967 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3242.012706 2021-02-19 04:12:30,049 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5058.647466 2021-02-19 04:12:30,098 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5537.672878 2021-02-19 04:12:30,983 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2377.041937 2021-02-19 04:12:31,219 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3114.735049 2021-02-19 04:12:31,223 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:31,223 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5499.879956 2021-02-19 04:12:31,417 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5318.186824 2021-02-19 04:12:31,540 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2517.923313 2021-02-19 04:12:31,591 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4145.389653 2021-02-19 04:12:31,619 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3242.012706 2021-02-19 04:12:31,678 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5058.647466 2021-02-19 04:12:31,733 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5537.672878 2021-02-19 04:12:32,638 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2417.841937 2021-02-19 04:12:32,894 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5336.379956 2021-02-19 04:12:32,904 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3096.935049 2021-02-19 04:12:32,914 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:33,107 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5281.486824 2021-02-19 04:12:33,207 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2482.923313 2021-02-19 04:12:33,259 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3979.189653 2021-02-19 04:12:33,276 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3332.812706 2021-02-19 04:12:33,341 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4922.747466 2021-02-19 04:12:33,408 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5413.972878 2021-02-19 04:12:34,272 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2417.841937 2021-02-19 04:12:34,582 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5336.379956 2021-02-19 04:12:34,595 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:34,614 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3096.935049 2021-02-19 04:12:34,773 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5281.486824 2021-02-19 04:12:34,855 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2482.923313 2021-02-19 04:12:34,986 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3979.189653 2021-02-19 04:12:34,987 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3332.812706 2021-02-19 04:12:35,022 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4922.747466 2021-02-19 04:12:35,085 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5413.972878 2021-02-19 04:12:35,897 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2435.763439 2021-02-19 04:12:36,285 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5336.379956 2021-02-19 04:12:36,303 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3096.935049 2021-02-19 04:12:36,315 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:36,407 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5134.269011 2021-02-19 04:12:36,533 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2440.664009 2021-02-19 04:12:36,664 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3883.181544 2021-02-19 04:12:36,676 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3403.008353 2021-02-19 04:12:36,713 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4795.314304 2021-02-19 04:12:36,759 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5272.184585 2021-02-19 04:12:37,517 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2435.763439 2021-02-19 04:12:37,948 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5187.475373 2021-02-19 04:12:37,970 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:38,003 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3106.267750 2021-02-19 04:12:38,071 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5134.269011 2021-02-19 04:12:38,177 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2440.664009 2021-02-19 04:12:38,368 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3403.008353 2021-02-19 04:12:38,417 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4795.314304 2021-02-19 04:12:38,434 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5272.184585 2021-02-19 04:12:38,434 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3883.181544 2021-02-19 04:12:39,171 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2435.763439 2021-02-19 04:12:39,658 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:39,660 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5187.475373 2021-02-19 04:12:39,680 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3106.267750 2021-02-19 04:12:39,759 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5134.269011 2021-02-19 04:12:39,865 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2440.664009 2021-02-19 04:12:40,059 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4795.314304 2021-02-19 04:12:40,081 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3403.008353 2021-02-19 04:12:40,109 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5272.184585 2021-02-19 04:12:40,151 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3883.181544 2021-02-19 04:12:40,826 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2435.763439 2021-02-19 04:12:41,315 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:41,345 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5187.475373 2021-02-19 04:12:41,348 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3106.267750 2021-02-19 04:12:41,417 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5134.269011 2021-02-19 04:12:41,517 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2440.664009 2021-02-19 04:12:41,713 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4795.314304 2021-02-19 04:12:41,809 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3403.008353 2021-02-19 04:12:41,816 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3883.181544 2021-02-19 04:12:41,874 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5272.184585 2021-02-19 04:12:42,451 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2409.763439 2021-02-19 04:12:42,950 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:43,028 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5135.775373 2021-02-19 04:12:43,036 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3091.567750 2021-02-19 04:12:43,115 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5149.069011 2021-02-19 04:12:43,176 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2400.464009 2021-02-19 04:12:43,351 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4744.214304 2021-02-19 04:12:43,506 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3306.408353 2021-02-19 04:12:43,512 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3923.981544 2021-02-19 04:12:43,536 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5184.184585 2021-02-19 04:12:44,081 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2409.763439 2021-02-19 04:12:44,582 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:44,681 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3091.567750 2021-02-19 04:12:44,697 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5135.775373 2021-02-19 04:12:44,760 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5149.069011 2021-02-19 04:12:44,812 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2400.464009 2021-02-19 04:12:44,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4744.214304 2021-02-19 04:12:45,167 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3306.408353 2021-02-19 04:12:45,207 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5184.184585 2021-02-19 04:12:45,232 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3923.981544 2021-02-19 04:12:45,706 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2394.600000 2021-02-19 04:12:46,203 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:46,377 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3091.567750 2021-02-19 04:12:46,398 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5135.775373 2021-02-19 04:12:46,414 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5182.500000 2021-02-19 04:12:46,463 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2374.200000 2021-02-19 04:12:46,605 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4719.300000 2021-02-19 04:12:46,821 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3259.500000 2021-02-19 04:12:46,828 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5133.500000 2021-02-19 04:12:46,898 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3994.000000 2021-02-19 04:12:47,355 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2394.600000 2021-02-19 04:12:47,831 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:48,079 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5182.500000 2021-02-19 04:12:48,091 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5080.200000 2021-02-19 04:12:48,108 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3052.700000 2021-02-19 04:12:48,141 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2374.200000 2021-02-19 04:12:48,243 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4719.300000 2021-02-19 04:12:48,499 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3259.500000 2021-02-19 04:12:48,503 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5133.500000 2021-02-19 04:12:48,558 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3994.000000 2021-02-19 04:12:49,010 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2394.600000 2021-02-19 04:12:49,431 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:49,727 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5182.500000 2021-02-19 04:12:49,779 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5080.200000 2021-02-19 04:12:49,802 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2374.200000 2021-02-19 04:12:49,822 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3052.700000 2021-02-19 04:12:49,861 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4719.300000 2021-02-19 04:12:50,138 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5133.500000 2021-02-19 04:12:50,194 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3259.500000 2021-02-19 04:12:50,217 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3994.000000 2021-02-19 04:12:50,641 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2394.600000 2021-02-19 04:12:51,042 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:51,342 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5182.500000 2021-02-19 04:12:51,414 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5080.200000 2021-02-19 04:12:51,480 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2374.200000 2021-02-19 04:12:51,489 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3052.700000 2021-02-19 04:12:51,519 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4719.300000 2021-02-19 04:12:51,766 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5133.500000 2021-02-19 04:12:51,855 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3259.500000 2021-02-19 04:12:51,878 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3994.000000 2021-02-19 04:12:52,285 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2394.600000 2021-02-19 04:12:52,671 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:53,006 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5418.800000 2021-02-19 04:12:53,125 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5364.700000 2021-02-19 04:12:53,144 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2514.400000 2021-02-19 04:12:53,230 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4942.600000 2021-02-19 04:12:53,240 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3102.300000 2021-02-19 04:12:53,398 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5366.100000 2021-02-19 04:12:53,490 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3358.100000 2021-02-19 04:12:53,540 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4109.600000 2021-02-19 04:12:53,937 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2357.600000 2021-02-19 04:12:54,326 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:54,630 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5418.800000 2021-02-19 04:12:54,795 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5364.700000 2021-02-19 04:12:54,816 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2514.400000 2021-02-19 04:12:54,880 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4942.600000 2021-02-19 04:12:54,950 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3102.300000 2021-02-19 04:12:55,066 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5366.100000 2021-02-19 04:12:55,197 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3358.100000 2021-02-19 04:12:55,200 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4109.600000 2021-02-19 04:12:55,559 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2342.800000 2021-02-19 04:12:55,948 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:56,269 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5418.800000 2021-02-19 04:12:56,457 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5724.200000 2021-02-19 04:12:56,493 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2660.600000 2021-02-19 04:12:56,532 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5236.600000 2021-02-19 04:12:56,601 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3196.300000 2021-02-19 04:12:56,737 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5642.900000 2021-02-19 04:12:56,861 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3406.400000 2021-02-19 04:12:56,880 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4185.500000 2021-02-19 04:12:57,187 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2342.800000 2021-02-19 04:12:57,589 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:57,895 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5675.000000 2021-02-19 04:12:58,102 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5724.200000 2021-02-19 04:12:58,160 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2660.600000 2021-02-19 04:12:58,180 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5236.600000 2021-02-19 04:12:58,242 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3196.300000 2021-02-19 04:12:58,361 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5642.900000 2021-02-19 04:12:58,499 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3406.400000 2021-02-19 04:12:58,505 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4185.500000 2021-02-19 04:12:58,802 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2342.800000 2021-02-19 04:12:59,210 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:12:59,513 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5675.000000 2021-02-19 04:12:59,750 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5724.200000 2021-02-19 04:12:59,821 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5236.600000 2021-02-19 04:12:59,858 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2660.600000 2021-02-19 04:12:59,960 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3196.300000 2021-02-19 04:13:00,005 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5642.900000 2021-02-19 04:13:00,171 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3406.400000 2021-02-19 04:13:00,174 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4185.500000 2021-02-19 04:13:00,415 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2342.800000 2021-02-19 04:13:00,844 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:01,135 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5675.000000 2021-02-19 04:13:01,398 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5724.200000 2021-02-19 04:13:01,480 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5236.600000 2021-02-19 04:13:01,500 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2660.600000 2021-02-19 04:13:01,641 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3196.300000 2021-02-19 04:13:01,683 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5642.900000 2021-02-19 04:13:01,809 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3406.400000 2021-02-19 04:13:01,813 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4185.500000 2021-02-19 04:13:02,052 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2342.800000 2021-02-19 04:13:02,476 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:02,779 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5700.400000 2021-02-19 04:13:03,013 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5710.500000 2021-02-19 04:13:03,089 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5282.300000 2021-02-19 04:13:03,141 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2643.900000 2021-02-19 04:13:03,286 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3219.400000 2021-02-19 04:13:03,328 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5653.700000 2021-02-19 04:13:03,474 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4132.500000 2021-02-19 04:13:03,503 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3364.400000 2021-02-19 04:13:03,714 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2351.400000 2021-02-19 04:13:04,130 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:04,437 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5700.400000 2021-02-19 04:13:04,661 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5710.500000 2021-02-19 04:13:04,706 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5282.300000 2021-02-19 04:13:04,832 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2643.900000 2021-02-19 04:13:04,926 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3219.400000 2021-02-19 04:13:04,984 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5653.700000 2021-02-19 04:13:05,109 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4132.500000 2021-02-19 04:13:05,150 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3364.400000 2021-02-19 04:13:05,358 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2351.400000 2021-02-19 04:13:05,753 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:06,063 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5726.057745 2021-02-19 04:13:06,341 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5710.500000 2021-02-19 04:13:06,380 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5282.300000 2021-02-19 04:13:06,483 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2652.155977 2021-02-19 04:13:06,592 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3189.640098 2021-02-19 04:13:06,619 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5648.712664 2021-02-19 04:13:06,747 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4130.692630 2021-02-19 04:13:06,819 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3322.549735 2021-02-19 04:13:07,012 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2323.300579 2021-02-19 04:13:07,377 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:07,684 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5726.057745 2021-02-19 04:13:07,999 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5671.495656 2021-02-19 04:13:08,066 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5324.599880 2021-02-19 04:13:08,236 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2652.155977 2021-02-19 04:13:08,263 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5648.712664 2021-02-19 04:13:08,266 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3189.640098 2021-02-19 04:13:08,434 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4130.692630 2021-02-19 04:13:08,473 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3322.549735 2021-02-19 04:13:08,650 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2323.300579 2021-02-19 04:13:08,983 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:09,326 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5726.057745 2021-02-19 04:13:09,657 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5671.495656 2021-02-19 04:13:09,720 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5324.599880 2021-02-19 04:13:09,875 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2652.155977 2021-02-19 04:13:09,907 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5648.712664 2021-02-19 04:13:09,959 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3189.640098 2021-02-19 04:13:10,098 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4130.692630 2021-02-19 04:13:10,168 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3322.549735 2021-02-19 04:13:10,295 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2323.300579 2021-02-19 04:13:10,601 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:10,961 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5726.057745 2021-02-19 04:13:11,305 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5671.495656 2021-02-19 04:13:11,397 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5324.599880 2021-02-19 04:13:11,598 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5648.712664 2021-02-19 04:13:11,615 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3189.640098 2021-02-19 04:13:11,631 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2652.155977 2021-02-19 04:13:11,759 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4130.692630 2021-02-19 04:13:11,801 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3322.549735 2021-02-19 04:13:11,974 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2323.300579 2021-02-19 04:13:12,266 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:12,599 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5558.457745 2021-02-19 04:13:12,950 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5535.895656 2021-02-19 04:13:13,020 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5210.599880 2021-02-19 04:13:13,278 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5527.812664 2021-02-19 04:13:13,299 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3214.840098 2021-02-19 04:13:13,312 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2583.155977 2021-02-19 04:13:13,413 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4049.492630 2021-02-19 04:13:13,447 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3274.549735 2021-02-19 04:13:13,596 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2353.200579 2021-02-19 04:13:13,884 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:14,226 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5558.457745 2021-02-19 04:13:14,569 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5535.895656 2021-02-19 04:13:14,641 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5210.599880 2021-02-19 04:13:14,957 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5527.812664 2021-02-19 04:13:15,002 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3214.840098 2021-02-19 04:13:15,009 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2583.155977 2021-02-19 04:13:15,065 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4049.492630 2021-02-19 04:13:15,088 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3274.549735 2021-02-19 04:13:15,240 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2353.200579 2021-02-19 04:13:15,499 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:15,871 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5281.701902 2021-02-19 04:13:16,187 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5535.895656 2021-02-19 04:13:16,279 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5210.599880 2021-02-19 04:13:16,585 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5289.698298 2021-02-19 04:13:16,634 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3253.022723 2021-02-19 04:13:16,654 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2443.501902 2021-02-19 04:13:16,700 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3878.211311 2021-02-19 04:13:16,744 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3255.735235 2021-02-19 04:13:16,872 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2373.673874 2021-02-19 04:13:17,138 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:17,483 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5281.701902 2021-02-19 04:13:17,802 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5305.819419 2021-02-19 04:13:17,911 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4930.712513 2021-02-19 04:13:18,266 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3253.022723 2021-02-19 04:13:18,282 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5289.698298 2021-02-19 04:13:18,319 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2443.501902 2021-02-19 04:13:18,372 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3878.211311 2021-02-19 04:13:18,404 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3255.735235 2021-02-19 04:13:18,503 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2373.673874 2021-02-19 04:13:18,773 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:19,125 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5281.701902 2021-02-19 04:13:19,434 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5305.819419 2021-02-19 04:13:19,533 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4930.712513 2021-02-19 04:13:19,898 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3253.022723 2021-02-19 04:13:19,963 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5289.698298 2021-02-19 04:13:19,996 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2443.501902 2021-02-19 04:13:20,042 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3878.211311 2021-02-19 04:13:20,071 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3255.735235 2021-02-19 04:13:20,167 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2373.673874 2021-02-19 04:13:20,398 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:20,750 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5281.701902 2021-02-19 04:13:21,066 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5305.819419 2021-02-19 04:13:21,160 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4930.712513 2021-02-19 04:13:21,502 | infra | INFO | pool-2-thread-30 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' completed 2021-02-19 04:13:21,503 | infra | INFO | pool-2-thread-30 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:13:21,575 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3253.022723 2021-02-19 04:13:21,644 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5289.698298 2021-02-19 04:13:21,663 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2443.501902 2021-02-19 04:13:21,711 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3878.211311 2021-02-19 04:13:21,740 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3255.735235 2021-02-19 04:13:21,825 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2373.673874 2021-02-19 04:13:22,019 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:22,378 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5307.201902 2021-02-19 04:13:22,704 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5349.419419 2021-02-19 04:13:22,823 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4957.212513 2021-02-19 04:13:23,138 | infra | INFO | pool-2-thread-51 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' completed 2021-02-19 04:13:23,138 | infra | INFO | pool-2-thread-51 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:13:23,214 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3229.022723 2021-02-19 04:13:23,315 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2493.201902 2021-02-19 04:13:23,342 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5288.998298 2021-02-19 04:13:23,414 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3295.435235 2021-02-19 04:13:23,428 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3994.711311 2021-02-19 04:13:23,486 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2315.273874 2021-02-19 04:13:23,638 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:24,015 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5307.201902 2021-02-19 04:13:24,339 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5349.419419 2021-02-19 04:13:24,446 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4957.212513 2021-02-19 04:13:24,848 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3229.022723 2021-02-19 04:13:24,947 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2493.201902 2021-02-19 04:13:25,028 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5288.998298 2021-02-19 04:13:25,095 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3295.435235 2021-02-19 04:13:25,122 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3994.711311 2021-02-19 04:13:25,134 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2315.273874 2021-02-19 04:13:25,267 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:25,674 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5508.340912 2021-02-19 04:13:25,948 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5569.551866 2021-02-19 04:13:26,069 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5206.198450 2021-02-19 04:13:26,476 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3201.378524 2021-02-19 04:13:26,566 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2644.005812 2021-02-19 04:13:26,674 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5380.106822 2021-02-19 04:13:26,757 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3333.702051 2021-02-19 04:13:26,763 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4213.338982 2021-02-19 04:13:26,786 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2291.445014 2021-02-19 04:13:26,891 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:27,289 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5508.340912 2021-02-19 04:13:27,594 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5569.551866 2021-02-19 04:13:27,709 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5206.198450 2021-02-19 04:13:28,140 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3201.378524 2021-02-19 04:13:28,206 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2644.005812 2021-02-19 04:13:28,342 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5380.106822 2021-02-19 04:13:28,411 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3333.702051 2021-02-19 04:13:28,444 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2291.445014 2021-02-19 04:13:28,463 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4213.338982 2021-02-19 04:13:28,563 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:28,934 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5508.340912 2021-02-19 04:13:29,232 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5569.551866 2021-02-19 04:13:29,377 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5206.198450 2021-02-19 04:13:29,775 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3201.378524 2021-02-19 04:13:29,871 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2644.005812 2021-02-19 04:13:30,048 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5380.106822 2021-02-19 04:13:30,089 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3333.702051 2021-02-19 04:13:30,131 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2291.445014 2021-02-19 04:13:30,157 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4213.338982 2021-02-19 04:13:30,226 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:30,569 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5508.340912 2021-02-19 04:13:30,849 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5569.551866 2021-02-19 04:13:30,993 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5206.198450 2021-02-19 04:13:31,457 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3201.378524 2021-02-19 04:13:31,512 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2644.005812 2021-02-19 04:13:31,703 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5380.106822 2021-02-19 04:13:31,743 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3333.702051 2021-02-19 04:13:31,835 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2291.445014 2021-02-19 04:13:31,880 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4213.338982 2021-02-19 04:13:31,903 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:32,190 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5508.340912 2021-02-19 04:13:32,536 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5223.651866 2021-02-19 04:13:32,625 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5426.298450 2021-02-19 04:13:33,085 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3126.178524 2021-02-19 04:13:33,176 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2778.805812 2021-02-19 04:13:33,407 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3426.102051 2021-02-19 04:13:33,411 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5057.406822 2021-02-19 04:13:33,512 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2220.345014 2021-02-19 04:13:33,555 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:33,561 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4166.138982 2021-02-19 04:13:33,835 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5707.840912 2021-02-19 04:13:34,171 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5223.651866 2021-02-19 04:13:34,269 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5426.298450 2021-02-19 04:13:34,713 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3126.178524 2021-02-19 04:13:34,799 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2778.805812 2021-02-19 04:13:35,099 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5057.406822 2021-02-19 04:13:35,101 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3426.102051 2021-02-19 04:13:35,161 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2220.345014 2021-02-19 04:13:35,213 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4166.138982 2021-02-19 04:13:35,227 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:35,523 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5834.663123 2021-02-19 04:13:35,809 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4590.014677 2021-02-19 04:13:35,905 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5557.786312 2021-02-19 04:13:36,361 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3126.178524 2021-02-19 04:13:36,480 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2874.995994 2021-02-19 04:13:36,736 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4690.010191 2021-02-19 04:13:36,780 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3534.496293 2021-02-19 04:13:36,811 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2104.868888 2021-02-19 04:13:36,872 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4038.497932 2021-02-19 04:13:36,887 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:37,167 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5834.663123 2021-02-19 04:13:37,434 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4590.014677 2021-02-19 04:13:37,517 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5557.786312 2021-02-19 04:13:37,976 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3050.632421 2021-02-19 04:13:38,117 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2874.995994 2021-02-19 04:13:38,380 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4690.010191 2021-02-19 04:13:38,421 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3534.496293 2021-02-19 04:13:38,505 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2104.868888 2021-02-19 04:13:38,512 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4038.497932 2021-02-19 04:13:38,545 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:38,782 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5834.663123 2021-02-19 04:13:39,069 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4590.014677 2021-02-19 04:13:39,137 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5557.786312 2021-02-19 04:13:39,617 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3050.632421 2021-02-19 04:13:39,753 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2874.995994 2021-02-19 04:13:40,000 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4690.010191 2021-02-19 04:13:40,042 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3534.496293 2021-02-19 04:13:40,198 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2104.868888 2021-02-19 04:13:40,200 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4038.497932 2021-02-19 04:13:40,209 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:40,392 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5834.663123 2021-02-19 04:13:40,683 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4590.014677 2021-02-19 04:13:40,793 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5557.786312 2021-02-19 04:13:41,262 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3050.632421 2021-02-19 04:13:41,400 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2874.995994 2021-02-19 04:13:41,641 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4690.010191 2021-02-19 04:13:41,677 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3534.496293 2021-02-19 04:13:41,861 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:41,877 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2104.868888 2021-02-19 04:13:41,900 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4038.497932 2021-02-19 04:13:42,029 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5834.663123 2021-02-19 04:13:42,313 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4512.914677 2021-02-19 04:13:42,405 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5644.186312 2021-02-19 04:13:42,878 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2962.232421 2021-02-19 04:13:43,026 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.695994 2021-02-19 04:13:43,276 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4534.310191 2021-02-19 04:13:43,296 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3693.196293 2021-02-19 04:13:43,493 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:43,516 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2068.768888 2021-02-19 04:13:43,559 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4039.797932 2021-02-19 04:13:43,677 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5953.263123 2021-02-19 04:13:43,950 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4512.914677 2021-02-19 04:13:44,039 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5644.186312 2021-02-19 04:13:44,506 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2962.232421 2021-02-19 04:13:44,650 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.695994 2021-02-19 04:13:44,921 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4534.310191 2021-02-19 04:13:44,944 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3693.196293 2021-02-19 04:13:45,127 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:45,197 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2068.768888 2021-02-19 04:13:45,246 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4039.797932 2021-02-19 04:13:45,315 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5953.263123 2021-02-19 04:13:45,565 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4651.206524 2021-02-19 04:13:45,690 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5779.056714 2021-02-19 04:13:46,124 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2875.859896 2021-02-19 04:13:46,286 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2908.695994 2021-02-19 04:13:46,549 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4465.051651 2021-02-19 04:13:46,576 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3841.958395 2021-02-19 04:13:46,740 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:46,829 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2068.320472 2021-02-19 04:13:46,875 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4086.329298 2021-02-19 04:13:46,947 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6098.244907 2021-02-19 04:13:47,196 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4651.206524 2021-02-19 04:13:47,325 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5779.056714 2021-02-19 04:13:47,773 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2875.859896 2021-02-19 04:13:47,907 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2958.299099 2021-02-19 04:13:48,253 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3841.958395 2021-02-19 04:13:48,269 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4465.051651 2021-02-19 04:13:48,394 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:48,460 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2068.320472 2021-02-19 04:13:48,572 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4086.329298 2021-02-19 04:13:48,599 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6098.244907 2021-02-19 04:13:48,838 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4651.206524 2021-02-19 04:13:48,940 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5779.056714 2021-02-19 04:13:49,407 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2875.859896 2021-02-19 04:13:49,559 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2958.299099 2021-02-19 04:13:49,924 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3841.958395 2021-02-19 04:13:49,947 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4465.051651 2021-02-19 04:13:50,042 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:50,124 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2068.320472 2021-02-19 04:13:50,236 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4086.329298 2021-02-19 04:13:50,266 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6098.244907 2021-02-19 04:13:50,467 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4651.206524 2021-02-19 04:13:50,561 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5779.056714 2021-02-19 04:13:51,046 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2875.859896 2021-02-19 04:13:51,194 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2958.299099 2021-02-19 04:13:51,569 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3841.958395 2021-02-19 04:13:51,599 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4465.051651 2021-02-19 04:13:51,674 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:51,746 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2068.320472 2021-02-19 04:13:51,911 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4086.329298 2021-02-19 04:13:51,940 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6098.244907 2021-02-19 04:13:52,098 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4651.206524 2021-02-19 04:13:52,171 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5779.056714 2021-02-19 04:13:52,671 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2917.759896 2021-02-19 04:13:52,815 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3009.299099 2021-02-19 04:13:53,217 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3755.058395 2021-02-19 04:13:53,250 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4583.951651 2021-02-19 04:13:53,296 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:53,382 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2030.020472 2021-02-19 04:13:53,546 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4127.929298 2021-02-19 04:13:53,566 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6172.644907 2021-02-19 04:13:53,716 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4707.006524 2021-02-19 04:13:53,776 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5927.856714 2021-02-19 04:13:54,298 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2917.759896 2021-02-19 04:13:54,431 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3009.299099 2021-02-19 04:13:54,835 | test | DEBUG | Thread-372 | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> kill_memcached():L745 2021-02-19 04:13:54,836 | test | INFO | Thread-372 | [common_lib:sleep:22] Sleep 5 seconds. Reason: Sleep for 5 seconds between continuous memc kill 2021-02-19 04:13:54,864 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3755.058395 2021-02-19 04:13:54,891 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4583.951651 2021-02-19 04:13:54,967 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:55,038 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2030.020472 2021-02-19 04:13:55,165 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4127.929298 2021-02-19 04:13:55,209 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6172.644907 2021-02-19 04:13:55,361 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4707.006524 2021-02-19 04:13:55,411 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5927.856714 2021-02-19 04:13:56,002 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2973.206836 2021-02-19 04:13:56,157 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2969.324885 2021-02-19 04:13:56,532 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3637.312253 2021-02-19 04:13:56,548 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4671.995523 2021-02-19 04:13:56,621 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:56,694 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2014.588787 2021-02-19 04:13:56,801 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4177.440995 2021-02-19 04:13:56,851 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6124.883750 2021-02-19 04:13:56,986 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4666.917529 2021-02-19 04:13:57,026 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5908.454927 2021-02-19 04:13:57,634 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2973.206836 2021-02-19 04:13:57,776 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2969.324885 2021-02-19 04:13:58,167 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3637.312253 2021-02-19 04:13:58,183 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4671.995523 2021-02-19 04:13:58,253 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:58,328 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2014.588787 2021-02-19 04:13:58,418 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4177.440995 2021-02-19 04:13:58,503 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6124.883750 2021-02-19 04:13:58,641 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4666.917529 2021-02-19 04:13:58,668 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5908.454927 2021-02-19 04:13:59,272 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2973.206836 2021-02-19 04:13:59,404 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2969.324885 2021-02-19 04:13:59,836 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3637.312253 2021-02-19 04:13:59,882 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4671.995523 2021-02-19 04:13:59,914 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:13:59,989 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2014.588787 2021-02-19 04:14:00,078 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4177.440995 2021-02-19 04:14:00,128 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6124.883750 2021-02-19 04:14:00,263 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4666.917529 2021-02-19 04:14:00,282 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5908.454927 2021-02-19 04:14:00,871 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2973.206836 2021-02-19 04:14:01,009 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2969.324885 2021-02-19 04:14:01,082 | test | DEBUG | Thread-372 | [basetestcase:check_coredump_exist:727] 172.23.110.64: No crash files found 2021-02-19 04:14:01,421 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3637.312253 2021-02-19 04:14:01,500 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:01,519 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4671.995523 2021-02-19 04:14:01,594 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2014.588787 2021-02-19 04:14:01,668 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4177.440995 2021-02-19 04:14:01,729 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6124.883750 2021-02-19 04:14:01,852 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4666.917529 2021-02-19 04:14:01,865 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5908.454927 2021-02-19 04:14:02,460 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2973.206836 2021-02-19 04:14:02,609 | test | DEBUG | Thread-372 | [basetestcase:check_coredump_exist:746] 172.23.110.64: No 'sanitizers.log.*' files found 2021-02-19 04:14:02,634 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2969.324885 2021-02-19 04:14:03,026 | test | DEBUG | Thread-372 | [basetestcase:check_coredump_exist:727] 172.23.110.65: No crash files found 2021-02-19 04:14:03,088 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1812.912253 2021-02-19 04:14:03,114 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:03,236 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2340.795523 2021-02-19 04:14:03,446 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2098.340995 2021-02-19 04:14:03,467 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2304.117529 2021-02-19 04:14:03,592 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3027.083750 2021-02-19 04:14:04,015 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1018.688787 2021-02-19 04:14:04,148 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1488.606836 2021-02-19 04:14:04,224 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2908.454927 2021-02-19 04:14:04,354 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1458.524885 2021-02-19 04:14:04,727 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1812.912253 2021-02-19 04:14:04,802 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:05,410 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2098.340995 2021-02-19 04:14:05,414 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2304.117529 2021-02-19 04:14:05,417 | test | DEBUG | Thread-372 | [basetestcase:check_coredump_exist:746] 172.23.110.65: No 'sanitizers.log.*' files found 2021-02-19 04:14:05,417 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:05,427 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3027.083750 2021-02-19 04:14:05,447 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2340.795523 2021-02-19 04:14:05,589 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2014.588787 2021-02-19 04:14:05,815 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2973.206836 2021-02-19 04:14:05,825 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5908.454927 2021-02-19 04:14:06,000 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2969.324885 2021-02-19 04:14:06,134 | test | WARNING | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3880] Exception during cbstat all cmd: Traceback (most recent call last): File "/opt/couchbase/lib/python/cbstats", line 999, in main() File "/opt/couchbase/lib/python/cbstats", line 996, in main c.execute() File "/opt/couchbase/lib/python/clitool.py", line 71, in execute f[0](mc, *args[2:], **opts.__dict__) File "/opt/couchbase/lib/python/cbstats", line 38, in g f(*args, **kwargs) File "/opt/couchbase/lib/python/cli_auth_utils.py", line 93, in g mc.bucket_select(bucket) File "/opt/couchbase/lib/python/mc_bin_client.py", line 674, in bucket_select return self._doCmd(memcacheConstants.CMD_SELECT_BUCKET, name, '') File "/opt/couchbase/lib/python/mc_bin_client.py", line 298, in _doCmd return self._handleSingleResponse(opaque) File "/opt/couchbase/lib/python/mc_bin_client.py", line 291, in _handleSingleResponse cmd, opaque, cas, keylen, extralen, data = self._handleKeyedResponse(myopaque) File "/opt/couchbase/lib/python/mc_bin_client.py", line 287, in _handleKeyedResponse raise MemcachedError(errcode, msg) mc_bin_client.ErrorKeyEnoent: Memcached error #1: KEY_ENOENT : Not Found : 2021-02-19 04:14:06,147 | test | DEBUG | Thread-372 | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> _wait_warmup_completed():L3881 2021-02-19 04:14:06,147 | test | INFO | Thread-372 | [common_lib:sleep:22] Sleep 2 seconds. Reason: Warm-up not complete for GleamBookUsers0 on 172.23.110.64 2021-02-19 04:14:06,334 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1812.912253 2021-02-19 04:14:06,378 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:06,999 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4177.440995 2021-02-19 04:14:07,046 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6124.883750 2021-02-19 04:14:07,092 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4671.995523 2021-02-19 04:14:07,130 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4666.917529 2021-02-19 04:14:07,180 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2014.588787 2021-02-19 04:14:07,401 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2973.206836 2021-02-19 04:14:07,450 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5908.454927 2021-02-19 04:14:07,581 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2969.324885 2021-02-19 04:14:07,905 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3637.312253 2021-02-19 04:14:07,940 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:08,243 | test | WARNING | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3880] Exception during cbstat all cmd: Traceback (most recent call last): File "/opt/couchbase/lib/python/cbstats", line 999, in main() File "/opt/couchbase/lib/python/cbstats", line 996, in main c.execute() File "/opt/couchbase/lib/python/clitool.py", line 71, in execute f[0](mc, *args[2:], **opts.__dict__) File "/opt/couchbase/lib/python/cbstats", line 38, in g f(*args, **kwargs) File "/opt/couchbase/lib/python/cli_auth_utils.py", line 93, in g mc.bucket_select(bucket) File "/opt/couchbase/lib/python/mc_bin_client.py", line 674, in bucket_select return self._doCmd(memcacheConstants.CMD_SELECT_BUCKET, name, '') File "/opt/couchbase/lib/python/mc_bin_client.py", line 298, in _doCmd return self._handleSingleResponse(opaque) File "/opt/couchbase/lib/python/mc_bin_client.py", line 291, in _handleSingleResponse cmd, opaque, cas, keylen, extralen, data = self._handleKeyedResponse(myopaque) File "/opt/couchbase/lib/python/mc_bin_client.py", line 287, in _handleKeyedResponse raise MemcachedError(errcode, msg) mc_bin_client.ErrorKeyEnoent: Memcached error #1: KEY_ENOENT : Not Found : 2021-02-19 04:14:08,250 | test | DEBUG | Thread-372 | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> _wait_warmup_completed():L3881 2021-02-19 04:14:08,250 | test | INFO | Thread-372 | [common_lib:sleep:22] Sleep 2 seconds. Reason: Warm-up not complete for GleamBookUsers0 on 172.23.110.64 2021-02-19 04:14:08,582 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4177.440995 2021-02-19 04:14:08,622 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6124.883750 2021-02-19 04:14:08,684 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4671.995523 2021-02-19 04:14:08,703 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4666.917529 2021-02-19 04:14:08,750 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2014.588787 2021-02-19 04:14:08,977 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2973.206836 2021-02-19 04:14:09,046 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5908.454927 2021-02-19 04:14:09,141 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2969.324885 2021-02-19 04:14:09,490 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:09,509 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3637.312253 2021-02-19 04:14:10,141 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4177.440995 2021-02-19 04:14:10,184 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6124.883750 2021-02-19 04:14:10,247 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4671.995523 2021-02-19 04:14:10,265 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4666.917529 2021-02-19 04:14:10,312 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2014.588787 2021-02-19 04:14:10,414 | test | DEBUG | Thread-372 | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> _wait_warmup_completed():L3881 2021-02-19 04:14:10,414 | test | INFO | Thread-372 | [common_lib:sleep:22] Sleep 2 seconds. Reason: Warm-up not complete for GleamBookUsers0 on 172.23.110.64 2021-02-19 04:14:10,552 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2973.206836 2021-02-19 04:14:10,622 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5908.454927 2021-02-19 04:14:10,723 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2969.324885 2021-02-19 04:14:11,046 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:11,065 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3637.312253 2021-02-19 04:14:11,786 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6124.883750 2021-02-19 04:14:11,828 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4177.440995 2021-02-19 04:14:11,848 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4671.995523 2021-02-19 04:14:11,881 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4666.917529 2021-02-19 04:14:11,903 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2014.588787 2021-02-19 04:14:12,147 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2973.206836 2021-02-19 04:14:12,259 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5908.454927 2021-02-19 04:14:12,323 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:14:12,533 | test | DEBUG | Thread-372 | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> _wait_warmup_completed():L3881 2021-02-19 04:14:12,533 | test | INFO | Thread-372 | [common_lib:sleep:22] Sleep 2 seconds. Reason: Warm-up not complete for GleamBookUsers0 on 172.23.110.64 2021-02-19 04:14:12,596 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:12,625 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:14:13,431 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:14:13,450 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:14:13,467 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:14:13,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.050000 2021-02-19 04:14:13,598 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:14:13,726 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:14:13,849 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:14:13,924 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:14:14,161 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:14,216 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:14:14,654 | test | DEBUG | Thread-372 | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> _wait_warmup_completed():L3881 2021-02-19 04:14:14,654 | test | INFO | Thread-372 | [common_lib:sleep:22] Sleep 2 seconds. Reason: Warm-up not complete for GleamBookUsers0 on 172.23.110.64 2021-02-19 04:14:15,042 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:14:15,049 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:14:15,069 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:14:15,164 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.050000 2021-02-19 04:14:15,174 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:14:15,280 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:14:15,405 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.150000 2021-02-19 04:14:15,473 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.250000 2021-02-19 04:14:15,746 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:15,776 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.200000 2021-02-19 04:14:16,634 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.200000 2021-02-19 04:14:16,655 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.200000 2021-02-19 04:14:16,671 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.050000 2021-02-19 04:14:16,766 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.400000 2021-02-19 04:14:16,776 | test | DEBUG | Thread-372 | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> _wait_warmup_completed():L3881 2021-02-19 04:14:16,776 | test | INFO | Thread-372 | [common_lib:sleep:22] Sleep 2 seconds. Reason: Warm-up not complete for GleamBookUsers0 on 172.23.110.64 2021-02-19 04:14:16,795 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.150000 2021-02-19 04:14:16,937 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.200000 2021-02-19 04:14:16,997 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.150000 2021-02-19 04:14:17,049 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.250000 2021-02-19 04:14:17,296 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:17,339 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.200000 2021-02-19 04:14:18,217 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.200000 2021-02-19 04:14:18,230 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.200000 2021-02-19 04:14:18,250 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.050000 2021-02-19 04:14:18,352 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.400000 2021-02-19 04:14:18,411 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.150000 2021-02-19 04:14:18,515 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.200000 2021-02-19 04:14:18,559 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.150000 2021-02-19 04:14:18,645 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.250000 2021-02-19 04:14:18,831 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:18,875 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.200000 2021-02-19 04:14:18,888 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 13.4709999561. 2021-02-19 04:14:18,888 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:19,329 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.441999912262. 2021-02-19 04:14:19,331 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:19,769 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.436999797821. 2021-02-19 04:14:19,769 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:19,779 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.200000 2021-02-19 04:14:19,798 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.200000 2021-02-19 04:14:19,813 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.050000 2021-02-19 04:14:19,934 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.400000 2021-02-19 04:14:19,997 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.150000 2021-02-19 04:14:20,115 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.200000 2021-02-19 04:14:20,164 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.150000 2021-02-19 04:14:20,232 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.463000059128. 2021-02-19 04:14:20,233 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:20,239 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.250000 2021-02-19 04:14:20,450 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:20,477 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.200000 2021-02-19 04:14:20,651 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.418999910355. 2021-02-19 04:14:20,651 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:21,052 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.401000022888. 2021-02-19 04:14:21,053 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:21,357 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.200000 2021-02-19 04:14:21,394 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.200000 2021-02-19 04:14:21,437 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.050000 2021-02-19 04:14:21,492 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.438000202179. 2021-02-19 04:14:21,492 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:21,559 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.400000 2021-02-19 04:14:21,601 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.150000 2021-02-19 04:14:21,680 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.200000 2021-02-19 04:14:21,723 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.150000 2021-02-19 04:14:21,848 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.250000 2021-02-19 04:14:21,917 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.425999879837. 2021-02-19 04:14:21,917 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:22,023 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.200000 2021-02-19 04:14:22,033 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:22,351 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.434000015259. 2021-02-19 04:14:22,352 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:22,786 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.433000087738. 2021-02-19 04:14:22,786 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:22,936 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 14.000000 2021-02-19 04:14:22,967 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 17.600000 2021-02-19 04:14:23,013 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 16.950000 2021-02-19 04:14:23,164 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 16.100000 2021-02-19 04:14:23,184 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 13.900000 2021-02-19 04:14:23,233 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 13.600000 2021-02-19 04:14:23,253 | test | DEBUG | Thread-372 | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> _wait_warmup_completed():L3881 2021-02-19 04:14:23,255 | test | INFO | Thread-372 | [common_lib:sleep:22] Sleep 2 seconds. Reason: Warm-up not complete for GleamBookUsers0 on 172.23.110.65 2021-02-19 04:14:23,289 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 15.750000 2021-02-19 04:14:23,427 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6.250000 2021-02-19 04:14:23,585 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 13.700000 2021-02-19 04:14:23,642 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:24,529 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 14.000000 2021-02-19 04:14:24,555 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 17.600000 2021-02-19 04:14:24,585 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 16.950000 2021-02-19 04:14:24,733 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 16.100000 2021-02-19 04:14:24,809 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 13.600000 2021-02-19 04:14:24,813 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 13.900000 2021-02-19 04:14:24,846 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 15.750000 2021-02-19 04:14:25,003 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6.250000 2021-02-19 04:14:25,187 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 13.700000 2021-02-19 04:14:25,194 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:25,401 | test | DEBUG | Thread-372 | [common_lib:sleep:17] Sleep is called from couchbase_utils/bucket_utils/bucket_ready_functions.py -> _wait_warmup_completed():L3881 2021-02-19 04:14:25,401 | test | INFO | Thread-372 | [common_lib:sleep:22] Sleep 2 seconds. Reason: Warm-up not complete for GleamBookUsers0 on 172.23.110.65 2021-02-19 04:14:26,101 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 34.818917 2021-02-19 04:14:26,153 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 20.903603 2021-02-19 04:14:26,165 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 33.014053 2021-02-19 04:14:26,358 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 16.100000 2021-02-19 04:14:26,388 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 13.900000 2021-02-19 04:14:26,403 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 23.006666 2021-02-19 04:14:26,423 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 30.215134 2021-02-19 04:14:26,562 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 17.210089 2021-02-19 04:14:26,760 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 30.515314 2021-02-19 04:14:26,779 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:27,512 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 4.72600007057. 2021-02-19 04:14:27,512 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:27,661 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 34.818917 2021-02-19 04:14:27,723 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 20.903603 2021-02-19 04:14:27,743 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 33.014053 2021-02-19 04:14:27,914 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 33.015584 2021-02-19 04:14:27,930 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.417999982834. 2021-02-19 04:14:27,930 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:27,956 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 32.717025 2021-02-19 04:14:27,970 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 23.006666 2021-02-19 04:14:27,989 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 30.215134 2021-02-19 04:14:28,118 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 17.210089 2021-02-19 04:14:28,316 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 30.515314 2021-02-19 04:14:28,346 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:28,398 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.46799993515. 2021-02-19 04:14:28,398 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:28,816 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.418999910355. 2021-02-19 04:14:28,816 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:29,229 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 34.818917 2021-02-19 04:14:29,230 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.414000034332. 2021-02-19 04:14:29,230 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:29,312 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 20.903603 2021-02-19 04:14:29,342 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 33.014053 2021-02-19 04:14:29,539 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 23.006666 2021-02-19 04:14:29,555 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 33.015584 2021-02-19 04:14:29,569 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 30.215134 2021-02-19 04:14:29,582 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 32.717025 2021-02-19 04:14:29,681 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 17.210089 2021-02-19 04:14:29,687 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.456000089645. 2021-02-19 04:14:29,687 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:29,898 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 30.515314 2021-02-19 04:14:29,908 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:30,119 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.431999921799. 2021-02-19 04:14:30,119 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:30,542 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.422000169754. 2021-02-19 04:14:30,542 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:30,779 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 34.818917 2021-02-19 04:14:30,861 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 20.903603 2021-02-19 04:14:30,880 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 33.014053 2021-02-19 04:14:30,990 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.447999954224. 2021-02-19 04:14:30,990 | test | DEBUG | Thread-372 | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:14:31,105 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 23.006666 2021-02-19 04:14:31,125 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 33.015584 2021-02-19 04:14:31,141 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 32.717025 2021-02-19 04:14:31,217 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 30.215134 2021-02-19 04:14:31,250 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 17.210089 2021-02-19 04:14:31,413 | test | INFO | Thread-372 | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.422000169754. 2021-02-19 04:14:31,417 | test | DEBUG | Thread-372 | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> crash_thread():L737 2021-02-19 04:14:31,417 | test | DEBUG | Thread-372 | [common_lib:sleep:24] Sleep 300 seconds. Reason: None 2021-02-19 04:14:31,457 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 30.515314 2021-02-19 04:14:31,467 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:32,368 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 38.418917 2021-02-19 04:14:32,417 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 24.903603 2021-02-19 04:14:32,507 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 39.014053 2021-02-19 04:14:32,711 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 28.906666 2021-02-19 04:14:32,729 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 36.815584 2021-02-19 04:14:32,743 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 36.417025 2021-02-19 04:14:32,798 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 33.915134 2021-02-19 04:14:32,838 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 18.810089 2021-02-19 04:14:33,023 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:33,039 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 34.615314 2021-02-19 04:14:33,921 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 38.418917 2021-02-19 04:14:34,012 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 24.903603 2021-02-19 04:14:34,062 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 39.014053 2021-02-19 04:14:34,357 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 36.815584 2021-02-19 04:14:34,371 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 28.906666 2021-02-19 04:14:34,392 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 36.417025 2021-02-19 04:14:34,414 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 18.810089 2021-02-19 04:14:34,427 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 33.915134 2021-02-19 04:14:34,575 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:34,632 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 34.615314 2021-02-19 04:14:35,463 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 38.800000 2021-02-19 04:14:35,558 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 24.900000 2021-02-19 04:14:35,609 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 39.000000 2021-02-19 04:14:35,921 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 29.500000 2021-02-19 04:14:35,940 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 37.100000 2021-02-19 04:14:35,966 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 19.600000 2021-02-19 04:14:35,980 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 36.900000 2021-02-19 04:14:35,992 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 35.100000 2021-02-19 04:14:36,115 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:36,187 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 34.615314 2021-02-19 04:14:37,009 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 38.800000 2021-02-19 04:14:37,134 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 24.900000 2021-02-19 04:14:37,180 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 39.000000 2021-02-19 04:14:37,493 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 29.500000 2021-02-19 04:14:37,519 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 37.100000 2021-02-19 04:14:37,551 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 19.600000 2021-02-19 04:14:37,565 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 36.900000 2021-02-19 04:14:37,581 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 35.100000 2021-02-19 04:14:37,678 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:37,730 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 35.300000 2021-02-19 04:14:38,586 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 38.800000 2021-02-19 04:14:38,688 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 24.900000 2021-02-19 04:14:38,760 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 39.000000 2021-02-19 04:14:39,045 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 29.500000 2021-02-19 04:14:39,073 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 37.100000 2021-02-19 04:14:39,111 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 19.600000 2021-02-19 04:14:39,138 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 36.900000 2021-02-19 04:14:39,150 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 35.100000 2021-02-19 04:14:39,227 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:39,272 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 35.300000 2021-02-19 04:14:40,128 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 38.800000 2021-02-19 04:14:40,247 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 24.900000 2021-02-19 04:14:40,309 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 39.000000 2021-02-19 04:14:40,599 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 29.500000 2021-02-19 04:14:40,640 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 37.100000 2021-02-19 04:14:40,696 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 19.600000 2021-02-19 04:14:40,710 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 36.900000 2021-02-19 04:14:40,723 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 35.100000 2021-02-19 04:14:40,782 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:40,835 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 35.300000 2021-02-19 04:14:41,673 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 38.800000 2021-02-19 04:14:41,790 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 24.900000 2021-02-19 04:14:41,855 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 39.000000 2021-02-19 04:14:42,198 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 37.100000 2021-02-19 04:14:42,210 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 29.500000 2021-02-19 04:14:42,279 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 767.000000 2021-02-19 04:14:42,290 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 807.500000 2021-02-19 04:14:42,305 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 37.000000 2021-02-19 04:14:42,328 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:42,395 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 35.200000 2021-02-19 04:14:43,216 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 39.100000 2021-02-19 04:14:43,329 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 26.000000 2021-02-19 04:14:43,401 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 39.000000 2021-02-19 04:14:43,756 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 37.100000 2021-02-19 04:14:43,799 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2285.600000 2021-02-19 04:14:43,841 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 767.000000 2021-02-19 04:14:43,901 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:43,921 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 807.500000 2021-02-19 04:14:43,930 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 37.000000 2021-02-19 04:14:43,953 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 35.200000 2021-02-19 04:14:44,780 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 39.100000 2021-02-19 04:14:44,880 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 26.000000 2021-02-19 04:14:44,950 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 39.000000 2021-02-19 04:14:45,335 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 37.100000 2021-02-19 04:14:45,365 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2285.600000 2021-02-19 04:14:45,407 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 767.000000 2021-02-19 04:14:45,460 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:45,499 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2425.900000 2021-02-19 04:14:45,513 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 37.200000 2021-02-19 04:14:45,529 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 34.900000 2021-02-19 04:14:46,335 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 39.100000 2021-02-19 04:14:46,427 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 28.300000 2021-02-19 04:14:46,492 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 39.000000 2021-02-19 04:14:46,887 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 36.100000 2021-02-19 04:14:46,944 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5839.900000 2021-02-19 04:14:46,984 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2211.600000 2021-02-19 04:14:47,065 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:47,124 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 37.200000 2021-02-19 04:14:47,138 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2425.900000 2021-02-19 04:14:47,150 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 34.900000 2021-02-19 04:14:47,882 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 39.700000 2021-02-19 04:14:47,980 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 28.300000 2021-02-19 04:14:48,038 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 39.000000 2021-02-19 04:14:48,444 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 36.100000 2021-02-19 04:14:48,519 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5839.900000 2021-02-19 04:14:48,552 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2211.600000 2021-02-19 04:14:48,621 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:48,703 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 37.200000 2021-02-19 04:14:48,726 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2425.900000 2021-02-19 04:14:48,737 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 34.900000 2021-02-19 04:14:49,428 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 39.700000 2021-02-19 04:14:49,598 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 28.300000 2021-02-19 04:14:49,645 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 39.000000 2021-02-19 04:14:50,012 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 36.100000 2021-02-19 04:14:50,157 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5839.900000 2021-02-19 04:14:50,174 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2211.600000 2021-02-19 04:14:50,196 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:50,270 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 37.200000 2021-02-19 04:14:50,296 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2425.900000 2021-02-19 04:14:50,321 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 34.900000 2021-02-19 04:14:50,982 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 39.700000 2021-02-19 04:14:51,171 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 28.300000 2021-02-19 04:14:51,216 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 39.000000 2021-02-19 04:14:51,601 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 36.100000 2021-02-19 04:14:51,786 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2211.600000 2021-02-19 04:14:51,816 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:51,838 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5839.900000 2021-02-19 04:14:51,898 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 37.200000 2021-02-19 04:14:51,914 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2425.900000 2021-02-19 04:14:51,928 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 34.900000 2021-02-19 04:14:52,528 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 494.900000 2021-02-19 04:14:52,799 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1973.200000 2021-02-19 04:14:52,842 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 215.500000 2021-02-19 04:14:53,144 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 926.100000 2021-02-19 04:14:53,404 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3609.900000 2021-02-19 04:14:53,421 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6957.800000 2021-02-19 04:14:53,461 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 35.500000 2021-02-19 04:14:53,476 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:53,492 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3956.200000 2021-02-19 04:14:53,520 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 23.200000 2021-02-19 04:14:54,075 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 494.900000 2021-02-19 04:14:54,345 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1973.200000 2021-02-19 04:14:54,414 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 215.500000 2021-02-19 04:14:54,694 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 926.100000 2021-02-19 04:14:54,990 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3609.900000 2021-02-19 04:14:55,000 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6957.800000 2021-02-19 04:14:55,046 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 35.500000 2021-02-19 04:14:55,072 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3956.200000 2021-02-19 04:14:55,095 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:55,108 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 23.200000 2021-02-19 04:14:55,615 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1635.000000 2021-02-19 04:14:55,891 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4546.600000 2021-02-19 04:14:55,954 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1204.100000 2021-02-19 04:14:56,250 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 926.100000 2021-02-19 04:14:56,608 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4097.700000 2021-02-19 04:14:56,621 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 542.000000 2021-02-19 04:14:56,660 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6196.500000 2021-02-19 04:14:56,678 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4244.100000 2021-02-19 04:14:56,703 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:56,732 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6.400000 2021-02-19 04:14:57,181 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1635.000000 2021-02-19 04:14:57,397 | infra | INFO | pool-2-thread-42 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' completed 2021-02-19 04:14:57,398 | infra | INFO | pool-2-thread-42 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:14:57,447 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4546.600000 2021-02-19 04:14:57,507 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1204.100000 2021-02-19 04:14:57,818 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2109.900000 2021-02-19 04:14:58,211 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 542.000000 2021-02-19 04:14:58,256 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4097.700000 2021-02-19 04:14:58,289 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4244.100000 2021-02-19 04:14:58,292 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6196.500000 2021-02-19 04:14:58,309 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:58,335 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6.400000 2021-02-19 04:14:58,746 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1635.000000 2021-02-19 04:14:58,987 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4546.600000 2021-02-19 04:14:59,049 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1204.100000 2021-02-19 04:14:59,285 | infra | INFO | pool-2-thread-18 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:14:59,286 | infra | INFO | pool-2-thread-18 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:14:59,359 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2109.900000 2021-02-19 04:14:59,769 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 542.000000 2021-02-19 04:14:59,813 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4097.700000 2021-02-19 04:14:59,868 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6196.500000 2021-02-19 04:14:59,890 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4244.100000 2021-02-19 04:14:59,900 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:14:59,910 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6.400000 2021-02-19 04:15:00,289 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1635.000000 2021-02-19 04:15:00,532 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4546.600000 2021-02-19 04:15:00,588 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1204.100000 2021-02-19 04:15:00,905 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2109.900000 2021-02-19 04:15:01,358 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 542.000000 2021-02-19 04:15:01,405 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4097.700000 2021-02-19 04:15:01,441 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6196.500000 2021-02-19 04:15:01,453 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4244.100000 2021-02-19 04:15:01,480 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:01,502 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6.400000 2021-02-19 04:15:01,832 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1635.000000 2021-02-19 04:15:02,082 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4546.600000 2021-02-19 04:15:02,141 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1204.100000 2021-02-19 04:15:02,490 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2259.400000 2021-02-19 04:15:02,989 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2932.400000 2021-02-19 04:15:03,029 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3516.100000 2021-02-19 04:15:03,072 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3619.500000 2021-02-19 04:15:03,119 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5539.600000 2021-02-19 04:15:03,131 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:03,163 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.600000 2021-02-19 04:15:03,398 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3756.700000 2021-02-19 04:15:03,698 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4623.800000 2021-02-19 04:15:03,746 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4100.700000 2021-02-19 04:15:04,079 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2259.400000 2021-02-19 04:15:04,582 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2932.400000 2021-02-19 04:15:04,713 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3619.500000 2021-02-19 04:15:04,717 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3516.100000 2021-02-19 04:15:04,755 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5539.600000 2021-02-19 04:15:04,782 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:04,803 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.600000 2021-02-19 04:15:04,989 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3756.700000 2021-02-19 04:15:05,349 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4623.800000 2021-02-19 04:15:05,371 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4100.700000 2021-02-19 04:15:05,707 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2158.940096 2021-02-19 04:15:06,230 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4999.950160 2021-02-19 04:15:06,380 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3516.100000 2021-02-19 04:15:06,398 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3619.500000 2021-02-19 04:15:06,476 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5539.600000 2021-02-19 04:15:06,493 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:06,506 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.600000 2021-02-19 04:15:06,621 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5311.852396 2021-02-19 04:15:07,042 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4035.413898 2021-02-19 04:15:07,065 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6297.079073 2021-02-19 04:15:07,351 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2158.940096 2021-02-19 04:15:07,868 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4999.950160 2021-02-19 04:15:08,065 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3434.616933 2021-02-19 04:15:08,081 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2648.377316 2021-02-19 04:15:08,207 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5585.145527 2021-02-19 04:15:08,223 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.397764 2021-02-19 04:15:08,234 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:08,313 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5311.852396 2021-02-19 04:15:08,721 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4035.413898 2021-02-19 04:15:08,742 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6297.079073 2021-02-19 04:15:08,997 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2158.940096 2021-02-19 04:15:09,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4999.950160 2021-02-19 04:15:09,756 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3434.616933 2021-02-19 04:15:09,832 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2648.377316 2021-02-19 04:15:09,918 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:09,940 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5585.145527 2021-02-19 04:15:09,974 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.397764 2021-02-19 04:15:09,990 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5311.852396 2021-02-19 04:15:10,388 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4035.413898 2021-02-19 04:15:10,407 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6297.079073 2021-02-19 04:15:10,641 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2158.940096 2021-02-19 04:15:11,151 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4999.950160 2021-02-19 04:15:11,437 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3434.616933 2021-02-19 04:15:11,559 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2648.377316 2021-02-19 04:15:11,648 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:11,665 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5585.145527 2021-02-19 04:15:11,697 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.397764 2021-02-19 04:15:11,710 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5311.852396 2021-02-19 04:15:12,072 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4035.413898 2021-02-19 04:15:12,085 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6297.079073 2021-02-19 04:15:12,319 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2158.940096 2021-02-19 04:15:12,799 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5247.950160 2021-02-19 04:15:13,125 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3503.316933 2021-02-19 04:15:13,240 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1076.677316 2021-02-19 04:15:13,365 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5758.545527 2021-02-19 04:15:13,368 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:13,394 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5612.352396 2021-02-19 04:15:13,430 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.797764 2021-02-19 04:15:13,724 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3962.513898 2021-02-19 04:15:13,739 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6429.579073 2021-02-19 04:15:13,970 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2274.240096 2021-02-19 04:15:14,431 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5247.950160 2021-02-19 04:15:14,786 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3503.316933 2021-02-19 04:15:14,911 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1076.677316 2021-02-19 04:15:15,085 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:15,086 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5758.545527 2021-02-19 04:15:15,092 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5612.352396 2021-02-19 04:15:15,138 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.797764 2021-02-19 04:15:15,394 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6429.579073 2021-02-19 04:15:15,423 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3962.513898 2021-02-19 04:15:15,575 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2360.241724 2021-02-19 04:15:16,030 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5382.746981 2021-02-19 04:15:16,410 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3503.316933 2021-02-19 04:15:16,512 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:16,680 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:16,710 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5716.267518 2021-02-19 04:15:16,740 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5799.954341 2021-02-19 04:15:16,789 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:15:17,036 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6439.473616 2021-02-19 04:15:17,065 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3950.172664 2021-02-19 04:15:17,168 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2360.241724 2021-02-19 04:15:17,624 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5382.746981 2021-02-19 04:15:18,058 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3539.908811 2021-02-19 04:15:18,142 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:18,305 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:18,331 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5716.267518 2021-02-19 04:15:18,372 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5799.954341 2021-02-19 04:15:18,407 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:15:18,635 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6439.473616 2021-02-19 04:15:18,676 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3950.172664 2021-02-19 04:15:18,799 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2360.241724 2021-02-19 04:15:19,243 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5382.746981 2021-02-19 04:15:19,696 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3539.908811 2021-02-19 04:15:19,779 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:19,918 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:19,956 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5716.267518 2021-02-19 04:15:20,025 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5799.954341 2021-02-19 04:15:20,094 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:15:20,247 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6439.473616 2021-02-19 04:15:20,283 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3950.172664 2021-02-19 04:15:20,407 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2360.241724 2021-02-19 04:15:20,849 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5382.746981 2021-02-19 04:15:21,323 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3539.908811 2021-02-19 04:15:21,421 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:21,573 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:21,605 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5716.267518 2021-02-19 04:15:21,684 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5799.954341 2021-02-19 04:15:21,736 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:15:21,861 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6439.473616 2021-02-19 04:15:21,894 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3950.172664 2021-02-19 04:15:22,006 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2360.241724 2021-02-19 04:15:22,443 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5495.046981 2021-02-19 04:15:22,944 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3619.208811 2021-02-19 04:15:23,036 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:23,187 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:23,244 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5683.767518 2021-02-19 04:15:23,321 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5382.154341 2021-02-19 04:15:23,413 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300000 2021-02-19 04:15:23,507 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6360.773616 2021-02-19 04:15:23,559 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3972.872664 2021-02-19 04:15:23,628 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2392.341724 2021-02-19 04:15:24,048 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5495.046981 2021-02-19 04:15:24,551 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3619.208811 2021-02-19 04:15:24,683 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:24,803 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:24,868 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5683.767518 2021-02-19 04:15:24,977 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5382.154341 2021-02-19 04:15:25,051 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300000 2021-02-19 04:15:25,148 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6360.773616 2021-02-19 04:15:25,180 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3972.872664 2021-02-19 04:15:25,252 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2392.341724 2021-02-19 04:15:25,642 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5532.800000 2021-02-19 04:15:26,194 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3730.100000 2021-02-19 04:15:26,321 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:26,424 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:26,532 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5836.600000 2021-02-19 04:15:26,664 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4836.200000 2021-02-19 04:15:26,673 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300000 2021-02-19 04:15:26,782 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6296.800000 2021-02-19 04:15:26,825 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3974.000000 2021-02-19 04:15:26,861 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2420.500000 2021-02-19 04:15:27,265 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5532.800000 2021-02-19 04:15:27,815 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3730.100000 2021-02-19 04:15:27,961 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:28,059 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:28,151 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5836.600000 2021-02-19 04:15:28,312 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4836.200000 2021-02-19 04:15:28,319 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300000 2021-02-19 04:15:28,427 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6296.800000 2021-02-19 04:15:28,463 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3974.000000 2021-02-19 04:15:28,503 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2420.500000 2021-02-19 04:15:28,852 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5532.800000 2021-02-19 04:15:29,444 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3730.100000 2021-02-19 04:15:29,585 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:29,678 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:29,772 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5836.600000 2021-02-19 04:15:29,934 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300000 2021-02-19 04:15:29,970 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4836.200000 2021-02-19 04:15:30,048 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6296.800000 2021-02-19 04:15:30,111 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3974.000000 2021-02-19 04:15:30,164 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2420.500000 2021-02-19 04:15:30,486 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5532.800000 2021-02-19 04:15:31,056 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3730.100000 2021-02-19 04:15:31,219 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:31,301 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:31,404 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5836.600000 2021-02-19 04:15:31,572 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300000 2021-02-19 04:15:31,605 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4836.200000 2021-02-19 04:15:31,677 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6296.800000 2021-02-19 04:15:31,756 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3974.000000 2021-02-19 04:15:31,788 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2420.500000 2021-02-19 04:15:32,104 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5532.800000 2021-02-19 04:15:32,723 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3716.400000 2021-02-19 04:15:32,871 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:32,924 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:33,032 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5901.600000 2021-02-19 04:15:33,206 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:15:33,234 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4626.100000 2021-02-19 04:15:33,342 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6198.100000 2021-02-19 04:15:33,375 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4001.500000 2021-02-19 04:15:33,443 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2455.900000 2021-02-19 04:15:33,697 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5532.100000 2021-02-19 04:15:34,338 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3716.400000 2021-02-19 04:15:34,529 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:34,572 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:34,654 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5901.600000 2021-02-19 04:15:34,831 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:15:34,895 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4626.100000 2021-02-19 04:15:34,983 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6198.100000 2021-02-19 04:15:35,046 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4001.500000 2021-02-19 04:15:35,062 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2455.900000 2021-02-19 04:15:35,309 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5532.100000 2021-02-19 04:15:35,960 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3588.324118 2021-02-19 04:15:36,190 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:36,229 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:36,276 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5813.811379 2021-02-19 04:15:36,450 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:15:36,523 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4564.072003 2021-02-19 04:15:36,615 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6060.299130 2021-02-19 04:15:36,700 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4072.694871 2021-02-19 04:15:36,707 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2471.777002 2021-02-19 04:15:36,940 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5585.318058 2021-02-19 04:15:37,591 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3588.324118 2021-02-19 04:15:37,838 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:37,858 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:37,894 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5813.811379 2021-02-19 04:15:38,059 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:15:38,177 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4564.072003 2021-02-19 04:15:38,250 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6060.299130 2021-02-19 04:15:38,348 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4072.694871 2021-02-19 04:15:38,390 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2471.777002 2021-02-19 04:15:38,598 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5585.318058 2021-02-19 04:15:39,214 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3588.324118 2021-02-19 04:15:39,489 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:39,499 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:39,529 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5813.811379 2021-02-19 04:15:39,688 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:15:39,819 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4564.072003 2021-02-19 04:15:39,918 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6060.299130 2021-02-19 04:15:40,055 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2471.777002 2021-02-19 04:15:40,062 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4072.694871 2021-02-19 04:15:40,226 | infra | INFO | pool-2-thread-45 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:15:40,226 | infra | INFO | pool-2-thread-45 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:15:40,240 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5585.318058 2021-02-19 04:15:40,845 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3588.324118 2021-02-19 04:15:41,131 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:41,164 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:41,187 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5813.811379 2021-02-19 04:15:41,325 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:15:41,467 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4564.072003 2021-02-19 04:15:41,536 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6060.299130 2021-02-19 04:15:41,694 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2471.777002 2021-02-19 04:15:41,709 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4072.694871 2021-02-19 04:15:41,877 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5585.318058 2021-02-19 04:15:42,460 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3583.124118 2021-02-19 04:15:42,746 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:42,796 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:42,826 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5828.611379 2021-02-19 04:15:42,946 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:15:43,075 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4630.872003 2021-02-19 04:15:43,151 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6079.099130 2021-02-19 04:15:43,316 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2395.677002 2021-02-19 04:15:43,336 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4094.394871 2021-02-19 04:15:43,486 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5702.918058 2021-02-19 04:15:44,081 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3583.124118 2021-02-19 04:15:44,375 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:44,503 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5828.611379 2021-02-19 04:15:44,505 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:44,596 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:15:44,710 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4630.872003 2021-02-19 04:15:44,776 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6079.099130 2021-02-19 04:15:44,943 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2395.677002 2021-02-19 04:15:44,973 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4094.394871 2021-02-19 04:15:45,101 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5702.918058 2021-02-19 04:15:45,684 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3699.149940 2021-02-19 04:15:46,000 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:46,141 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:46,160 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5825.753341 2021-02-19 04:15:46,213 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:15:46,328 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4630.872003 2021-02-19 04:15:46,387 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6079.099130 2021-02-19 04:15:46,578 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2373.082953 2021-02-19 04:15:46,628 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4111.227251 2021-02-19 04:15:46,750 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5795.864946 2021-02-19 04:15:47,296 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3699.149940 2021-02-19 04:15:47,611 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:47,763 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:47,802 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5825.753341 2021-02-19 04:15:47,845 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:15:47,966 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4440.735934 2021-02-19 04:15:48,016 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6171.540456 2021-02-19 04:15:48,242 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2373.082953 2021-02-19 04:15:48,276 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4111.227251 2021-02-19 04:15:48,374 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5795.864946 2021-02-19 04:15:48,891 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3699.149940 2021-02-19 04:15:49,234 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:49,385 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:49,447 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5825.753341 2021-02-19 04:15:49,467 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:15:49,589 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4440.735934 2021-02-19 04:15:49,641 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6171.540456 2021-02-19 04:15:49,858 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2373.082953 2021-02-19 04:15:49,891 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4111.227251 2021-02-19 04:15:49,971 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5795.864946 2021-02-19 04:15:50,510 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3699.149940 2021-02-19 04:15:50,851 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:51,003 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:51,082 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:15:51,118 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5825.753341 2021-02-19 04:15:51,243 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4440.735934 2021-02-19 04:15:51,288 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6171.540456 2021-02-19 04:15:51,473 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2373.082953 2021-02-19 04:15:51,503 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4111.227251 2021-02-19 04:15:51,598 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5795.864946 2021-02-19 04:15:52,072 | infra | INFO | pool-2-thread-54 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:15:52,072 | infra | INFO | pool-2-thread-54 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:15:52,101 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3699.149940 2021-02-19 04:15:52,444 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:52,632 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:52,700 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:15:52,755 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5715.053341 2021-02-19 04:15:52,848 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3383.635934 2021-02-19 04:15:52,898 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6231.740456 2021-02-19 04:15:53,108 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2469.582953 2021-02-19 04:15:53,119 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4226.227251 2021-02-19 04:15:53,213 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5885.564946 2021-02-19 04:15:53,694 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3846.549940 2021-02-19 04:15:54,046 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:54,236 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:54,313 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:15:54,381 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5715.053341 2021-02-19 04:15:54,460 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3383.635934 2021-02-19 04:15:54,539 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6231.740456 2021-02-19 04:15:54,752 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2469.582953 2021-02-19 04:15:54,756 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4226.227251 2021-02-19 04:15:54,842 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5885.564946 2021-02-19 04:15:55,305 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3846.549940 2021-02-19 04:15:55,654 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:55,858 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:55,971 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:15:56,006 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5698.000000 2021-02-19 04:15:56,072 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2413.400000 2021-02-19 04:15:56,135 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6252.700000 2021-02-19 04:15:56,361 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2469.582953 2021-02-19 04:15:56,394 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4226.227251 2021-02-19 04:15:56,467 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5952.800000 2021-02-19 04:15:56,904 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3953.700000 2021-02-19 04:15:57,276 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:57,466 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:57,584 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:15:57,625 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5698.000000 2021-02-19 04:15:57,684 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2413.400000 2021-02-19 04:15:57,750 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6252.700000 2021-02-19 04:15:57,986 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2509.800000 2021-02-19 04:15:58,010 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4268.500000 2021-02-19 04:15:58,096 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5952.800000 2021-02-19 04:15:58,494 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3953.700000 2021-02-19 04:15:58,871 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:15:59,084 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:15:59,227 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:15:59,280 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5698.000000 2021-02-19 04:15:59,354 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2413.400000 2021-02-19 04:15:59,384 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6252.700000 2021-02-19 04:15:59,637 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2509.800000 2021-02-19 04:15:59,651 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4268.500000 2021-02-19 04:15:59,710 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5952.800000 2021-02-19 04:16:00,114 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3953.700000 2021-02-19 04:16:00,476 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:00,710 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:00,848 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:16:00,894 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5698.000000 2021-02-19 04:16:00,982 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2413.400000 2021-02-19 04:16:01,022 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6252.700000 2021-02-19 04:16:01,246 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2509.800000 2021-02-19 04:16:01,273 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4268.500000 2021-02-19 04:16:01,322 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5952.800000 2021-02-19 04:16:01,717 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3953.700000 2021-02-19 04:16:02,086 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:02,336 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:02,476 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:16:02,523 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5803.018984 2021-02-19 04:16:02,632 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1313.441847 2021-02-19 04:16:02,671 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6214.872168 2021-02-19 04:16:02,875 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2501.323883 2021-02-19 04:16:02,905 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4208.170669 2021-02-19 04:16:02,941 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6049.978886 2021-02-19 04:16:03,322 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3973.102669 2021-02-19 04:16:03,703 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:03,947 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:04,101 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:16:04,148 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5803.018984 2021-02-19 04:16:04,262 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1313.441847 2021-02-19 04:16:04,292 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6214.872168 2021-02-19 04:16:04,489 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2501.323883 2021-02-19 04:16:04,519 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4208.170669 2021-02-19 04:16:04,559 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6049.978886 2021-02-19 04:16:04,953 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3973.102669 2021-02-19 04:16:05,311 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:05,576 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:05,763 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:16:05,783 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5910.418984 2021-02-19 04:16:05,928 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 193.841847 2021-02-19 04:16:05,940 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6200.172168 2021-02-19 04:16:06,121 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2506.323883 2021-02-19 04:16:06,135 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4205.070669 2021-02-19 04:16:06,180 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6117.578886 2021-02-19 04:16:06,545 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4023.702669 2021-02-19 04:16:06,911 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:07,180 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:07,405 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:16:07,415 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5910.418984 2021-02-19 04:16:07,549 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 193.841847 2021-02-19 04:16:07,568 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6200.172168 2021-02-19 04:16:07,732 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2506.323883 2021-02-19 04:16:07,779 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4205.070669 2021-02-19 04:16:07,795 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6117.578886 2021-02-19 04:16:08,160 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4023.702669 2021-02-19 04:16:08,506 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:08,825 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:09,026 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:16:09,029 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5910.418984 2021-02-19 04:16:09,164 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 193.841847 2021-02-19 04:16:09,203 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6200.172168 2021-02-19 04:16:09,364 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2506.323883 2021-02-19 04:16:09,410 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6117.578886 2021-02-19 04:16:09,421 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4205.070669 2021-02-19 04:16:09,766 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4023.702669 2021-02-19 04:16:10,095 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:10,414 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:10,655 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:16:10,676 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5910.418984 2021-02-19 04:16:10,788 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 193.841847 2021-02-19 04:16:10,839 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6200.172168 2021-02-19 04:16:10,969 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2506.323883 2021-02-19 04:16:11,007 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6117.578886 2021-02-19 04:16:11,023 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4205.070669 2021-02-19 04:16:11,369 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4023.702669 2021-02-19 04:16:11,696 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:12,015 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:12,279 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:16:12,303 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5898.577463 2021-02-19 04:16:12,411 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:12,473 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6174.720196 2021-02-19 04:16:12,595 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2501.274602 2021-02-19 04:16:12,661 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4178.821456 2021-02-19 04:16:12,674 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6165.935621 2021-02-19 04:16:12,974 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4169.240992 2021-02-19 04:16:13,286 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:13,634 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:13,941 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:16:13,967 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5898.577463 2021-02-19 04:16:14,030 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:14,084 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6174.720196 2021-02-19 04:16:14,213 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2501.274602 2021-02-19 04:16:14,296 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4178.821456 2021-02-19 04:16:14,305 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6165.935621 2021-02-19 04:16:14,588 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4169.240992 2021-02-19 04:16:14,875 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:15,233 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:15,573 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:16:15,634 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5898.577463 2021-02-19 04:16:15,674 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:15,736 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6098.220196 2021-02-19 04:16:15,829 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2483.974602 2021-02-19 04:16:15,910 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4165.421456 2021-02-19 04:16:15,920 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6267.135621 2021-02-19 04:16:16,198 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4309.240992 2021-02-19 04:16:16,463 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:16,821 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:17,230 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:17,282 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5848.377463 2021-02-19 04:16:17,296 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:17,378 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6098.220196 2021-02-19 04:16:17,447 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2483.974602 2021-02-19 04:16:17,532 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6267.135621 2021-02-19 04:16:17,551 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4165.421456 2021-02-19 04:16:17,803 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4309.240992 2021-02-19 04:16:18,062 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:18,424 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:18,841 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:18,904 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:18,927 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5848.377463 2021-02-19 04:16:19,023 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6098.220196 2021-02-19 04:16:19,075 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2483.974602 2021-02-19 04:16:19,191 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6267.135621 2021-02-19 04:16:19,201 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4165.421456 2021-02-19 04:16:19,408 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4309.240992 2021-02-19 04:16:19,677 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:20,032 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:20,494 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:20,529 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:20,552 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5848.377463 2021-02-19 04:16:20,665 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6098.220196 2021-02-19 04:16:20,716 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2483.974602 2021-02-19 04:16:20,815 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6267.135621 2021-02-19 04:16:20,825 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4165.421456 2021-02-19 04:16:21,023 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4309.240992 2021-02-19 04:16:21,305 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:21,630 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:22,170 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:22,186 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5848.377463 2021-02-19 04:16:22,191 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:22,303 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6130.300000 2021-02-19 04:16:22,342 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2442.200000 2021-02-19 04:16:22,427 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6237.100000 2021-02-19 04:16:22,437 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4195.100000 2021-02-19 04:16:22,653 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4339.800000 2021-02-19 04:16:22,914 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:23,240 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:23,809 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:23,823 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5864.200000 2021-02-19 04:16:23,838 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:23,957 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6130.300000 2021-02-19 04:16:23,969 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2442.200000 2021-02-19 04:16:24,107 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4195.100000 2021-02-19 04:16:24,115 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6237.100000 2021-02-19 04:16:24,273 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4339.800000 2021-02-19 04:16:24,510 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:24,826 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:25,427 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:25,473 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:25,482 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5864.200000 2021-02-19 04:16:25,598 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6130.300000 2021-02-19 04:16:25,609 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2442.200000 2021-02-19 04:16:25,744 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4198.500000 2021-02-19 04:16:25,766 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6143.500000 2021-02-19 04:16:25,897 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4316.400000 2021-02-19 04:16:26,115 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:26,428 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:27,046 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:27,096 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:27,138 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5877.300000 2021-02-19 04:16:27,250 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6173.600000 2021-02-19 04:16:27,263 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2387.600000 2021-02-19 04:16:27,371 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4198.500000 2021-02-19 04:16:27,405 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6143.500000 2021-02-19 04:16:27,548 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4316.400000 2021-02-19 04:16:27,740 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:28,016 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:28,668 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:28,732 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:28,775 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5877.300000 2021-02-19 04:16:28,882 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6173.600000 2021-02-19 04:16:28,894 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2387.600000 2021-02-19 04:16:28,986 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4198.500000 2021-02-19 04:16:29,036 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6143.500000 2021-02-19 04:16:29,167 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4316.400000 2021-02-19 04:16:29,371 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:29,637 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:30,321 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:30,349 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:30,385 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5877.300000 2021-02-19 04:16:30,529 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6173.600000 2021-02-19 04:16:30,546 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2387.600000 2021-02-19 04:16:30,608 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4198.500000 2021-02-19 04:16:30,655 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6143.500000 2021-02-19 04:16:30,773 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4316.400000 2021-02-19 04:16:30,999 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:31,257 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:31,956 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:31,973 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:32,003 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5877.300000 2021-02-19 04:16:32,184 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6173.600000 2021-02-19 04:16:32,200 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2387.600000 2021-02-19 04:16:32,240 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4198.500000 2021-02-19 04:16:32,280 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6092.600000 2021-02-19 04:16:32,408 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4213.500000 2021-02-19 04:16:32,598 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:32,878 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:33,605 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:16:33,628 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:33,641 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5844.000000 2021-02-19 04:16:33,834 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6141.100000 2021-02-19 04:16:33,862 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2365.400000 2021-02-19 04:16:33,878 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4268.800000 2021-02-19 04:16:33,910 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6092.600000 2021-02-19 04:16:34,032 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4213.500000 2021-02-19 04:16:34,206 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:34,480 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:35,240 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:35,253 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:16:35,269 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5844.000000 2021-02-19 04:16:35,523 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4268.800000 2021-02-19 04:16:35,526 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6141.100000 2021-02-19 04:16:35,536 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2365.400000 2021-02-19 04:16:35,559 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6092.600000 2021-02-19 04:16:35,657 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4126.200000 2021-02-19 04:16:35,811 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:36,094 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:36,838 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:36,862 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:16:36,881 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5827.500000 2021-02-19 04:16:37,121 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4363.000000 2021-02-19 04:16:37,181 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6096.100000 2021-02-19 04:16:37,203 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6200.000000 2021-02-19 04:16:37,209 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2428.600000 2021-02-19 04:16:37,332 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4126.200000 2021-02-19 04:16:37,433 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:37,687 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:38,440 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:38,479 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:16:38,520 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5827.500000 2021-02-19 04:16:38,742 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4363.000000 2021-02-19 04:16:38,795 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6096.100000 2021-02-19 04:16:38,828 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6200.000000 2021-02-19 04:16:38,838 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2428.600000 2021-02-19 04:16:38,953 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4126.200000 2021-02-19 04:16:39,066 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:39,272 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:40,051 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:40,132 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:16:40,164 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5827.500000 2021-02-19 04:16:40,380 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4363.000000 2021-02-19 04:16:40,430 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6096.100000 2021-02-19 04:16:40,469 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6200.000000 2021-02-19 04:16:40,476 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2428.600000 2021-02-19 04:16:40,576 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4126.200000 2021-02-19 04:16:40,678 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:40,864 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:41,703 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:41,793 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:16:41,805 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5827.500000 2021-02-19 04:16:42,039 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4363.000000 2021-02-19 04:16:42,069 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6096.100000 2021-02-19 04:16:42,105 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2428.600000 2021-02-19 04:16:42,144 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6200.000000 2021-02-19 04:16:42,200 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4126.200000 2021-02-19 04:16:42,288 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:42,456 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:43,325 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:43,417 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:43,437 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5901.800000 2021-02-19 04:16:43,696 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4396.100000 2021-02-19 04:16:43,713 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6144.800000 2021-02-19 04:16:43,733 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2463.400000 2021-02-19 04:16:43,812 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6292.400000 2021-02-19 04:16:43,831 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4166.000000 2021-02-19 04:16:43,921 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:44,068 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:44,957 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:45,049 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:45,069 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5901.800000 2021-02-19 04:16:45,358 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6144.800000 2021-02-19 04:16:45,368 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2463.400000 2021-02-19 04:16:45,378 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4396.100000 2021-02-19 04:16:45,443 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6292.400000 2021-02-19 04:16:45,509 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4166.000000 2021-02-19 04:16:45,538 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:45,674 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:46,549 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:46,658 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:46,680 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5947.300000 2021-02-19 04:16:46,992 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6155.400000 2021-02-19 04:16:47,028 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2400.600000 2021-02-19 04:16:47,035 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4407.700000 2021-02-19 04:16:47,062 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6322.300000 2021-02-19 04:16:47,135 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4171.400000 2021-02-19 04:16:47,157 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:47,282 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:48,187 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:48,279 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:48,332 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5947.300000 2021-02-19 04:16:48,655 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2400.600000 2021-02-19 04:16:48,668 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6155.400000 2021-02-19 04:16:48,694 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6322.300000 2021-02-19 04:16:48,706 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4407.700000 2021-02-19 04:16:48,775 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4171.400000 2021-02-19 04:16:48,801 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:48,888 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:49,802 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:49,884 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:49,959 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5947.300000 2021-02-19 04:16:50,299 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2400.600000 2021-02-19 04:16:50,312 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6155.400000 2021-02-19 04:16:50,358 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4407.700000 2021-02-19 04:16:50,361 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6322.300000 2021-02-19 04:16:50,421 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4171.400000 2021-02-19 04:16:50,430 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:50,526 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:51,421 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:51,503 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:51,589 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5947.300000 2021-02-19 04:16:51,983 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2400.600000 2021-02-19 04:16:51,993 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6155.400000 2021-02-19 04:16:52,002 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4407.700000 2021-02-19 04:16:52,026 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6322.300000 2021-02-19 04:16:52,091 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4171.400000 2021-02-19 04:16:52,096 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:52,163 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:53,039 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:53,138 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:53,210 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5922.417273 2021-02-19 04:16:53,622 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2418.505038 2021-02-19 04:16:53,642 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6144.669692 2021-02-19 04:16:53,651 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4415.215154 2021-02-19 04:16:53,670 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6344.127549 2021-02-19 04:16:53,730 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4093.989324 2021-02-19 04:16:53,743 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:53,802 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:54,641 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:54,747 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:54,838 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5922.417273 2021-02-19 04:16:55,262 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2418.505038 2021-02-19 04:16:55,289 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6344.127549 2021-02-19 04:16:55,336 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4415.215154 2021-02-19 04:16:55,351 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6144.669692 2021-02-19 04:16:55,378 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:55,381 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4093.989324 2021-02-19 04:16:55,424 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:56,246 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:56,365 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:16:56,443 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5872.417273 2021-02-19 04:16:56,900 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2502.105038 2021-02-19 04:16:56,933 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6383.927549 2021-02-19 04:16:57,020 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4443.715154 2021-02-19 04:16:57,029 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6172.969692 2021-02-19 04:16:57,046 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:57,049 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:57,055 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4080.789324 2021-02-19 04:16:57,868 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:57,980 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.200000 2021-02-19 04:16:58,055 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5872.417273 2021-02-19 04:16:58,523 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2502.105038 2021-02-19 04:16:58,555 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6383.927549 2021-02-19 04:16:58,677 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4443.715154 2021-02-19 04:16:58,690 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:16:58,701 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:16:58,730 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6172.969692 2021-02-19 04:16:58,743 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4080.789324 2021-02-19 04:16:59,496 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:16:59,591 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.200000 2021-02-19 04:16:59,674 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5872.417273 2021-02-19 04:17:00,164 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2502.105038 2021-02-19 04:17:00,177 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6383.927549 2021-02-19 04:17:00,342 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4443.715154 2021-02-19 04:17:00,352 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:00,364 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6172.969692 2021-02-19 04:17:00,378 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:00,395 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4080.789324 2021-02-19 04:17:01,094 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:01,203 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.200000 2021-02-19 04:17:01,282 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5872.417273 2021-02-19 04:17:01,782 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2502.105038 2021-02-19 04:17:01,808 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6383.927549 2021-02-19 04:17:01,997 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4443.715154 2021-02-19 04:17:02,012 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:02,019 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6172.969692 2021-02-19 04:17:02,046 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:02,065 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4080.789324 2021-02-19 04:17:02,716 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:02,819 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.200000 2021-02-19 04:17:02,907 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5794.751661 2021-02-19 04:17:03,407 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2501.894878 2021-02-19 04:17:03,444 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6426.889636 2021-02-19 04:17:03,648 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4417.674430 2021-02-19 04:17:03,673 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6192.638175 2021-02-19 04:17:03,696 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:03,700 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:03,711 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4137.033173 2021-02-19 04:17:04,331 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:04,440 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.200000 2021-02-19 04:17:04,523 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5794.751661 2021-02-19 04:17:05,028 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2501.894878 2021-02-19 04:17:05,061 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6426.889636 2021-02-19 04:17:05,309 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4417.674430 2021-02-19 04:17:05,321 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6192.638175 2021-02-19 04:17:05,334 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:05,361 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4137.033173 2021-02-19 04:17:05,367 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:05,926 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:06,055 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:17:06,150 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5812.491657 2021-02-19 04:17:06,644 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2448.767934 2021-02-19 04:17:06,680 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6438.760833 2021-02-19 04:17:06,951 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6175.889904 2021-02-19 04:17:06,993 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4329.588321 2021-02-19 04:17:07,015 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:07,035 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4156.588980 2021-02-19 04:17:07,058 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:07,523 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:07,676 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:17:07,753 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5812.491657 2021-02-19 04:17:08,267 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2448.767934 2021-02-19 04:17:08,312 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6438.760833 2021-02-19 04:17:08,581 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6175.889904 2021-02-19 04:17:08,622 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4329.588321 2021-02-19 04:17:08,661 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4156.588980 2021-02-19 04:17:08,678 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:08,721 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:09,114 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:09,275 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:17:09,364 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5812.491657 2021-02-19 04:17:09,877 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2448.767934 2021-02-19 04:17:09,920 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6438.760833 2021-02-19 04:17:10,204 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6175.889904 2021-02-19 04:17:10,257 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4329.588321 2021-02-19 04:17:10,312 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4156.588980 2021-02-19 04:17:10,319 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:10,351 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:10,703 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:10,888 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:17:10,963 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5812.491657 2021-02-19 04:17:11,489 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2448.767934 2021-02-19 04:17:11,540 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6438.760833 2021-02-19 04:17:11,848 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6175.889904 2021-02-19 04:17:11,887 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4329.588321 2021-02-19 04:17:11,931 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4156.588980 2021-02-19 04:17:11,946 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:11,980 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:12,325 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:12,505 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:17:12,589 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5941.739996 2021-02-19 04:17:13,096 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2440.273056 2021-02-19 04:17:13,190 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6397.171197 2021-02-19 04:17:13,493 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6098.351729 2021-02-19 04:17:13,509 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4368.613892 2021-02-19 04:17:13,549 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4137.855807 2021-02-19 04:17:13,571 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:13,632 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:13,930 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:14,128 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:17:14,190 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5941.739996 2021-02-19 04:17:14,714 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2440.273056 2021-02-19 04:17:14,809 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6397.171197 2021-02-19 04:17:15,138 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6098.351729 2021-02-19 04:17:15,170 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4368.613892 2021-02-19 04:17:15,180 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4137.855807 2021-02-19 04:17:15,191 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:15,230 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:15,542 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:15,740 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:17:15,806 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6005.301859 2021-02-19 04:17:16,334 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2466.457346 2021-02-19 04:17:16,424 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6327.612932 2021-02-19 04:17:16,753 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6068.369718 2021-02-19 04:17:16,796 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4468.853748 2021-02-19 04:17:16,809 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4115.169418 2021-02-19 04:17:16,819 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:16,858 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:17,147 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:17,345 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:17:17,405 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6005.301859 2021-02-19 04:17:17,933 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2466.457346 2021-02-19 04:17:18,045 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6327.612932 2021-02-19 04:17:18,372 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6068.369718 2021-02-19 04:17:18,408 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4468.853748 2021-02-19 04:17:18,434 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4115.169418 2021-02-19 04:17:18,466 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:18,503 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:18,736 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:18,940 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:17:19,003 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6005.301859 2021-02-19 04:17:19,549 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2466.457346 2021-02-19 04:17:19,650 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6327.612932 2021-02-19 04:17:19,986 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6068.369718 2021-02-19 04:17:20,048 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4468.853748 2021-02-19 04:17:20,075 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4115.169418 2021-02-19 04:17:20,089 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:20,118 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:20,335 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:20,591 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:17:20,630 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6005.301859 2021-02-19 04:17:21,168 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2466.457346 2021-02-19 04:17:21,278 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6327.612932 2021-02-19 04:17:21,611 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6068.369718 2021-02-19 04:17:21,694 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4115.169418 2021-02-19 04:17:21,713 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:21,730 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4468.853748 2021-02-19 04:17:21,769 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:21,924 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:22,197 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:17:22,247 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6005.301859 2021-02-19 04:17:22,760 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2483.457346 2021-02-19 04:17:22,910 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6349.112932 2021-02-19 04:17:23,220 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6201.369718 2021-02-19 04:17:23,331 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4103.469418 2021-02-19 04:17:23,348 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:23,359 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4395.553748 2021-02-19 04:17:23,391 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:23,538 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:23,799 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:17:23,869 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5943.901859 2021-02-19 04:17:24,361 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2483.457346 2021-02-19 04:17:24,506 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6349.112932 2021-02-19 04:17:24,832 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6201.369718 2021-02-19 04:17:24,967 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:25,003 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4103.469418 2021-02-19 04:17:25,015 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4395.553748 2021-02-19 04:17:25,026 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:25,160 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:25,417 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:17:25,487 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5943.901859 2021-02-19 04:17:25,954 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2480.970581 2021-02-19 04:17:26,118 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6416.563769 2021-02-19 04:17:26,440 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6285.440362 2021-02-19 04:17:26,618 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:26,698 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4143.927428 2021-02-19 04:17:26,706 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:26,707 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4288.841112 2021-02-19 04:17:26,792 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:27,036 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:17:27,099 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5896.884965 2021-02-19 04:17:27,568 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2480.970581 2021-02-19 04:17:27,723 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6416.563769 2021-02-19 04:17:28,065 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6285.440362 2021-02-19 04:17:28,242 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:28,329 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:28,388 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4143.927428 2021-02-19 04:17:28,395 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4288.841112 2021-02-19 04:17:28,450 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:28,648 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:17:28,697 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5896.884965 2021-02-19 04:17:29,171 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2480.970581 2021-02-19 04:17:29,421 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6416.563769 2021-02-19 04:17:29,730 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6285.440362 2021-02-19 04:17:29,871 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:29,943 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:30,015 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4143.927428 2021-02-19 04:17:30,030 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4288.841112 2021-02-19 04:17:30,076 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:30,263 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:17:30,316 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5896.884965 2021-02-19 04:17:30,775 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2480.970581 2021-02-19 04:17:31,039 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6416.563769 2021-02-19 04:17:31,378 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6285.440362 2021-02-19 04:17:31,546 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:31,584 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:31,648 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4143.927428 2021-02-19 04:17:31,657 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4288.841112 2021-02-19 04:17:31,707 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:31,872 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:17:31,918 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5896.884965 2021-02-19 04:17:32,375 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2481.270581 2021-02-19 04:17:32,674 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6418.363769 2021-02-19 04:17:32,993 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6274.540362 2021-02-19 04:17:33,200 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:33,227 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:33,276 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4174.427428 2021-02-19 04:17:33,290 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4364.141112 2021-02-19 04:17:33,341 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:33,500 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.100000 2021-02-19 04:17:33,552 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5862.784965 2021-02-19 04:17:34,010 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2481.270581 2021-02-19 04:17:34,305 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6418.363769 2021-02-19 04:17:34,601 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6274.540362 2021-02-19 04:17:34,822 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:34,842 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:34,900 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4174.427428 2021-02-19 04:17:34,910 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4364.141112 2021-02-19 04:17:34,956 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:35,111 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.100000 2021-02-19 04:17:35,174 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5862.784965 2021-02-19 04:17:35,619 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2481.270581 2021-02-19 04:17:35,908 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6440.210970 2021-02-19 04:17:36,206 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6259.507557 2021-02-19 04:17:36,441 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:36,467 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:36,542 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4466.115114 2021-02-19 04:17:36,552 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4142.553598 2021-02-19 04:17:36,588 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:36,716 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.100000 2021-02-19 04:17:36,799 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5837.832439 2021-02-19 04:17:36,805 | infra | INFO | pool-2-thread-27 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:17:36,805 | infra | INFO | pool-2-thread-27 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:17:37,224 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2505.833850 2021-02-19 04:17:37,529 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6440.210970 2021-02-19 04:17:37,822 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6259.507557 2021-02-19 04:17:38,108 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:38,142 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:38,216 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4466.115114 2021-02-19 04:17:38,230 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:38,276 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4142.553598 2021-02-19 04:17:38,355 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.100000 2021-02-19 04:17:38,411 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5837.832439 2021-02-19 04:17:38,828 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2505.833850 2021-02-19 04:17:39,132 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6440.210970 2021-02-19 04:17:39,420 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6259.507557 2021-02-19 04:17:39,723 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:39,786 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:39,844 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4466.115114 2021-02-19 04:17:39,898 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4142.553598 2021-02-19 04:17:39,905 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:40,013 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.100000 2021-02-19 04:17:40,032 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5837.832439 2021-02-19 04:17:40,434 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2505.833850 2021-02-19 04:17:40,730 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6440.210970 2021-02-19 04:17:41,042 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6259.507557 2021-02-19 04:17:41,332 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:41,476 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4466.115114 2021-02-19 04:17:41,490 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:41,529 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:41,596 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4142.553598 2021-02-19 04:17:41,655 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.100000 2021-02-19 04:17:41,660 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5837.832439 2021-02-19 04:17:42,038 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2505.833850 2021-02-19 04:17:42,338 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6513.010970 2021-02-19 04:17:42,644 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6288.807557 2021-02-19 04:17:42,950 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:43,111 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4504.515114 2021-02-19 04:17:43,155 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:43,214 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:43,299 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4164.753598 2021-02-19 04:17:43,309 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:17:43,352 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5943.832439 2021-02-19 04:17:43,657 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2523.533850 2021-02-19 04:17:43,930 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6513.010970 2021-02-19 04:17:44,269 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6288.807557 2021-02-19 04:17:44,611 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:44,793 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4504.515114 2021-02-19 04:17:44,806 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:44,851 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:44,959 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:17:44,976 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4164.753598 2021-02-19 04:17:44,994 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5943.832439 2021-02-19 04:17:45,292 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2523.533850 2021-02-19 04:17:45,563 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6513.010970 2021-02-19 04:17:45,900 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6425.820436 2021-02-19 04:17:46,216 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:46,441 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:46,500 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4504.515114 2021-02-19 04:17:46,509 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:46,615 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4226.615009 2021-02-19 04:17:46,635 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6108.936974 2021-02-19 04:17:46,648 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599580 2021-02-19 04:17:46,921 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2549.200150 2021-02-19 04:17:47,178 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6568.297212 2021-02-19 04:17:47,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6425.820436 2021-02-19 04:17:47,826 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:48,072 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:48,111 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4579.879934 2021-02-19 04:17:48,125 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:48,278 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6108.936974 2021-02-19 04:17:48,319 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4226.615009 2021-02-19 04:17:48,342 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599580 2021-02-19 04:17:48,522 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2549.200150 2021-02-19 04:17:48,793 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6568.297212 2021-02-19 04:17:49,130 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6425.820436 2021-02-19 04:17:49,421 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:49,684 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:49,740 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4579.879934 2021-02-19 04:17:49,743 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:49,917 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6108.936974 2021-02-19 04:17:49,937 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4226.615009 2021-02-19 04:17:49,963 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599580 2021-02-19 04:17:50,147 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2549.200150 2021-02-19 04:17:50,407 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6568.297212 2021-02-19 04:17:50,730 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6425.820436 2021-02-19 04:17:51,039 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:51,312 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:51,368 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:51,381 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4579.879934 2021-02-19 04:17:51,586 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6108.936974 2021-02-19 04:17:51,621 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4226.615009 2021-02-19 04:17:51,641 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599580 2021-02-19 04:17:51,769 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2549.200150 2021-02-19 04:17:52,016 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6568.297212 2021-02-19 04:17:52,352 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6606.520436 2021-02-19 04:17:52,661 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:52,951 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:52,987 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:53,016 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4602.479934 2021-02-19 04:17:53,211 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6221.836974 2021-02-19 04:17:53,259 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4190.115009 2021-02-19 04:17:53,269 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599580 2021-02-19 04:17:53,423 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2633.300150 2021-02-19 04:17:53,631 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6548.797212 2021-02-19 04:17:53,959 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6606.520436 2021-02-19 04:17:54,260 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:54,578 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:54,604 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:54,628 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4602.479934 2021-02-19 04:17:54,858 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6221.836974 2021-02-19 04:17:54,881 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4190.115009 2021-02-19 04:17:54,892 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599580 2021-02-19 04:17:55,059 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2633.300150 2021-02-19 04:17:55,246 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6548.797212 2021-02-19 04:17:55,558 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6606.520436 2021-02-19 04:17:55,858 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:56,186 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:56,213 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:56,233 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4559.289833 2021-02-19 04:17:56,480 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6228.267527 2021-02-19 04:17:56,510 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4117.934464 2021-02-19 04:17:56,513 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300210 2021-02-19 04:17:56,673 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2692.841529 2021-02-19 04:17:56,858 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6495.865736 2021-02-19 04:17:57,160 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6643.105174 2021-02-19 04:17:57,456 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:57,793 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:57,832 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:57,871 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4559.289833 2021-02-19 04:17:58,134 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6228.267527 2021-02-19 04:17:58,150 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4117.934464 2021-02-19 04:17:58,158 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300210 2021-02-19 04:17:58,315 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2692.841529 2021-02-19 04:17:58,469 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6495.865736 2021-02-19 04:17:58,769 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6643.105174 2021-02-19 04:17:59,046 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:17:59,414 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:17:59,446 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:17:59,480 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4559.289833 2021-02-19 04:17:59,770 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6228.267527 2021-02-19 04:17:59,809 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4117.934464 2021-02-19 04:17:59,816 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300210 2021-02-19 04:17:59,923 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2692.841529 2021-02-19 04:18:00,101 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6495.865736 2021-02-19 04:18:00,401 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6643.105174 2021-02-19 04:18:00,438 | infra | INFO | pool-2-thread-63 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:18:00,440 | infra | INFO | pool-2-thread-63 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:18:00,641 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:01,029 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:01,062 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:01,128 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4559.289833 2021-02-19 04:18:01,401 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6228.267527 2021-02-19 04:18:01,470 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300210 2021-02-19 04:18:01,496 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4117.934464 2021-02-19 04:18:01,526 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2692.841529 2021-02-19 04:18:01,700 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6495.865736 2021-02-19 04:18:01,994 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6643.105174 2021-02-19 04:18:02,246 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:02,660 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:02,667 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:02,755 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4550.789833 2021-02-19 04:18:03,009 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6178.667527 2021-02-19 04:18:03,081 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300210 2021-02-19 04:18:03,145 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4143.034464 2021-02-19 04:18:03,165 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2665.741529 2021-02-19 04:18:03,331 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6448.365736 2021-02-19 04:18:03,591 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6550.405174 2021-02-19 04:18:03,868 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:04,296 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:04,299 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:04,368 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4550.789833 2021-02-19 04:18:04,631 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6178.667527 2021-02-19 04:18:04,713 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300210 2021-02-19 04:18:04,762 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4143.034464 2021-02-19 04:18:04,803 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2665.741529 2021-02-19 04:18:04,970 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6448.365736 2021-02-19 04:18:05,214 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6550.405174 2021-02-19 04:18:05,457 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:05,951 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:05,980 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:06,026 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4547.900000 2021-02-19 04:18:06,244 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6101.800000 2021-02-19 04:18:06,336 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:18:06,395 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4131.500000 2021-02-19 04:18:06,448 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2631.700000 2021-02-19 04:18:06,585 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6359.200000 2021-02-19 04:18:06,851 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6684.000000 2021-02-19 04:18:07,066 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:07,604 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:07,618 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:07,665 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4547.900000 2021-02-19 04:18:07,868 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6101.800000 2021-02-19 04:18:07,989 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:18:08,032 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4131.500000 2021-02-19 04:18:08,102 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2631.700000 2021-02-19 04:18:08,224 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6359.200000 2021-02-19 04:18:08,460 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6684.000000 2021-02-19 04:18:08,660 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:09,224 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:09,233 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:09,288 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4547.900000 2021-02-19 04:18:09,480 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6101.800000 2021-02-19 04:18:09,608 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:18:09,645 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4131.500000 2021-02-19 04:18:09,723 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2631.700000 2021-02-19 04:18:09,832 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6359.200000 2021-02-19 04:18:10,078 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6684.000000 2021-02-19 04:18:10,265 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:10,835 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:10,862 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:10,943 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4547.900000 2021-02-19 04:18:11,098 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6101.800000 2021-02-19 04:18:11,223 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:18:11,272 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4131.500000 2021-02-19 04:18:11,336 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2631.700000 2021-02-19 04:18:11,464 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6359.200000 2021-02-19 04:18:11,726 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6684.000000 2021-02-19 04:18:11,888 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:12,447 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:12,457 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:12,572 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4477.600000 2021-02-19 04:18:12,721 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5979.300000 2021-02-19 04:18:12,831 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:18:12,891 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4031.900000 2021-02-19 04:18:12,977 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2630.800000 2021-02-19 04:18:13,092 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6188.400000 2021-02-19 04:18:13,346 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7187.200000 2021-02-19 04:18:13,490 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:14,072 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:14,092 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:14,213 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4477.600000 2021-02-19 04:18:14,361 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5979.300000 2021-02-19 04:18:14,464 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:18:14,516 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4031.900000 2021-02-19 04:18:14,605 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2630.800000 2021-02-19 04:18:14,717 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6188.400000 2021-02-19 04:18:14,964 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7187.200000 2021-02-19 04:18:15,092 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:15,694 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:15,711 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:15,835 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4418.149381 2021-02-19 04:18:15,973 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5919.648062 2021-02-19 04:18:16,073 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:18:16,121 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4058.622693 2021-02-19 04:18:16,233 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2630.427247 2021-02-19 04:18:16,325 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6101.027727 2021-02-19 04:18:16,588 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7545.657811 2021-02-19 04:18:16,684 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:17,312 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:17,342 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:17,453 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4418.149381 2021-02-19 04:18:17,585 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5919.648062 2021-02-19 04:18:17,698 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:18:17,746 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4058.622693 2021-02-19 04:18:17,864 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2630.427247 2021-02-19 04:18:17,940 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6101.027727 2021-02-19 04:18:18,204 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7545.657811 2021-02-19 04:18:18,311 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:18,956 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:18,961 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:19,081 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4418.149381 2021-02-19 04:18:19,197 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5919.648062 2021-02-19 04:18:19,303 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:18:19,362 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4058.622693 2021-02-19 04:18:19,496 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2630.427247 2021-02-19 04:18:19,559 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6101.027727 2021-02-19 04:18:19,836 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7545.657811 2021-02-19 04:18:19,947 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:20,585 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:20,621 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:20,709 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4418.149381 2021-02-19 04:18:20,816 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5919.648062 2021-02-19 04:18:20,999 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:18:21,032 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4058.622693 2021-02-19 04:18:21,107 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2630.427247 2021-02-19 04:18:21,184 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6101.027727 2021-02-19 04:18:21,451 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7545.657811 2021-02-19 04:18:21,539 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:22,191 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:22,250 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:22,311 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4442.749381 2021-02-19 04:18:22,440 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5897.848062 2021-02-19 04:18:22,654 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:18:22,670 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4093.922693 2021-02-19 04:18:22,770 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2560.527247 2021-02-19 04:18:22,819 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6150.427727 2021-02-19 04:18:23,065 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7589.157811 2021-02-19 04:18:23,148 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:23,790 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:23,859 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:23,918 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4442.749381 2021-02-19 04:18:24,043 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5897.848062 2021-02-19 04:18:24,299 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:18:24,302 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4093.922693 2021-02-19 04:18:24,391 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2560.527247 2021-02-19 04:18:24,457 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6150.427727 2021-02-19 04:18:24,681 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7589.157811 2021-02-19 04:18:24,753 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:25,388 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:25,476 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:25,552 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4442.749381 2021-02-19 04:18:25,664 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5897.848062 2021-02-19 04:18:25,934 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:18:25,938 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4029.099519 2021-02-19 04:18:26,007 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2504.305286 2021-02-19 04:18:26,073 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6149.871606 2021-02-19 04:18:26,295 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7599.054065 2021-02-19 04:18:26,381 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:26,977 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:27,105 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:27,171 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4437.344133 2021-02-19 04:18:27,285 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5858.004125 2021-02-19 04:18:27,556 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4029.099519 2021-02-19 04:18:27,573 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:18:27,630 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2504.305286 2021-02-19 04:18:27,694 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6149.871606 2021-02-19 04:18:27,917 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7599.054065 2021-02-19 04:18:27,982 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:28,588 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:28,744 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:28,822 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4437.344133 2021-02-19 04:18:28,918 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5858.004125 2021-02-19 04:18:29,191 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4029.099519 2021-02-19 04:18:29,191 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:18:29,255 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2504.305286 2021-02-19 04:18:29,315 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6149.871606 2021-02-19 04:18:29,535 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7599.054065 2021-02-19 04:18:29,595 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:30,176 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:30,372 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:30,434 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4437.344133 2021-02-19 04:18:30,556 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5858.004125 2021-02-19 04:18:30,834 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:18:30,877 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2504.305286 2021-02-19 04:18:30,878 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4029.099519 2021-02-19 04:18:30,927 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6149.871606 2021-02-19 04:18:31,170 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7599.054065 2021-02-19 04:18:31,206 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:31,769 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:31,996 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:32,045 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4437.344133 2021-02-19 04:18:32,167 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5858.004125 2021-02-19 04:18:32,438 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:18:32,502 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2503.505286 2021-02-19 04:18:32,506 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4040.799519 2021-02-19 04:18:32,543 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6050.671606 2021-02-19 04:18:32,799 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7610.454065 2021-02-19 04:18:32,826 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:33,362 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:33,637 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:33,694 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4378.244133 2021-02-19 04:18:33,789 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5874.004125 2021-02-19 04:18:34,062 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:18:34,135 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4040.799519 2021-02-19 04:18:34,160 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2503.505286 2021-02-19 04:18:34,181 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6050.671606 2021-02-19 04:18:34,410 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7610.454065 2021-02-19 04:18:34,431 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:34,966 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:35,299 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:35,349 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4378.244133 2021-02-19 04:18:35,415 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5874.004125 2021-02-19 04:18:35,683 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:18:35,756 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4056.200000 2021-02-19 04:18:35,780 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2521.400000 2021-02-19 04:18:35,799 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5964.500000 2021-02-19 04:18:36,013 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7655.300000 2021-02-19 04:18:36,043 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:36,569 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:36,905 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:36,984 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4315.100000 2021-02-19 04:18:37,055 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5936.800000 2021-02-19 04:18:37,293 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:18:37,364 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4056.200000 2021-02-19 04:18:37,438 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5964.500000 2021-02-19 04:18:37,454 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2521.400000 2021-02-19 04:18:37,663 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7655.300000 2021-02-19 04:18:37,677 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:38,177 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:38,509 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:38,588 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4315.100000 2021-02-19 04:18:38,663 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5936.800000 2021-02-19 04:18:38,960 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:18:38,983 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4056.200000 2021-02-19 04:18:39,089 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2521.400000 2021-02-19 04:18:39,115 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5964.500000 2021-02-19 04:18:39,283 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:39,303 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7655.300000 2021-02-19 04:18:39,769 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:40,138 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:40,198 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4315.100000 2021-02-19 04:18:40,289 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5936.800000 2021-02-19 04:18:40,569 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:18:40,619 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4056.200000 2021-02-19 04:18:40,706 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2521.400000 2021-02-19 04:18:40,736 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5964.500000 2021-02-19 04:18:40,924 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:40,928 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7655.300000 2021-02-19 04:18:41,374 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:41,746 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:41,819 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4315.100000 2021-02-19 04:18:41,907 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5936.800000 2021-02-19 04:18:42,190 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.500000 2021-02-19 04:18:42,230 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4056.200000 2021-02-19 04:18:42,336 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2562.600000 2021-02-19 04:18:42,358 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5793.400000 2021-02-19 04:18:42,549 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:42,568 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7677.000000 2021-02-19 04:18:42,986 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:43,364 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:43,444 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4252.300000 2021-02-19 04:18:43,526 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5954.600000 2021-02-19 04:18:43,845 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.600000 2021-02-19 04:18:43,924 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4010.100000 2021-02-19 04:18:43,947 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2562.600000 2021-02-19 04:18:43,973 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5793.400000 2021-02-19 04:18:44,164 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:44,176 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7677.000000 2021-02-19 04:18:44,585 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:44,990 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:45,089 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4252.300000 2021-02-19 04:18:45,190 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5954.600000 2021-02-19 04:18:45,464 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.700000 2021-02-19 04:18:45,553 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4010.100000 2021-02-19 04:18:45,572 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2562.600000 2021-02-19 04:18:45,607 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5793.400000 2021-02-19 04:18:45,767 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:45,842 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7666.000000 2021-02-19 04:18:46,194 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:46,602 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:46,752 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4240.600000 2021-02-19 04:18:46,818 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5955.200000 2021-02-19 04:18:47,066 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.700000 2021-02-19 04:18:47,219 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2557.800000 2021-02-19 04:18:47,269 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4015.200000 2021-02-19 04:18:47,283 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5622.400000 2021-02-19 04:18:47,367 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:47,447 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7666.000000 2021-02-19 04:18:47,789 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:48,288 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:48,421 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4240.600000 2021-02-19 04:18:48,463 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5955.200000 2021-02-19 04:18:48,681 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.700000 2021-02-19 04:18:48,855 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2557.800000 2021-02-19 04:18:48,904 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4015.200000 2021-02-19 04:18:48,917 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5622.400000 2021-02-19 04:18:48,982 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:49,059 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7666.000000 2021-02-19 04:18:49,388 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:49,937 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:50,043 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4240.600000 2021-02-19 04:18:50,102 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5955.200000 2021-02-19 04:18:50,286 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.700000 2021-02-19 04:18:50,469 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2557.800000 2021-02-19 04:18:50,513 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4015.200000 2021-02-19 04:18:50,528 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5622.400000 2021-02-19 04:18:50,595 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:50,671 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7666.000000 2021-02-19 04:18:50,997 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:51,569 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:51,681 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4240.600000 2021-02-19 04:18:51,723 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5955.200000 2021-02-19 04:18:51,911 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.700000 2021-02-19 04:18:52,135 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2557.800000 2021-02-19 04:18:52,151 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5622.400000 2021-02-19 04:18:52,174 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4015.200000 2021-02-19 04:18:52,196 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:52,278 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7731.200000 2021-02-19 04:18:52,602 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:53,161 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:53,209 | infra | INFO | pool-2-thread-25 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' completed 2021-02-19 04:18:53,209 | infra | INFO | pool-2-thread-25 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:18:53,282 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4191.700000 2021-02-19 04:18:53,336 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6044.600000 2021-02-19 04:18:53,520 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.600000 2021-02-19 04:18:53,753 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2492.700000 2021-02-19 04:18:53,789 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5616.600000 2021-02-19 04:18:53,805 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4041.100000 2021-02-19 04:18:53,818 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:53,911 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7731.200000 2021-02-19 04:18:54,187 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:54,769 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:54,927 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4191.700000 2021-02-19 04:18:54,960 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6044.600000 2021-02-19 04:18:55,121 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.600000 2021-02-19 04:18:55,364 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2492.700000 2021-02-19 04:18:55,421 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5616.600000 2021-02-19 04:18:55,447 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:55,447 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4041.100000 2021-02-19 04:18:55,548 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7731.200000 2021-02-19 04:18:55,792 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:56,378 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:56,555 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4138.800000 2021-02-19 04:18:56,576 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6127.500000 2021-02-19 04:18:56,749 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:18:56,976 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2428.700000 2021-02-19 04:18:57,075 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5615.400000 2021-02-19 04:18:57,091 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4064.900000 2021-02-19 04:18:57,108 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:57,209 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7845.600000 2021-02-19 04:18:57,381 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:57,384 | infra | INFO | pool-2-thread-19 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:18:57,384 | infra | INFO | pool-2-thread-19 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:18:57,984 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:58,201 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6127.500000 2021-02-19 04:18:58,219 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4138.800000 2021-02-19 04:18:58,362 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:18:58,599 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2428.700000 2021-02-19 04:18:58,688 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5615.400000 2021-02-19 04:18:58,711 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4064.900000 2021-02-19 04:18:58,714 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:18:58,838 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7845.600000 2021-02-19 04:18:58,964 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:18:59,578 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:18:59,836 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6127.500000 2021-02-19 04:18:59,844 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4138.800000 2021-02-19 04:18:59,976 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:00,220 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2428.700000 2021-02-19 04:19:00,328 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5615.400000 2021-02-19 04:19:00,342 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:00,364 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4064.900000 2021-02-19 04:19:00,457 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7845.600000 2021-02-19 04:19:00,582 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:01,196 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:01,453 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6127.500000 2021-02-19 04:19:01,463 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4138.800000 2021-02-19 04:19:01,578 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:01,831 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2428.700000 2021-02-19 04:19:02,002 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4064.900000 2021-02-19 04:19:02,033 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:02,039 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5615.400000 2021-02-19 04:19:02,088 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7845.600000 2021-02-19 04:19:02,233 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:02,802 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:03,085 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4206.000000 2021-02-19 04:19:03,095 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6172.500000 2021-02-19 04:19:03,176 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:03,453 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2438.100000 2021-02-19 04:19:03,641 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4132.500000 2021-02-19 04:19:03,655 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:03,681 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5581.000000 2021-02-19 04:19:03,713 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7949.000000 2021-02-19 04:19:03,832 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:04,388 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:04,694 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4206.000000 2021-02-19 04:19:04,723 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6172.500000 2021-02-19 04:19:04,779 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:05,068 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2438.100000 2021-02-19 04:19:05,279 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4132.500000 2021-02-19 04:19:05,288 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:05,319 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5581.000000 2021-02-19 04:19:05,345 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7949.000000 2021-02-19 04:19:05,444 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:05,976 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:06,299 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4330.800000 2021-02-19 04:19:06,322 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6260.600000 2021-02-19 04:19:06,384 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:06,668 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2492.900000 2021-02-19 04:19:06,776 | infra | INFO | pool-2-thread-32 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:19:06,776 | infra | INFO | pool-2-thread-32 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:19:06,887 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4218.300000 2021-02-19 04:19:06,894 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:06,928 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5536.900000 2021-02-19 04:19:06,983 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8039.700000 2021-02-19 04:19:07,062 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:07,579 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:07,924 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4330.800000 2021-02-19 04:19:07,960 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6260.600000 2021-02-19 04:19:08,019 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:08,282 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2492.900000 2021-02-19 04:19:08,532 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:08,543 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4218.300000 2021-02-19 04:19:08,555 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5536.900000 2021-02-19 04:19:08,592 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8039.700000 2021-02-19 04:19:08,657 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:09,173 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:09,532 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4330.800000 2021-02-19 04:19:09,572 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6260.600000 2021-02-19 04:19:09,634 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:09,871 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2492.900000 2021-02-19 04:19:10,131 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:10,227 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4218.300000 2021-02-19 04:19:10,233 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5536.900000 2021-02-19 04:19:10,256 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8039.700000 2021-02-19 04:19:10,298 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:10,779 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:11,151 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4330.800000 2021-02-19 04:19:11,203 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6260.600000 2021-02-19 04:19:11,246 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:11,467 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2492.900000 2021-02-19 04:19:11,727 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:11,871 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4218.300000 2021-02-19 04:19:11,890 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5536.900000 2021-02-19 04:19:11,898 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8039.700000 2021-02-19 04:19:11,901 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:12,371 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:12,765 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4527.100000 2021-02-19 04:19:12,831 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6465.300000 2021-02-19 04:19:12,858 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:13,069 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2562.300000 2021-02-19 04:19:13,325 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:13,526 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4415.200000 2021-02-19 04:19:13,533 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7388.300000 2021-02-19 04:19:13,552 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:13,561 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5508.200000 2021-02-19 04:19:13,950 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:14,378 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4527.100000 2021-02-19 04:19:14,448 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6465.300000 2021-02-19 04:19:14,459 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:14,657 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2562.300000 2021-02-19 04:19:14,924 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:15,176 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4415.200000 2021-02-19 04:19:15,188 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:15,227 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7388.300000 2021-02-19 04:19:15,279 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5508.200000 2021-02-19 04:19:15,543 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:15,999 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4650.600000 2021-02-19 04:19:16,023 | infra | INFO | pool-2-thread-40 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:19:16,023 | infra | INFO | pool-2-thread-40 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' started 2021-02-19 04:19:16,059 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:16,073 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6691.700000 2021-02-19 04:19:16,256 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2614.100000 2021-02-19 04:19:16,510 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:16,783 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4621.400000 2021-02-19 04:19:16,796 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:16,884 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6192.700000 2021-02-19 04:19:16,914 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5554.100000 2021-02-19 04:19:17,138 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:17,607 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4650.600000 2021-02-19 04:19:17,673 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:17,687 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6691.700000 2021-02-19 04:19:17,882 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2614.100000 2021-02-19 04:19:18,105 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:18,404 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:18,424 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4621.400000 2021-02-19 04:19:18,505 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6192.700000 2021-02-19 04:19:18,562 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5554.100000 2021-02-19 04:19:18,737 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:19,223 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4650.600000 2021-02-19 04:19:19,312 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:19,332 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6691.700000 2021-02-19 04:19:19,486 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2614.100000 2021-02-19 04:19:19,707 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:20,003 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:20,042 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4621.400000 2021-02-19 04:19:20,153 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6192.700000 2021-02-19 04:19:20,230 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5554.100000 2021-02-19 04:19:20,358 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:20,835 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4650.600000 2021-02-19 04:19:20,946 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:20,960 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6691.700000 2021-02-19 04:19:21,111 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2614.100000 2021-02-19 04:19:21,296 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:21,642 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:21,674 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4621.400000 2021-02-19 04:19:21,723 | infra | INFO | pool-2-thread-44 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:19:21,724 | infra | INFO | pool-2-thread-44 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:19:21,788 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6192.700000 2021-02-19 04:19:21,851 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5554.100000 2021-02-19 04:19:21,957 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:22,483 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4704.300000 2021-02-19 04:19:22,579 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:22,594 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6958.300000 2021-02-19 04:19:22,723 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2601.900000 2021-02-19 04:19:22,891 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:23,250 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:23,296 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4778.800000 2021-02-19 04:19:23,424 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5083.800000 2021-02-19 04:19:23,466 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5711.700000 2021-02-19 04:19:23,571 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:24,086 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4704.300000 2021-02-19 04:19:24,207 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:24,221 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6958.300000 2021-02-19 04:19:24,321 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2601.900000 2021-02-19 04:19:24,513 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:24,858 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:24,921 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4778.800000 2021-02-19 04:19:25,069 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5083.800000 2021-02-19 04:19:25,086 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5711.700000 2021-02-19 04:19:25,183 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:25,693 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4704.300000 2021-02-19 04:19:25,829 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7252.751902 2021-02-19 04:19:25,861 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:25,970 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2586.698672 2021-02-19 04:19:26,118 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:26,457 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:26,572 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4905.813048 2021-02-19 04:19:26,703 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4501.963841 2021-02-19 04:19:26,723 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5796.490586 2021-02-19 04:19:26,778 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:27,306 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4794.895188 2021-02-19 04:19:27,480 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7252.751902 2021-02-19 04:19:27,513 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:27,584 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2586.698672 2021-02-19 04:19:27,716 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:28,055 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:28,170 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4905.813048 2021-02-19 04:19:28,316 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4501.963841 2021-02-19 04:19:28,362 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5796.490586 2021-02-19 04:19:28,401 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:28,917 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4794.895188 2021-02-19 04:19:29,098 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7252.751902 2021-02-19 04:19:29,165 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:29,187 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2586.698672 2021-02-19 04:19:29,358 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:29,655 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:29,790 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4905.813048 2021-02-19 04:19:29,914 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4501.963841 2021-02-19 04:19:29,964 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5796.490586 2021-02-19 04:19:30,026 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:30,515 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4794.895188 2021-02-19 04:19:30,710 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7252.751902 2021-02-19 04:19:30,782 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:30,803 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2586.698672 2021-02-19 04:19:30,957 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:31,246 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:31,385 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4905.813048 ############################################################ # # Step 6: Rebalance In_Out with Loading of docs # ############################################################ 2021-02-19 04:19:31,460 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[172.23.110.69,172.23.110.68]_OUT=[172.23.110.65]_1613737171.42 2021-02-19 04:19:31,460 | infra | INFO | pool-1-thread-29 | [task:start_task:84] Thread 'Rebalance_task_IN=[172.23.110.69,172.23.110.68]_OUT=[172.23.110.65]_1613737171.42' started 2021-02-19 04:19:31,466 | test | DEBUG | pool-1-thread-29 | [rest_client:add_node:1103] Adding remote node 172.23.110.69:8091 to cluster 172.23.110.64:8091 2021-02-19 04:19:31,477 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L899 2021-02-19 04:19:31,477 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 30 seconds. Reason: Let the rebalance begin! 2021-02-19 04:19:31,545 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4501.963841 2021-02-19 04:19:31,595 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5796.490586 2021-02-19 04:19:31,628 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:32,107 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4794.895188 2021-02-19 04:19:32,331 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7598.351902 2021-02-19 04:19:32,387 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:32,415 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2669.298672 2021-02-19 04:19:32,562 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:32,834 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:32,986 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5040.313048 2021-02-19 04:19:33,157 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4468.363841 2021-02-19 04:19:33,209 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5794.590586 2021-02-19 04:19:33,236 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:33,588 | test | DEBUG | pool-1-thread-29 | [rest_client:add_node:1103] Adding remote node 172.23.110.68:8091 to cluster 172.23.110.64:8091 2021-02-19 04:19:33,716 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4946.695188 2021-02-19 04:19:33,980 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7598.351902 2021-02-19 04:19:34,006 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:34,091 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2669.298672 2021-02-19 04:19:34,186 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:34,447 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:34,586 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5040.313048 2021-02-19 04:19:34,775 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4468.363841 2021-02-19 04:19:34,826 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5794.590586 2021-02-19 04:19:34,884 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:35,318 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4946.695188 2021-02-19 04:19:35,588 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7598.351902 2021-02-19 04:19:35,618 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:35,707 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2669.298672 2021-02-19 04:19:35,799 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:35,930 | test | DEBUG | pool-1-thread-29 | [task:start_rebalance:301] Removing node 172.23.110.65:8091 from cluster 2021-02-19 04:19:35,930 | test | DEBUG | pool-1-thread-29 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.68,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': u'ns_1@172.23.110.65', 'user': 'Administrator'} 2021-02-19 04:19:35,967 | test | DEBUG | pool-1-thread-29 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 04:19:35,970 | test | INFO | pool-1-thread-29 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+---------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 14.5358797922 | Cluster node | | 172.23.110.65 | kv | 7.0.0-4498-enterprise | 16.4007191819 | --- OUT ---> | | 172.23.110.69 | None | | | <--- IN --- | | 172.23.110.68 | None | | | <--- IN --- | +---------------+----------+-----------------------+---------------+--------------+ 2021-02-19 04:19:35,983 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 04:19:35,983 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 04:19:36,043 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:36,196 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5170.708625 2021-02-19 04:19:36,444 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4421.456416 2021-02-19 04:19:36,506 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5847.900040 2021-02-19 04:19:36,536 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:36,930 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5055.389592 2021-02-19 04:19:37,216 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7933.017029 2021-02-19 04:19:37,282 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.101873 2021-02-19 04:19:37,388 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2766.767024 2021-02-19 04:19:37,390 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:37,634 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:37,806 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5170.708625 2021-02-19 04:19:38,065 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4421.456416 2021-02-19 04:19:38,121 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5847.900040 2021-02-19 04:19:38,138 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:38,523 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5055.389592 2021-02-19 04:19:38,845 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7933.017029 2021-02-19 04:19:38,890 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.101873 2021-02-19 04:19:38,986 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2766.767024 2021-02-19 04:19:39,003 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:39,236 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:39,413 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5170.708625 2021-02-19 04:19:39,684 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4421.456416 2021-02-19 04:19:39,720 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5847.900040 2021-02-19 04:19:39,747 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:40,138 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5055.389592 2021-02-19 04:19:40,450 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7933.017029 2021-02-19 04:19:40,502 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.101873 2021-02-19 04:19:40,611 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:40,627 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2766.767024 2021-02-19 04:19:40,834 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:41,028 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.05 % 2021-02-19 04:19:41,028 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 0.0483521742709 2021-02-19 04:19:41,053 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5170.708625 2021-02-19 04:19:41,299 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4421.456416 2021-02-19 04:19:41,371 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5847.900040 2021-02-19 04:19:41,387 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:41,760 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5055.389592 2021-02-19 04:19:42,049 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7933.017029 2021-02-19 04:19:42,098 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.101873 2021-02-19 04:19:42,211 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:42,233 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2766.767024 2021-02-19 04:19:42,460 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:42,673 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4959.508625 2021-02-19 04:19:42,923 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4316.356416 2021-02-19 04:19:42,986 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5726.800040 2021-02-19 04:19:43,000 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:43,371 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4634.289592 2021-02-19 04:19:43,690 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7636.817029 2021-02-19 04:19:43,750 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.101873 2021-02-19 04:19:43,838 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2691.667024 2021-02-19 04:19:43,845 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:44,051 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:44,280 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4959.508625 2021-02-19 04:19:44,533 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4316.356416 2021-02-19 04:19:44,585 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5726.800040 2021-02-19 04:19:44,592 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:44,980 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4634.289592 2021-02-19 04:19:45,332 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7636.817029 2021-02-19 04:19:45,404 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.101873 2021-02-19 04:19:45,461 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:45,480 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2621.300000 2021-02-19 04:19:45,650 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:45,878 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4779.800000 2021-02-19 04:19:46,073 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.34 % 2021-02-19 04:19:46,075 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 0.344864683113 2021-02-19 04:19:46,154 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4199.200000 2021-02-19 04:19:46,201 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:46,219 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5560.400000 2021-02-19 04:19:46,582 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3618.500000 2021-02-19 04:19:46,947 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7228.600000 2021-02-19 04:19:47,013 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:47,065 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:47,092 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2621.300000 2021-02-19 04:19:47,278 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:47,484 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4779.800000 2021-02-19 04:19:47,772 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4199.200000 2021-02-19 04:19:47,819 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:47,831 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5560.400000 2021-02-19 04:19:48,180 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3618.500000 2021-02-19 04:19:48,572 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7228.600000 2021-02-19 04:19:48,635 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:48,674 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:48,713 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2621.300000 2021-02-19 04:19:48,875 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:49,092 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4779.800000 2021-02-19 04:19:49,381 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4199.200000 2021-02-19 04:19:49,444 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:49,459 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5560.400000 2021-02-19 04:19:49,796 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3618.500000 2021-02-19 04:19:50,230 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7228.600000 2021-02-19 04:19:50,266 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:50,368 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:50,385 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2621.300000 2021-02-19 04:19:50,470 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:50,687 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4779.800000 2021-02-19 04:19:51,000 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4199.200000 2021-02-19 04:19:51,075 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:51,085 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5560.400000 2021-02-19 04:19:51,128 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.62 % 2021-02-19 04:19:51,128 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 0.62085963442 2021-02-19 04:19:51,417 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3618.500000 2021-02-19 04:19:51,884 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7228.600000 2021-02-19 04:19:51,894 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:51,986 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:52,049 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2621.300000 2021-02-19 04:19:52,078 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:52,286 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5167.000000 2021-02-19 04:19:52,635 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4330.200000 2021-02-19 04:19:52,697 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5618.100000 2021-02-19 04:19:52,711 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:53,025 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1897.700000 2021-02-19 04:19:53,517 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:53,536 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7491.300000 2021-02-19 04:19:53,604 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:53,648 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2793.100000 2021-02-19 04:19:53,674 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:53,898 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5167.000000 2021-02-19 04:19:54,232 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4330.200000 2021-02-19 04:19:54,305 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5618.100000 2021-02-19 04:19:54,319 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:54,638 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1897.700000 2021-02-19 04:19:55,128 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:55,176 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7491.300000 2021-02-19 04:19:55,223 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:55,280 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2793.100000 2021-02-19 04:19:55,290 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:55,497 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5500.400000 2021-02-19 04:19:55,849 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4486.100000 2021-02-19 04:19:55,938 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5670.600000 2021-02-19 04:19:55,938 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:56,167 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.91 % 2021-02-19 04:19:56,167 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 0.905639671073 2021-02-19 04:19:56,269 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 779.100000 2021-02-19 04:19:56,737 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:56,809 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7791.000000 2021-02-19 04:19:56,865 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:56,910 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2928.200000 2021-02-19 04:19:56,940 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:57,135 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5500.400000 2021-02-19 04:19:57,467 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4486.100000 2021-02-19 04:19:57,565 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:57,581 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5670.600000 2021-02-19 04:19:57,880 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 779.100000 2021-02-19 04:19:58,352 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:19:58,487 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7791.000000 2021-02-19 04:19:58,549 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:19:58,552 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2928.200000 2021-02-19 04:19:58,555 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:19:58,736 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5500.400000 2021-02-19 04:19:59,115 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4486.100000 2021-02-19 04:19:59,184 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:19:59,249 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5670.600000 2021-02-19 04:19:59,473 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 794.900000 2021-02-19 04:19:59,950 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:00,114 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7791.000000 2021-02-19 04:20:00,157 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:00,174 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:20:00,194 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2928.200000 2021-02-19 04:20:00,334 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5500.400000 2021-02-19 04:20:00,734 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4486.100000 2021-02-19 04:20:00,805 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:00,871 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5670.600000 2021-02-19 04:20:01,085 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 794.900000 2021-02-19 04:20:01,214 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 1.27 % 2021-02-19 04:20:01,216 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 1.26516711078 2021-02-19 04:20:01,507 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 1.27 % 2021-02-19 04:20:01,522 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:20:01,522 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:20:01,545 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:01,733 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7791.000000 2021-02-19 04:20:01,759 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:01,786 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:20:01,831 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2928.200000 2021-02-19 04:20:01,957 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5500.400000 2021-02-19 04:20:02,378 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4502.500000 2021-02-19 04:20:02,421 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:02,489 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5615.500000 2021-02-19 04:20:02,700 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 689.400000 2021-02-19 04:20:03,144 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:03,247 | infra | INFO | pool-2-thread-26 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:20:03,247 | infra | INFO | pool-2-thread-26 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:20:03,348 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7805.100000 2021-02-19 04:20:03,378 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:03,421 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:20:03,461 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2941.500000 2021-02-19 04:20:03,575 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5537.600000 2021-02-19 04:20:03,983 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4502.500000 2021-02-19 04:20:04,039 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:04,108 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5615.500000 2021-02-19 04:20:04,306 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 713.000000 2021-02-19 04:20:04,753 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:04,974 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7805.100000 2021-02-19 04:20:05,009 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:05,040 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:20:05,081 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2941.500000 2021-02-19 04:20:05,190 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5537.600000 2021-02-19 04:20:05,594 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4502.500000 2021-02-19 04:20:05,653 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:05,723 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5615.500000 2021-02-19 04:20:05,948 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 690.375037 2021-02-19 04:20:06,255 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 1.47 % 2021-02-19 04:20:06,256 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 1.47278548405 2021-02-19 04:20:06,371 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:06,594 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7837.399301 2021-02-19 04:20:06,621 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:06,654 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:20:06,721 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2978.159361 2021-02-19 04:20:06,819 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5539.876086 2021-02-19 04:20:07,223 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4484.254768 2021-02-19 04:20:07,256 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:07,345 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5557.745681 2021-02-19 04:20:07,548 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 690.375037 2021-02-19 04:20:07,980 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:08,203 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7837.399301 2021-02-19 04:20:08,223 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:08,267 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:20:08,375 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2978.159361 2021-02-19 04:20:08,446 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5539.876086 2021-02-19 04:20:08,826 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4484.254768 2021-02-19 04:20:08,861 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:08,956 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5557.745681 2021-02-19 04:20:09,171 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 690.375037 2021-02-19 04:20:09,598 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:09,831 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7837.399301 2021-02-19 04:20:09,835 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:09,898 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:20:09,990 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2978.159361 2021-02-19 04:20:10,059 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5539.876086 2021-02-19 04:20:10,474 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4484.254768 2021-02-19 04:20:10,490 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:10,572 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5557.745681 2021-02-19 04:20:10,786 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 707.775037 2021-02-19 04:20:11,201 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:11,298 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 1.73 % 2021-02-19 04:20:11,298 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 1.72875603159 2021-02-19 04:20:11,450 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:11,476 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7837.399301 2021-02-19 04:20:11,506 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:20:11,533 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 1.73 % 2021-02-19 04:20:11,546 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:20:11,546 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:20:11,634 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2978.159361 2021-02-19 04:20:11,680 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5539.876086 2021-02-19 04:20:12,085 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4484.254768 2021-02-19 04:20:12,095 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:12,198 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5557.745681 2021-02-19 04:20:12,407 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 804.975037 2021-02-19 04:20:12,823 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:13,058 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:13,092 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8202.099301 2021-02-19 04:20:13,125 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 460.700000 2021-02-19 04:20:13,253 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3053.459361 2021-02-19 04:20:13,299 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5439.676086 2021-02-19 04:20:13,698 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4431.254768 2021-02-19 04:20:13,709 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:13,845 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5461.445681 2021-02-19 04:20:14,032 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 804.975037 2021-02-19 04:20:14,456 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:14,670 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:14,721 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8202.099301 2021-02-19 04:20:14,756 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 460.700000 2021-02-19 04:20:14,884 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3053.459361 2021-02-19 04:20:14,914 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5439.676086 2021-02-19 04:20:15,318 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4431.254768 2021-02-19 04:20:15,318 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:15,490 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5310.728242 2021-02-19 04:20:15,637 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 805.275037 2021-02-19 04:20:16,049 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:16,279 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:16,336 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 2.03 % 2021-02-19 04:20:16,336 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 2.03257416448 2021-02-19 04:20:16,342 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8598.895894 2021-02-19 04:20:16,372 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1098.156184 2021-02-19 04:20:16,513 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3124.647421 2021-02-19 04:20:16,535 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5458.752529 2021-02-19 04:20:16,923 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:16,948 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4409.011868 2021-02-19 04:20:17,118 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5310.728242 2021-02-19 04:20:17,244 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 699.265949 2021-02-19 04:20:17,651 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:17,894 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:17,950 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8598.895894 2021-02-19 04:20:17,980 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1098.156184 2021-02-19 04:20:18,134 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3124.647421 2021-02-19 04:20:18,158 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5458.752529 2021-02-19 04:20:18,530 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:18,555 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4409.011868 2021-02-19 04:20:18,727 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5310.728242 2021-02-19 04:20:18,854 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 699.265949 2021-02-19 04:20:19,269 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:19,520 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:19,595 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1098.156184 2021-02-19 04:20:19,611 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8598.895894 2021-02-19 04:20:19,743 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3124.647421 2021-02-19 04:20:19,783 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5458.752529 2021-02-19 04:20:20,145 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:20,177 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4409.011868 2021-02-19 04:20:20,357 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5310.728242 2021-02-19 04:20:20,457 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 687.265949 2021-02-19 04:20:20,877 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:21,190 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:21,213 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1098.156184 2021-02-19 04:20:21,230 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8598.895894 2021-02-19 04:20:21,368 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3124.647421 2021-02-19 04:20:21,377 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 2.29 % 2021-02-19 04:20:21,377 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 2.28899779243 2021-02-19 04:20:21,400 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5458.752529 2021-02-19 04:20:21,562 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 2.31 % 2021-02-19 04:20:21,576 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:20:21,576 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:20:21,762 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:21,785 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4409.011868 2021-02-19 04:20:21,967 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5310.728242 2021-02-19 04:20:22,071 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 687.265949 2021-02-19 04:20:22,489 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:22,805 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:22,838 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1346.556184 2021-02-19 04:20:22,851 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8625.795894 2021-02-19 04:20:22,984 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3096.447421 2021-02-19 04:20:23,010 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5576.752529 2021-02-19 04:20:23,365 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:23,394 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4382.111868 2021-02-19 04:20:23,581 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5360.428242 2021-02-19 04:20:23,680 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 412.065949 2021-02-19 04:20:24,099 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:24,490 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8625.795894 2021-02-19 04:20:24,496 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:24,520 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1346.556184 2021-02-19 04:20:24,628 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3096.447421 2021-02-19 04:20:24,644 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5576.752529 2021-02-19 04:20:24,970 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:24,994 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4382.111868 2021-02-19 04:20:25,201 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5360.428242 2021-02-19 04:20:25,293 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 388.365949 2021-02-19 04:20:25,717 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:25,852 | infra | INFO | pool-2-thread-28 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' completed 2021-02-19 04:20:25,852 | infra | INFO | pool-2-thread-28 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:20:26,115 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8505.689510 2021-02-19 04:20:26,138 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:26,140 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1433.175924 2021-02-19 04:20:26,269 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3103.827672 2021-02-19 04:20:26,289 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5584.024376 2021-02-19 04:20:26,431 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 2.55 % 2021-02-19 04:20:26,431 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 2.55131629468 2021-02-19 04:20:26,586 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:26,611 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4330.443756 2021-02-19 04:20:26,842 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5552.289311 2021-02-19 04:20:26,907 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 212.032368 2021-02-19 04:20:27,309 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599401 2021-02-19 04:20:27,739 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8505.689510 2021-02-19 04:20:27,776 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:27,785 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1433.175924 2021-02-19 04:20:27,890 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3103.827672 2021-02-19 04:20:27,907 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5584.024376 2021-02-19 04:20:28,197 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:28,221 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4330.443756 2021-02-19 04:20:28,454 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5552.289311 2021-02-19 04:20:28,517 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 212.032368 2021-02-19 04:20:28,921 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599401 2021-02-19 04:20:29,387 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8505.689510 2021-02-19 04:20:29,398 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:29,410 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1433.175924 2021-02-19 04:20:29,513 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3103.827672 2021-02-19 04:20:29,542 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5584.024376 2021-02-19 04:20:29,802 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:29,832 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4330.443756 2021-02-19 04:20:30,078 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5552.289311 2021-02-19 04:20:30,138 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 213.332368 2021-02-19 04:20:30,553 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599401 2021-02-19 04:20:31,019 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8505.689510 2021-02-19 04:20:31,026 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:31,039 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1433.175924 2021-02-19 04:20:31,138 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3103.827672 2021-02-19 04:20:31,163 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5584.024376 2021-02-19 04:20:31,391 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:31,437 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4330.443756 2021-02-19 04:20:31,476 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 2.81 % 2021-02-19 04:20:31,476 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 2.81314164315 2021-02-19 04:20:31,588 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 2.84 % 2021-02-19 04:20:31,601 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:20:31,601 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:20:31,693 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5552.289311 2021-02-19 04:20:31,743 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 213.332368 2021-02-19 04:20:32,148 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599401 2021-02-19 04:20:32,655 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8402.389510 2021-02-19 04:20:32,661 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:32,676 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1412.375924 2021-02-19 04:20:32,785 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3154.427672 2021-02-19 04:20:32,796 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5619.824376 2021-02-19 04:20:33,010 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:33,058 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4325.443756 2021-02-19 04:20:33,305 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5526.789311 2021-02-19 04:20:33,368 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 245.332368 2021-02-19 04:20:33,767 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599401 2021-02-19 04:20:34,308 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8402.389510 2021-02-19 04:20:34,315 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:34,315 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1412.375924 2021-02-19 04:20:34,411 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3154.427672 2021-02-19 04:20:34,434 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5619.824376 2021-02-19 04:20:34,640 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:34,684 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4325.443756 2021-02-19 04:20:34,907 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5526.789311 2021-02-19 04:20:34,980 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 272.132368 2021-02-19 04:20:35,355 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599401 2021-02-19 04:20:35,937 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8458.833467 2021-02-19 04:20:35,953 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1374.843272 2021-02-19 04:20:35,960 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:36,029 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3115.466683 2021-02-19 04:20:36,062 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5791.173487 2021-02-19 04:20:36,253 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:36,312 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4332.781791 2021-02-19 04:20:36,523 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5424.154027 2021-02-19 04:20:36,533 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 3.07 % 2021-02-19 04:20:36,533 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 3.06911219069 2021-02-19 04:20:36,608 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 331.263382 2021-02-19 04:20:36,961 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.600300 2021-02-19 04:20:37,609 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8458.833467 2021-02-19 04:20:37,622 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1374.843272 2021-02-19 04:20:37,632 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:37,674 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3115.466683 2021-02-19 04:20:37,694 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5791.173487 2021-02-19 04:20:37,871 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:37,950 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4332.781791 2021-02-19 04:20:38,131 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5424.154027 2021-02-19 04:20:38,243 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 331.263382 2021-02-19 04:20:38,569 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.600300 2021-02-19 04:20:39,249 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1374.843272 2021-02-19 04:20:39,263 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:39,302 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8458.833467 2021-02-19 04:20:39,305 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3115.466683 2021-02-19 04:20:39,369 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5791.173487 2021-02-19 04:20:39,483 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:39,555 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4332.781791 2021-02-19 04:20:39,742 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5424.154027 2021-02-19 04:20:39,888 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 332.963382 2021-02-19 04:20:40,178 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.600300 2021-02-19 04:20:40,882 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:40,900 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1374.843272 2021-02-19 04:20:40,924 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8458.833467 2021-02-19 04:20:40,937 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3115.466683 2021-02-19 04:20:41,009 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5791.173487 2021-02-19 04:20:41,094 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:41,157 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4332.781791 2021-02-19 04:20:41,354 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5424.154027 2021-02-19 04:20:41,536 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 332.963382 2021-02-19 04:20:41,576 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 3.39 % 2021-02-19 04:20:41,578 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 3.39199705801 2021-02-19 04:20:41,617 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 3.39 % 2021-02-19 04:20:41,628 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:20:41,628 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:20:41,779 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.600300 2021-02-19 04:20:42,502 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:42,530 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1379.443272 2021-02-19 04:20:42,546 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8530.533467 2021-02-19 04:20:42,648 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3086.266683 2021-02-19 04:20:42,678 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5899.173487 2021-02-19 04:20:42,756 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:42,775 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4337.281791 2021-02-19 04:20:42,971 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5438.654027 2021-02-19 04:20:43,191 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 299.963382 2021-02-19 04:20:43,417 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.600300 2021-02-19 04:20:44,121 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:44,178 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1379.443272 2021-02-19 04:20:44,197 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8530.533467 2021-02-19 04:20:44,280 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3086.266683 2021-02-19 04:20:44,339 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5899.173487 2021-02-19 04:20:44,365 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:44,388 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4337.281791 2021-02-19 04:20:44,585 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5438.654027 2021-02-19 04:20:44,842 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 299.963382 2021-02-19 04:20:45,023 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.600300 2021-02-19 04:20:45,747 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:45,825 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1379.443272 2021-02-19 04:20:45,865 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8530.533467 2021-02-19 04:20:45,920 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3120.000000 2021-02-19 04:20:46,013 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5865.200000 2021-02-19 04:20:46,032 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:46,038 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4363.200000 2021-02-19 04:20:46,196 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5432.600000 2021-02-19 04:20:46,523 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 223.500000 2021-02-19 04:20:46,618 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 3.72 % 2021-02-19 04:20:46,618 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 3.71928590315 2021-02-19 04:20:46,651 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:47,361 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:47,466 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1386.300000 2021-02-19 04:20:47,506 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8539.900000 2021-02-19 04:20:47,545 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3120.000000 2021-02-19 04:20:47,635 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5865.200000 2021-02-19 04:20:47,680 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4363.200000 2021-02-19 04:20:47,687 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:47,819 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5432.600000 2021-02-19 04:20:48,178 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 223.500000 2021-02-19 04:20:48,252 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:48,984 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:49,150 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8539.900000 2021-02-19 04:20:49,164 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1386.300000 2021-02-19 04:20:49,183 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3120.000000 2021-02-19 04:20:49,285 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5865.200000 2021-02-19 04:20:49,315 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4363.200000 2021-02-19 04:20:49,319 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:49,430 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5432.600000 2021-02-19 04:20:49,789 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 223.500000 2021-02-19 04:20:49,854 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:50,618 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:50,773 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8539.900000 2021-02-19 04:20:50,785 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1386.300000 2021-02-19 04:20:50,845 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3120.000000 2021-02-19 04:20:50,936 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5865.200000 2021-02-19 04:20:50,960 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:51,013 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4363.200000 2021-02-19 04:20:51,065 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5432.600000 2021-02-19 04:20:51,365 | infra | INFO | pool-2-thread-43 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' completed 2021-02-19 04:20:51,365 | infra | INFO | pool-2-thread-43 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:20:51,404 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 217.800000 2021-02-19 04:20:51,457 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:51,641 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 3.95 % 2021-02-19 04:20:51,654 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:20:51,654 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:20:51,663 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 3.95 % 2021-02-19 04:20:51,664 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 3.954727458 2021-02-19 04:20:52,233 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:52,398 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8625.400000 2021-02-19 04:20:52,404 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1320.900000 2021-02-19 04:20:52,470 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3114.300000 2021-02-19 04:20:52,595 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5834.000000 2021-02-19 04:20:52,605 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:52,642 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4335.100000 2021-02-19 04:20:52,690 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5425.400000 2021-02-19 04:20:53,015 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 181.300000 2021-02-19 04:20:53,052 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:53,845 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:54,026 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1320.900000 2021-02-19 04:20:54,040 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8625.400000 2021-02-19 04:20:54,088 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3114.300000 2021-02-19 04:20:54,233 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5834.000000 2021-02-19 04:20:54,234 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:54,288 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4335.100000 2021-02-19 04:20:54,316 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5425.400000 2021-02-19 04:20:54,651 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:54,678 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 181.300000 2021-02-19 04:20:55,506 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:55,644 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1320.900000 2021-02-19 04:20:55,697 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8625.400000 2021-02-19 04:20:55,707 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3114.300000 2021-02-19 04:20:55,862 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:55,878 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5834.000000 2021-02-19 04:20:55,913 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4267.761081 2021-02-19 04:20:55,948 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5434.355478 2021-02-19 04:20:56,259 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:56,303 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 159.423412 2021-02-19 04:20:56,710 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 4.19 % 2021-02-19 04:20:56,710 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 4.19113811734 2021-02-19 04:20:57,107 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:57,259 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1329.250875 2021-02-19 04:20:57,334 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3092.172486 2021-02-19 04:20:57,334 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8668.859880 2021-02-19 04:20:57,483 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:57,509 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5855.767384 2021-02-19 04:20:57,538 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4267.761081 2021-02-19 04:20:57,559 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5434.355478 2021-02-19 04:20:57,868 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:57,927 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 159.423412 2021-02-19 04:20:58,335 | infra | INFO | pool-2-thread-51 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:20:58,335 | infra | INFO | pool-2-thread-51 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:20:58,698 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:20:58,864 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1329.250875 2021-02-19 04:20:58,957 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3092.172486 2021-02-19 04:20:58,966 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8668.859880 2021-02-19 04:20:59,096 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:20:59,127 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5855.767384 2021-02-19 04:20:59,165 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4267.761081 2021-02-19 04:20:59,174 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5434.355478 2021-02-19 04:20:59,483 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:20:59,559 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 160.523412 2021-02-19 04:21:00,296 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:00,480 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1329.250875 2021-02-19 04:21:00,575 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3092.172486 2021-02-19 04:21:00,595 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8668.859880 2021-02-19 04:21:00,723 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:00,743 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5855.767384 2021-02-19 04:21:00,796 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4267.761081 2021-02-19 04:21:00,813 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5434.355478 2021-02-19 04:21:01,122 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:01,167 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 160.523412 2021-02-19 04:21:01,664 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 4.44 % 2021-02-19 04:21:01,677 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:21:01,677 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:21:01,746 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 4.44 % 2021-02-19 04:21:01,746 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 4.43633386203 2021-02-19 04:21:01,897 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:02,107 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1329.250875 2021-02-19 04:21:02,204 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3092.172486 2021-02-19 04:21:02,224 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8668.859880 2021-02-19 04:21:02,349 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:02,369 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5961.467384 2021-02-19 04:21:02,421 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3814.261081 2021-02-19 04:21:02,431 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5455.055478 2021-02-19 04:21:02,723 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:02,783 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 150.923412 2021-02-19 04:21:03,484 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:03,717 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1780.850875 2021-02-19 04:21:03,848 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3032.272486 2021-02-19 04:21:03,859 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8601.259880 2021-02-19 04:21:03,969 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:03,986 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5961.467384 2021-02-19 04:21:04,081 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3814.261081 2021-02-19 04:21:04,091 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5455.055478 2021-02-19 04:21:04,338 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:04,398 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 153.723412 2021-02-19 04:21:05,079 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:05,352 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1780.850875 2021-02-19 04:21:05,476 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8467.900000 2021-02-19 04:21:05,494 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2956.400000 2021-02-19 04:21:05,595 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:05,612 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6071.100000 2021-02-19 04:21:05,713 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3814.261081 2021-02-19 04:21:05,746 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5455.055478 2021-02-19 04:21:05,934 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:06,023 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 148.300000 2021-02-19 04:21:06,691 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:06,783 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 4.70 % 2021-02-19 04:21:06,783 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 4.69814777535 2021-02-19 04:21:07,002 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2199.600000 2021-02-19 04:21:07,117 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8467.900000 2021-02-19 04:21:07,134 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2956.400000 2021-02-19 04:21:07,207 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:07,262 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6071.100000 2021-02-19 04:21:07,338 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2788.800000 2021-02-19 04:21:07,368 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5551.700000 2021-02-19 04:21:07,529 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:07,628 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 148.300000 2021-02-19 04:21:08,283 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:08,653 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2199.600000 2021-02-19 04:21:08,763 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2956.400000 2021-02-19 04:21:08,779 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8467.900000 2021-02-19 04:21:08,845 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:08,915 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6071.100000 2021-02-19 04:21:09,055 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5551.700000 2021-02-19 04:21:09,073 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2788.800000 2021-02-19 04:21:09,138 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:09,243 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 148.300000 2021-02-19 04:21:09,892 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:10,259 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2199.600000 2021-02-19 04:21:10,375 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2956.400000 2021-02-19 04:21:10,405 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8467.900000 2021-02-19 04:21:10,473 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:10,546 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6071.100000 2021-02-19 04:21:10,680 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5551.700000 2021-02-19 04:21:10,713 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2788.800000 2021-02-19 04:21:10,759 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:10,857 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 137.700000 2021-02-19 04:21:11,489 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:11,687 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 5.00 % 2021-02-19 04:21:11,700 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:21:11,700 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:21:11,821 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 5.00 % 2021-02-19 04:21:11,821 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 5.00196590823 2021-02-19 04:21:11,871 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2199.600000 2021-02-19 04:21:12,003 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2956.400000 2021-02-19 04:21:12,016 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8467.900000 2021-02-19 04:21:12,096 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:12,164 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6071.100000 2021-02-19 04:21:12,279 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5605.200000 2021-02-19 04:21:12,335 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1096.700000 2021-02-19 04:21:12,387 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:12,499 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 100.300000 2021-02-19 04:21:13,084 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:13,479 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2270.100000 2021-02-19 04:21:13,625 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2954.500000 2021-02-19 04:21:13,657 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8216.900000 2021-02-19 04:21:13,704 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:13,782 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6092.600000 2021-02-19 04:21:13,900 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5605.200000 2021-02-19 04:21:13,967 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1096.700000 2021-02-19 04:21:13,996 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:14,125 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 100.300000 2021-02-19 04:21:14,688 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:15,088 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2270.100000 2021-02-19 04:21:15,253 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2954.500000 2021-02-19 04:21:15,311 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8216.900000 2021-02-19 04:21:15,332 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:15,398 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6092.600000 2021-02-19 04:21:15,506 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5574.900000 2021-02-19 04:21:15,595 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:15,614 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:15,766 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 202.100000 2021-02-19 04:21:16,303 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:16,700 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2300.900000 2021-02-19 04:21:16,861 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 5.08 % 2021-02-19 04:21:16,861 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 5.0796435957 2021-02-19 04:21:16,892 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2950.600000 2021-02-19 04:21:16,947 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8087.900000 2021-02-19 04:21:16,967 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:17,026 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6073.900000 2021-02-19 04:21:17,148 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5574.900000 2021-02-19 04:21:17,203 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:17,230 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:17,387 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 371.700000 2021-02-19 04:21:17,890 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:18,286 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2300.900000 2021-02-19 04:21:18,516 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2950.600000 2021-02-19 04:21:18,559 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8087.900000 2021-02-19 04:21:18,625 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:18,688 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6073.900000 2021-02-19 04:21:18,809 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5574.900000 2021-02-19 04:21:18,838 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:18,855 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:19,009 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 371.700000 2021-02-19 04:21:19,480 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:19,885 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2300.900000 2021-02-19 04:21:20,131 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2950.600000 2021-02-19 04:21:20,183 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8087.900000 2021-02-19 04:21:20,230 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:20,308 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6073.900000 2021-02-19 04:21:20,437 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5574.900000 2021-02-19 04:21:20,470 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:20,480 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:20,618 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 504.100000 2021-02-19 04:21:21,072 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:21,496 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2300.900000 2021-02-19 04:21:21,710 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 5.39 % 2021-02-19 04:21:21,723 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:21:21,723 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:21:21,749 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2950.600000 2021-02-19 04:21:21,812 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8087.900000 2021-02-19 04:21:21,842 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:21,904 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 5.40 % 2021-02-19 04:21:21,904 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 5.39812448518 2021-02-19 04:21:21,947 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6073.900000 2021-02-19 04:21:22,095 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:22,111 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5574.900000 2021-02-19 04:21:22,134 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:22,256 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 504.100000 2021-02-19 04:21:22,667 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:23,098 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2274.600000 2021-02-19 04:21:23,365 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2961.900000 2021-02-19 04:21:23,427 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8167.200000 2021-02-19 04:21:23,448 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:23,573 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6113.100000 2021-02-19 04:21:23,709 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:23,790 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5627.500000 2021-02-19 04:21:23,809 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:23,875 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 834.000000 2021-02-19 04:21:24,253 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:24,698 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2274.600000 2021-02-19 04:21:24,973 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2961.900000 2021-02-19 04:21:25,032 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8167.200000 2021-02-19 04:21:25,059 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:25,203 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6113.100000 2021-02-19 04:21:25,332 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:25,401 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5627.500000 2021-02-19 04:21:25,440 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:25,497 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 616.800000 2021-02-19 04:21:25,859 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:26,299 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2261.600000 2021-02-19 04:21:26,576 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3025.400000 2021-02-19 04:21:26,644 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8221.500000 2021-02-19 04:21:26,671 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:26,861 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6185.800000 2021-02-19 04:21:26,944 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 5.61 % 2021-02-19 04:21:26,944 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 5.6144993056 2021-02-19 04:21:26,980 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:21:27,022 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5666.900000 2021-02-19 04:21:27,049 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:27,132 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 616.800000 2021-02-19 04:21:27,450 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:27,910 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2261.600000 2021-02-19 04:21:28,171 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3025.400000 2021-02-19 04:21:28,282 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8221.500000 2021-02-19 04:21:28,298 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:28,490 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6185.800000 2021-02-19 04:21:28,594 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:21:28,654 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5666.900000 2021-02-19 04:21:28,690 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:28,760 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 616.800000 2021-02-19 04:21:29,035 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:29,513 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2261.600000 2021-02-19 04:21:29,796 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3025.400000 2021-02-19 04:21:29,894 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8221.500000 2021-02-19 04:21:29,924 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:30,137 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6185.800000 2021-02-19 04:21:30,217 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:21:30,282 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5666.900000 2021-02-19 04:21:30,388 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:30,457 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 504.100000 2021-02-19 04:21:30,638 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:31,111 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2261.600000 2021-02-19 04:21:31,420 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3025.400000 2021-02-19 04:21:31,512 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8221.500000 2021-02-19 04:21:31,536 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:31,734 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 5.85 % 2021-02-19 04:21:31,740 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6185.800000 2021-02-19 04:21:31,750 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:21:31,750 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:21:31,822 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:21:31,903 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5666.900000 2021-02-19 04:21:31,980 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 5.85 % 2021-02-19 04:21:31,982 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 5.85039394086 2021-02-19 04:21:32,007 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:32,082 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 504.100000 2021-02-19 04:21:32,237 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:32,723 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2258.800000 2021-02-19 04:21:33,032 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3087.700000 2021-02-19 04:21:33,138 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8141.700000 2021-02-19 04:21:33,168 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:33,367 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6083.200000 2021-02-19 04:21:33,426 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:21:33,542 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5566.800000 2021-02-19 04:21:33,644 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:33,710 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 198.000000 2021-02-19 04:21:33,845 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:34,332 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2258.800000 2021-02-19 04:21:34,694 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3087.700000 2021-02-19 04:21:34,750 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8141.700000 2021-02-19 04:21:34,835 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:34,984 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6083.200000 2021-02-19 04:21:35,045 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:21:35,204 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5566.800000 2021-02-19 04:21:35,273 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:35,371 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 137.700000 2021-02-19 04:21:35,450 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:35,934 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2263.900000 2021-02-19 04:21:36,290 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3147.000000 2021-02-19 04:21:36,401 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8035.100000 2021-02-19 04:21:36,486 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:36,584 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5958.300000 2021-02-19 04:21:36,654 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:36,829 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5581.500000 2021-02-19 04:21:36,895 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:36,990 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 125.100000 2021-02-19 04:21:37,028 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 6.02 % 2021-02-19 04:21:37,029 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 6.01791199808 2021-02-19 04:21:37,049 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:37,530 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2263.900000 2021-02-19 04:21:37,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3147.000000 2021-02-19 04:21:38,023 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8035.100000 2021-02-19 04:21:38,096 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:38,184 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5958.300000 2021-02-19 04:21:38,263 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:38,450 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5581.500000 2021-02-19 04:21:38,509 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:38,618 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 125.100000 2021-02-19 04:21:38,648 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:39,164 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2263.900000 2021-02-19 04:21:39,523 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3147.000000 2021-02-19 04:21:39,625 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8035.100000 2021-02-19 04:21:39,714 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:39,812 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5958.300000 2021-02-19 04:21:39,911 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:40,066 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5581.500000 2021-02-19 04:21:40,112 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:40,246 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 110.200000 2021-02-19 04:21:40,256 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:40,766 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2263.900000 2021-02-19 04:21:41,130 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3147.000000 2021-02-19 04:21:41,246 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8035.100000 2021-02-19 04:21:41,335 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:41,433 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5958.300000 2021-02-19 04:21:41,571 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:41,673 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5581.500000 2021-02-19 04:21:41,759 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 6.28 % 2021-02-19 04:21:41,775 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:21:41,775 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:21:41,786 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:41,903 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 110.200000 2021-02-19 04:21:41,914 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:42,069 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 6.28 % 2021-02-19 04:21:42,069 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 6.28117673451 2021-02-19 04:21:42,391 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2348.900000 2021-02-19 04:21:42,750 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3126.300000 2021-02-19 04:21:42,875 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8061.500000 2021-02-19 04:21:42,954 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:43,049 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6040.600000 2021-02-19 04:21:43,210 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:43,279 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5636.200000 2021-02-19 04:21:43,405 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:43,526 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:43,538 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 75.700000 2021-02-19 04:21:43,993 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2348.900000 2021-02-19 04:21:44,374 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3126.300000 2021-02-19 04:21:44,480 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8061.500000 2021-02-19 04:21:44,579 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:44,668 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6040.600000 2021-02-19 04:21:44,819 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:44,905 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5636.200000 2021-02-19 04:21:45,026 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:45,144 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:45,167 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 65.100000 2021-02-19 04:21:45,582 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2458.000000 2021-02-19 04:21:45,979 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3075.100000 2021-02-19 04:21:46,134 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8103.800000 2021-02-19 04:21:46,211 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:46,302 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6201.700000 2021-02-19 04:21:46,423 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:46,503 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5617.800000 2021-02-19 04:21:46,630 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:46,743 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:46,796 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 57.400000 2021-02-19 04:21:47,115 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 6.41 % 2021-02-19 04:21:47,115 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 6.41355455095 2021-02-19 04:21:47,221 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2458.000000 2021-02-19 04:21:47,586 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3075.100000 2021-02-19 04:21:47,766 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8103.800000 2021-02-19 04:21:47,832 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:47,931 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6201.700000 2021-02-19 04:21:48,040 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:48,112 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5617.800000 2021-02-19 04:21:48,237 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:48,359 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:48,421 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 57.400000 2021-02-19 04:21:48,826 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2458.000000 2021-02-19 04:21:49,220 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3075.100000 2021-02-19 04:21:49,381 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8103.800000 2021-02-19 04:21:49,466 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:49,565 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6201.700000 2021-02-19 04:21:49,642 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:49,726 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5617.800000 2021-02-19 04:21:49,839 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:49,961 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:50,072 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 69.700000 2021-02-19 04:21:50,424 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2458.000000 2021-02-19 04:21:50,832 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3075.100000 2021-02-19 04:21:51,032 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8103.800000 2021-02-19 04:21:51,107 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:51,186 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6201.700000 2021-02-19 04:21:51,250 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:51,342 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5617.800000 2021-02-19 04:21:51,454 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:51,575 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:51,713 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 69.700000 2021-02-19 04:21:51,786 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 6.65 % 2021-02-19 04:21:51,801 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:21:51,801 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:21:52,073 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2458.000000 2021-02-19 04:21:52,157 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 6.67 % 2021-02-19 04:21:52,157 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 6.6651096855 2021-02-19 04:21:52,464 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3064.000000 2021-02-19 04:21:52,546 | infra | INFO | pool-2-thread-18 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:21:52,546 | infra | INFO | pool-2-thread-18 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:21:52,660 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8147.200000 2021-02-19 04:21:52,714 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:52,802 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6277.400000 2021-02-19 04:21:52,861 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:52,960 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5631.700000 2021-02-19 04:21:53,059 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:53,187 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:53,323 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 109.000000 2021-02-19 04:21:53,684 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2597.200000 2021-02-19 04:21:54,065 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3064.000000 2021-02-19 04:21:54,299 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8147.200000 2021-02-19 04:21:54,322 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:54,484 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6277.400000 2021-02-19 04:21:54,497 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:54,601 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5631.700000 2021-02-19 04:21:54,671 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:54,798 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:54,947 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 127.000000 2021-02-19 04:21:55,295 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2597.200000 2021-02-19 04:21:55,665 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3064.000000 2021-02-19 04:21:55,901 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8147.200000 2021-02-19 04:21:55,948 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:56,096 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6261.100000 2021-02-19 04:21:56,119 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:56,230 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5398.800000 2021-02-19 04:21:56,267 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:56,404 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:56,552 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 132.900000 2021-02-19 04:21:56,903 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2645.000000 2021-02-19 04:21:57,197 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 6.86 % 2021-02-19 04:21:57,197 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 6.86386859459 2021-02-19 04:21:57,266 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3015.000000 2021-02-19 04:21:57,503 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8276.600000 2021-02-19 04:21:57,565 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:57,711 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6261.100000 2021-02-19 04:21:57,733 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:57,832 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5398.800000 2021-02-19 04:21:57,875 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:58,009 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:58,180 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 132.900000 2021-02-19 04:21:58,509 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2645.000000 2021-02-19 04:21:58,861 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3015.000000 2021-02-19 04:21:59,118 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8276.600000 2021-02-19 04:21:59,186 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:21:59,329 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6261.100000 2021-02-19 04:21:59,345 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:21:59,447 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5398.800000 2021-02-19 04:21:59,489 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:21:59,628 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:21:59,803 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 132.900000 2021-02-19 04:22:00,109 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2645.000000 2021-02-19 04:22:00,463 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3015.000000 2021-02-19 04:22:00,757 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8276.600000 2021-02-19 04:22:00,839 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:00,947 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6261.100000 2021-02-19 04:22:01,036 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:01,062 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5398.800000 2021-02-19 04:22:01,115 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:01,244 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:01,415 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 135.300000 2021-02-19 04:22:01,709 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2645.000000 2021-02-19 04:22:01,811 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 7.06 % 2021-02-19 04:22:01,825 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:22:01,825 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:22:02,062 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3015.000000 2021-02-19 04:22:02,240 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 7.09 % 2021-02-19 04:22:02,240 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 7.09291068622 2021-02-19 04:22:02,371 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8452.100000 2021-02-19 04:22:02,483 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:02,578 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6255.100000 2021-02-19 04:22:02,686 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.900000 2021-02-19 04:22:02,726 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:02,743 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3740.500000 2021-02-19 04:22:02,845 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:03,028 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 127.500000 2021-02-19 04:22:03,312 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2666.100000 2021-02-19 04:22:03,664 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3129.300000 2021-02-19 04:22:03,987 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8452.100000 2021-02-19 04:22:04,096 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:04,204 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6255.100000 2021-02-19 04:22:04,278 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.900000 2021-02-19 04:22:04,351 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:04,365 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3740.500000 2021-02-19 04:22:04,453 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:04,635 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 132.200000 2021-02-19 04:22:04,944 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2666.100000 2021-02-19 04:22:05,260 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3129.300000 2021-02-19 04:22:05,598 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8567.900000 2021-02-19 04:22:05,739 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:05,819 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6255.100000 2021-02-19 04:22:05,901 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.900000 2021-02-19 04:22:05,989 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:06,005 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1949.900000 2021-02-19 04:22:06,071 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:06,246 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 127.500000 2021-02-19 04:22:06,585 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2784.900000 2021-02-19 04:22:06,861 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3355.400000 2021-02-19 04:22:07,246 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8567.900000 2021-02-19 04:22:07,279 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 7.35 % 2021-02-19 04:22:07,279 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 7.34638115945 2021-02-19 04:22:07,378 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:07,444 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6243.100000 2021-02-19 04:22:07,542 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.900000 2021-02-19 04:22:07,609 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:07,648 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1949.900000 2021-02-19 04:22:07,683 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:07,855 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 127.500000 2021-02-19 04:22:08,187 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2784.900000 2021-02-19 04:22:08,471 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3355.400000 2021-02-19 04:22:08,846 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8567.900000 2021-02-19 04:22:08,980 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:09,055 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6243.100000 2021-02-19 04:22:09,161 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.900000 2021-02-19 04:22:09,219 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:09,285 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1949.900000 2021-02-19 04:22:09,312 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:09,457 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 119.500000 2021-02-19 04:22:09,792 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2784.900000 2021-02-19 04:22:10,072 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3355.400000 2021-02-19 04:22:10,444 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8567.900000 2021-02-19 04:22:10,611 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:10,665 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6243.100000 2021-02-19 04:22:10,816 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.900000 2021-02-19 04:22:10,842 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:10,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1949.900000 2021-02-19 04:22:10,921 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:11,092 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 119.500000 2021-02-19 04:22:11,436 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2784.900000 2021-02-19 04:22:11,664 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3355.400000 2021-02-19 04:22:11,836 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 7.59 % 2021-02-19 04:22:11,851 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:22:11,851 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:22:12,049 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8567.900000 2021-02-19 04:22:12,216 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:12,276 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6192.400000 2021-02-19 04:22:12,322 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 7.60 % 2021-02-19 04:22:12,322 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 7.59934704375 2021-02-19 04:22:12,456 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:12,476 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:12,522 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1589.500000 2021-02-19 04:22:12,569 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:12,742 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 99.700000 2021-02-19 04:22:13,029 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2912.500000 2021-02-19 04:22:13,265 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3460.700000 2021-02-19 04:22:13,664 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8579.400000 2021-02-19 04:22:13,822 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:13,901 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6192.400000 2021-02-19 04:22:14,069 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:14,086 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:14,125 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1589.500000 2021-02-19 04:22:14,167 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:14,348 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 80.700000 2021-02-19 04:22:14,624 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2912.500000 2021-02-19 04:22:14,851 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3460.700000 2021-02-19 04:22:15,282 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8579.400000 2021-02-19 04:22:15,427 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:15,506 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6238.900000 2021-02-19 04:22:15,673 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:22:15,704 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:15,746 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1589.500000 2021-02-19 04:22:15,785 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:15,971 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 71.800000 2021-02-19 04:22:16,220 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2984.200000 2021-02-19 04:22:16,484 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3480.200000 2021-02-19 04:22:16,891 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8581.200000 2021-02-19 04:22:17,055 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:17,124 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6238.900000 2021-02-19 04:22:17,286 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:22:17,332 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:17,359 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 7.68 % 2021-02-19 04:22:17,359 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 7.68282802365 2021-02-19 04:22:17,369 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1605.600000 2021-02-19 04:22:17,400 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:17,588 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 71.800000 2021-02-19 04:22:17,822 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2984.200000 2021-02-19 04:22:18,073 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3480.200000 2021-02-19 04:22:18,496 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8581.200000 2021-02-19 04:22:18,651 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:18,733 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6238.900000 2021-02-19 04:22:18,921 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:22:18,963 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:18,989 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1605.600000 2021-02-19 04:22:19,012 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:19,191 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 71.800000 2021-02-19 04:22:19,426 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2984.200000 2021-02-19 04:22:19,660 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3480.200000 2021-02-19 04:22:20,095 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8581.200000 2021-02-19 04:22:20,263 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:20,345 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6238.900000 2021-02-19 04:22:20,571 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:22:20,595 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:20,624 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1605.600000 2021-02-19 04:22:20,661 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:20,811 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 73.700000 2021-02-19 04:22:21,029 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2984.200000 2021-02-19 04:22:21,259 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3480.200000 2021-02-19 04:22:21,711 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8581.200000 2021-02-19 04:22:21,862 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 7.78 % 2021-02-19 04:22:21,868 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:21,877 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:22:21,877 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:22:21,959 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6238.900000 2021-02-19 04:22:22,180 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:22:22,207 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:22,256 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1605.600000 2021-02-19 04:22:22,269 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:22,401 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 7.78 % 2021-02-19 04:22:22,401 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 7.78437799527 2021-02-19 04:22:22,438 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 71.400000 2021-02-19 04:22:22,673 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2895.300000 2021-02-19 04:22:22,858 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3432.200000 2021-02-19 04:22:23,313 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8726.500000 2021-02-19 04:22:23,487 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:23,559 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6341.400000 2021-02-19 04:22:23,796 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:22:23,828 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:23,878 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1619.000000 2021-02-19 04:22:23,897 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:24,068 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 71.400000 2021-02-19 04:22:24,275 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2895.300000 2021-02-19 04:22:24,466 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3432.200000 2021-02-19 04:22:24,911 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8726.500000 2021-02-19 04:22:25,095 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:25,163 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6341.400000 2021-02-19 04:22:25,407 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400000 2021-02-19 04:22:25,447 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:25,496 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1646.500000 2021-02-19 04:22:25,509 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:25,667 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 139.500000 2021-02-19 04:22:25,881 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2895.300000 2021-02-19 04:22:26,081 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3390.000000 2021-02-19 04:22:26,503 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8882.600000 2021-02-19 04:22:26,686 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:26,756 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6395.500000 2021-02-19 04:22:27,023 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300000 2021-02-19 04:22:27,056 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:27,115 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1646.500000 2021-02-19 04:22:27,122 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:27,296 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 139.500000 2021-02-19 04:22:27,446 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 7.87 % 2021-02-19 04:22:27,446 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 7.86886815302 2021-02-19 04:22:27,496 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2789.500000 2021-02-19 04:22:27,684 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3390.000000 2021-02-19 04:22:28,121 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8882.600000 2021-02-19 04:22:28,280 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:28,365 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6395.500000 2021-02-19 04:22:28,653 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300000 2021-02-19 04:22:28,664 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:28,717 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:28,736 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1646.500000 2021-02-19 04:22:28,910 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 139.500000 2021-02-19 04:22:29,099 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2789.500000 2021-02-19 04:22:29,279 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3390.000000 2021-02-19 04:22:29,730 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8882.600000 2021-02-19 04:22:29,871 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:29,974 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6395.500000 2021-02-19 04:22:30,273 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:30,295 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300000 2021-02-19 04:22:30,328 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:30,359 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1646.500000 2021-02-19 04:22:30,535 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 188.900000 2021-02-19 04:22:30,693 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2789.500000 2021-02-19 04:22:30,884 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3390.000000 2021-02-19 04:22:31,318 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8882.600000 2021-02-19 04:22:31,463 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:31,573 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6395.500000 2021-02-19 04:22:31,877 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:31,888 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 7.97 % 2021-02-19 04:22:31,901 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:22:31,901 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:22:31,914 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300000 2021-02-19 04:22:31,930 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:32,000 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1646.500000 2021-02-19 04:22:32,165 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 188.900000 2021-02-19 04:22:32,288 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2775.700000 2021-02-19 04:22:32,486 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3412.700000 2021-02-19 04:22:32,486 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 7.97 % 2021-02-19 04:22:32,486 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 7.97193189142 2021-02-19 04:22:32,926 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8808.800000 2021-02-19 04:22:33,078 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:33,183 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6504.900000 2021-02-19 04:22:33,482 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:33,513 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300000 2021-02-19 04:22:33,526 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:33,617 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1658.300000 2021-02-19 04:22:33,773 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 315.300000 2021-02-19 04:22:33,904 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2775.700000 2021-02-19 04:22:34,081 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3412.700000 2021-02-19 04:22:34,519 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8808.800000 2021-02-19 04:22:34,674 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:34,788 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6504.900000 2021-02-19 04:22:35,098 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:35,128 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.300000 2021-02-19 04:22:35,144 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:35,266 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1658.300000 2021-02-19 04:22:35,400 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 351.000000 2021-02-19 04:22:35,549 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2721.700700 2021-02-19 04:22:35,687 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3455.879686 2021-02-19 04:22:36,130 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8770.976197 2021-02-19 04:22:36,305 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:36,424 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6585.413776 2021-02-19 04:22:36,723 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:36,767 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:36,796 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:36,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1629.558692 2021-02-19 04:22:37,065 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 357.689113 2021-02-19 04:22:37,200 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2721.700700 2021-02-19 04:22:37,282 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3455.879686 2021-02-19 04:22:37,525 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.06 % 2021-02-19 04:22:37,525 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 8.06278143903 2021-02-19 04:22:37,736 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8770.976197 2021-02-19 04:22:37,921 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:38,032 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6585.413776 2021-02-19 04:22:38,335 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:38,414 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:38,467 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:38,519 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1629.558692 2021-02-19 04:22:38,701 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 357.689113 2021-02-19 04:22:38,805 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2721.700700 2021-02-19 04:22:38,887 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3455.879686 2021-02-19 04:22:38,917 | infra | INFO | pool-2-thread-46 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:22:38,918 | infra | INFO | pool-2-thread-46 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:22:39,342 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8770.976197 2021-02-19 04:22:39,513 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:39,637 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6585.413776 2021-02-19 04:22:39,950 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:40,019 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:40,101 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:40,134 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1629.558692 2021-02-19 04:22:40,348 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 372.289113 2021-02-19 04:22:40,414 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2721.700700 2021-02-19 04:22:40,538 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3455.879686 2021-02-19 04:22:40,940 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8770.976197 2021-02-19 04:22:41,122 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:41,243 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6585.413776 2021-02-19 04:22:41,562 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:41,630 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:41,717 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:41,753 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1629.558692 2021-02-19 04:22:41,913 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.12 % 2021-02-19 04:22:41,926 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:22:41,926 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:22:41,960 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 372.289113 2021-02-19 04:22:42,026 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2721.700700 2021-02-19 04:22:42,150 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3455.879686 2021-02-19 04:22:42,548 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9058.376197 2021-02-19 04:22:42,565 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.13 % 2021-02-19 04:22:42,565 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 8.12920260503 2021-02-19 04:22:42,717 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:42,836 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6570.013776 2021-02-19 04:22:43,223 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:43,247 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:43,361 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1585.458692 2021-02-19 04:22:43,378 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:43,578 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 303.589113 2021-02-19 04:22:43,654 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2668.500700 2021-02-19 04:22:43,786 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3466.779686 2021-02-19 04:22:44,154 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9058.376197 2021-02-19 04:22:44,328 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:44,437 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6570.013776 2021-02-19 04:22:44,842 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:44,861 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:44,970 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1585.458692 2021-02-19 04:22:44,976 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:45,213 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 250.989113 2021-02-19 04:22:45,290 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2668.500700 2021-02-19 04:22:45,417 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3466.779686 2021-02-19 04:22:45,756 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9058.376197 2021-02-19 04:22:45,926 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:46,042 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6535.875983 2021-02-19 04:22:46,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:46,536 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:46,607 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1562.834520 2021-02-19 04:22:46,615 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:46,834 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 248.610173 2021-02-19 04:22:46,895 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2754.024957 2021-02-19 04:22:47,009 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3472.922157 2021-02-19 04:22:47,345 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9346.910363 2021-02-19 04:22:47,517 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:47,601 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.23 % 2021-02-19 04:22:47,602 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 8.22590695357 2021-02-19 04:22:47,647 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6535.875983 2021-02-19 04:22:48,117 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:48,148 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:48,214 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1562.834520 2021-02-19 04:22:48,226 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:48,451 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 248.610173 2021-02-19 04:22:48,509 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2754.024957 2021-02-19 04:22:48,614 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3472.922157 2021-02-19 04:22:48,956 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9346.910363 2021-02-19 04:22:49,130 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:49,256 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6535.875983 2021-02-19 04:22:49,756 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:49,770 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:49,848 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:49,849 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1562.834520 2021-02-19 04:22:50,076 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 268.310173 2021-02-19 04:22:50,118 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2754.024957 2021-02-19 04:22:50,246 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3472.922157 2021-02-19 04:22:50,543 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9346.910363 2021-02-19 04:22:50,733 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:50,858 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6535.875983 2021-02-19 04:22:51,378 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:51,408 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:51,464 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:51,500 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1562.834520 2021-02-19 04:22:51,687 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 268.310173 2021-02-19 04:22:51,717 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2754.024957 2021-02-19 04:22:51,842 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3472.922157 2021-02-19 04:22:51,938 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.27 % 2021-02-19 04:22:51,950 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:22:51,950 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:22:52,150 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9346.910363 2021-02-19 04:22:52,342 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:52,453 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6503.475983 2021-02-19 04:22:52,640 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.30 % 2021-02-19 04:22:52,641 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 8.29868750944 2021-02-19 04:22:52,970 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:53,013 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:53,105 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:53,131 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1573.934520 2021-02-19 04:22:53,305 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 402.410173 2021-02-19 04:22:53,331 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2779.824957 2021-02-19 04:22:53,464 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3487.122157 2021-02-19 04:22:53,759 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9382.810363 2021-02-19 04:22:53,951 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:54,049 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6503.475983 2021-02-19 04:22:54,582 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:54,641 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:54,710 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:54,750 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1573.934520 2021-02-19 04:22:54,921 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 402.410173 2021-02-19 04:22:54,934 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2779.824957 2021-02-19 04:22:55,088 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3487.122157 2021-02-19 04:22:55,362 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9382.810363 2021-02-19 04:22:55,575 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:55,657 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6531.100000 2021-02-19 04:22:56,198 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:56,260 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:56,313 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:56,384 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1598.600000 2021-02-19 04:22:56,532 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 560.100000 2021-02-19 04:22:56,546 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2762.100000 2021-02-19 04:22:56,697 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3516.100000 2021-02-19 04:22:56,966 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9354.500000 2021-02-19 04:22:57,174 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:57,263 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6531.100000 2021-02-19 04:22:57,680 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.38 % 2021-02-19 04:22:57,680 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 8.38317766719 2021-02-19 04:22:57,816 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:57,864 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:57,917 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:58,005 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1598.600000 2021-02-19 04:22:58,151 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 560.100000 2021-02-19 04:22:58,164 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2762.100000 2021-02-19 04:22:58,312 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3516.100000 2021-02-19 04:22:58,555 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9354.500000 2021-02-19 04:22:58,775 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:22:58,859 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6531.100000 2021-02-19 04:22:59,447 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:22:59,477 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:22:59,543 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:22:59,631 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1598.600000 2021-02-19 04:22:59,778 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2762.100000 2021-02-19 04:22:59,802 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 560.100000 2021-02-19 04:22:59,920 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3516.100000 2021-02-19 04:23:00,157 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9354.500000 2021-02-19 04:23:00,391 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:00,459 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6531.100000 2021-02-19 04:23:01,081 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:23:01,105 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:01,157 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:01,246 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1598.600000 2021-02-19 04:23:01,400 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2762.100000 2021-02-19 04:23:01,437 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 619.400000 2021-02-19 04:23:01,549 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3516.100000 2021-02-19 04:23:01,773 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9354.500000 2021-02-19 04:23:01,960 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.44 % 2021-02-19 04:23:01,971 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:23:01,971 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:23:01,983 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:02,058 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6531.100000 2021-02-19 04:23:02,710 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:02,721 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.49 % 2021-02-19 04:23:02,723 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 8.49209620653 2021-02-19 04:23:02,733 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:23:02,805 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:02,868 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1666.100000 2021-02-19 04:23:03,023 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2933.300000 2021-02-19 04:23:03,063 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 609.400000 2021-02-19 04:23:03,157 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3596.800000 2021-02-19 04:23:03,364 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9281.200000 2021-02-19 04:23:03,589 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:03,664 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6536.400000 2021-02-19 04:23:04,311 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:04,341 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:23:04,405 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:04,490 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1666.100000 2021-02-19 04:23:04,644 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2933.300000 2021-02-19 04:23:04,696 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 628.600000 2021-02-19 04:23:04,779 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3596.800000 2021-02-19 04:23:04,973 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9281.200000 2021-02-19 04:23:05,201 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:05,286 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6536.400000 2021-02-19 04:23:05,911 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:05,937 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:23:06,013 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:06,107 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1737.583175 2021-02-19 04:23:06,253 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3082.577883 2021-02-19 04:23:06,309 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 643.617324 2021-02-19 04:23:06,381 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3697.993959 2021-02-19 04:23:06,562 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9128.120270 2021-02-19 04:23:06,792 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:06,894 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6507.022716 2021-02-19 04:23:07,509 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:07,535 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599101 2021-02-19 04:23:07,605 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:07,755 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1737.583175 2021-02-19 04:23:07,763 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.58 % 2021-02-19 04:23:07,765 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 8.5770909532 2021-02-19 04:23:07,941 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3082.577883 2021-02-19 04:23:07,957 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 643.617324 2021-02-19 04:23:07,993 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3697.993959 2021-02-19 04:23:08,163 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9128.120270 2021-02-19 04:23:08,408 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:08,510 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6507.022716 2021-02-19 04:23:09,145 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:09,165 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599101 2021-02-19 04:23:09,200 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:09,351 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1737.583175 2021-02-19 04:23:09,555 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3082.577883 2021-02-19 04:23:09,584 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 602.717324 2021-02-19 04:23:09,595 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3697.993959 2021-02-19 04:23:09,769 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9128.120270 2021-02-19 04:23:10,046 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:10,121 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6507.022716 2021-02-19 04:23:10,753 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:10,822 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599101 2021-02-19 04:23:10,832 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:10,976 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1737.583175 2021-02-19 04:23:11,171 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3082.577883 2021-02-19 04:23:11,209 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 602.717324 2021-02-19 04:23:11,219 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3697.993959 2021-02-19 04:23:11,410 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 9128.120270 2021-02-19 04:23:11,641 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:11,760 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6507.022716 2021-02-19 04:23:11,983 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.64 % 2021-02-19 04:23:11,996 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:23:11,996 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:23:12,364 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:12,464 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599101 2021-02-19 04:23:12,476 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:12,627 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1927.383175 2021-02-19 04:23:12,809 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3368.877883 2021-02-19 04:23:12,812 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.69 % 2021-02-19 04:23:12,812 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 8.68550490361 2021-02-19 04:23:12,835 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3829.393959 2021-02-19 04:23:12,849 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 522.117324 2021-02-19 04:23:13,025 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8960.320270 2021-02-19 04:23:13,237 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:13,372 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6450.422716 2021-02-19 04:23:13,986 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:14,115 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599101 2021-02-19 04:23:14,167 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:14,279 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1927.383175 2021-02-19 04:23:14,466 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3368.877883 2021-02-19 04:23:14,500 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 388.417324 2021-02-19 04:23:14,532 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3829.393959 2021-02-19 04:23:14,632 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8960.320270 2021-02-19 04:23:14,835 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:14,980 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6450.422716 2021-02-19 04:23:15,591 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:15,733 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599101 2021-02-19 04:23:15,826 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:15,878 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1927.383175 2021-02-19 04:23:16,072 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3735.872609 2021-02-19 04:23:16,125 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 353.129745 2021-02-19 04:23:16,164 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3881.384026 2021-02-19 04:23:16,236 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8931.135954 2021-02-19 04:23:16,440 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:16,585 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6347.723235 2021-02-19 04:23:17,207 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:17,365 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400601 2021-02-19 04:23:17,461 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:17,506 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2159.865548 2021-02-19 04:23:17,749 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 353.129745 2021-02-19 04:23:17,778 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3735.872609 2021-02-19 04:23:17,819 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3881.384026 2021-02-19 04:23:17,855 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.76 % 2021-02-19 04:23:17,855 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 8.75727628163 2021-02-19 04:23:17,872 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8931.135954 2021-02-19 04:23:18,039 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:18,207 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6347.723235 2021-02-19 04:23:18,811 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:18,993 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400601 2021-02-19 04:23:19,062 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:19,108 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2159.865548 2021-02-19 04:23:19,384 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 353.129745 2021-02-19 04:23:19,403 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3735.872609 2021-02-19 04:23:19,450 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3881.384026 2021-02-19 04:23:19,490 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8931.135954 2021-02-19 04:23:19,664 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:19,805 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6347.723235 2021-02-19 04:23:20,411 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:20,611 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400601 2021-02-19 04:23:20,724 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:20,752 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2159.865548 2021-02-19 04:23:21,023 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 330.029745 2021-02-19 04:23:21,040 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3735.872609 2021-02-19 04:23:21,068 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3881.384026 2021-02-19 04:23:21,125 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8931.135954 2021-02-19 04:23:21,267 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:21,415 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6347.723235 2021-02-19 04:23:22,003 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:22,009 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.90 % 2021-02-19 04:23:22,020 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:23:22,022 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:23:22,213 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.400601 2021-02-19 04:23:22,341 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:22,381 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2330.865548 2021-02-19 04:23:22,677 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3826.972609 2021-02-19 04:23:22,697 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 298.229745 2021-02-19 04:23:22,697 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3684.884026 2021-02-19 04:23:22,749 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8980.435954 2021-02-19 04:23:22,872 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:22,898 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 8.94 % 2021-02-19 04:23:22,900 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 8.93897537684 2021-02-19 04:23:23,017 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6336.723235 2021-02-19 04:23:23,596 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:23,813 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1.200601 2021-02-19 04:23:23,940 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:23,976 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2330.865548 2021-02-19 04:23:24,283 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3826.972609 2021-02-19 04:23:24,361 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 298.129745 2021-02-19 04:23:24,375 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3684.884026 2021-02-19 04:23:24,388 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8980.435954 2021-02-19 04:23:24,477 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:24,638 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6336.723235 2021-02-19 04:23:25,187 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:25,471 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:23:25,559 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:25,612 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2448.400000 2021-02-19 04:23:25,903 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3826.972609 2021-02-19 04:23:26,012 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3684.884026 2021-02-19 04:23:26,022 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 298.129745 2021-02-19 04:23:26,046 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8980.435954 2021-02-19 04:23:26,124 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:26,260 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6369.400000 2021-02-19 04:23:26,788 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:27,078 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:23:27,213 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:27,279 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2448.400000 2021-02-19 04:23:27,549 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3820.900000 2021-02-19 04:23:27,658 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 290.800000 2021-02-19 04:23:27,670 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3533.700000 2021-02-19 04:23:27,706 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8910.100000 2021-02-19 04:23:27,736 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:27,884 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6369.400000 2021-02-19 04:23:27,934 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.15 % 2021-02-19 04:23:27,936 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 9.14510285365 2021-02-19 04:23:28,388 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:28,729 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:23:28,862 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:28,901 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2448.400000 2021-02-19 04:23:29,157 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3820.900000 2021-02-19 04:23:29,285 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 290.800000 2021-02-19 04:23:29,336 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8910.100000 2021-02-19 04:23:29,375 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3533.700000 2021-02-19 04:23:29,411 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:29,510 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6369.400000 2021-02-19 04:23:29,986 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:30,351 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:23:30,473 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:30,519 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2448.400000 2021-02-19 04:23:30,772 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3820.900000 2021-02-19 04:23:30,908 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 339.600000 2021-02-19 04:23:30,948 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8910.100000 2021-02-19 04:23:31,003 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3533.700000 2021-02-19 04:23:31,028 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:31,128 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6369.400000 2021-02-19 04:23:31,582 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:31,966 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:23:32,035 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.30 % 2021-02-19 04:23:32,048 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:23:32,048 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:23:32,114 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:32,148 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2448.400000 2021-02-19 04:23:32,382 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4553.500000 2021-02-19 04:23:32,533 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 419.800000 2021-02-19 04:23:32,572 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8715.800000 2021-02-19 04:23:32,648 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3697.000000 2021-02-19 04:23:32,651 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:32,742 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6173.600000 2021-02-19 04:23:32,976 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.36 % 2021-02-19 04:23:32,976 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 9.35708513139 2021-02-19 04:23:33,171 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:33,588 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:23:33,727 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:33,763 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2676.000000 2021-02-19 04:23:33,953 | infra | INFO | pool-2-thread-30 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:23:33,953 | infra | INFO | pool-2-thread-30 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:23:33,996 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4553.500000 2021-02-19 04:23:34,196 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 506.700000 2021-02-19 04:23:34,224 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8715.800000 2021-02-19 04:23:34,265 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:34,313 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3697.000000 2021-02-19 04:23:34,397 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6173.600000 2021-02-19 04:23:34,769 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:35,200 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:23:35,346 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:35,400 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2676.000000 2021-02-19 04:23:35,609 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5761.200000 2021-02-19 04:23:35,828 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 506.700000 2021-02-19 04:23:35,858 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8715.800000 2021-02-19 04:23:35,885 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:35,944 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3697.000000 2021-02-19 04:23:36,023 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6173.600000 2021-02-19 04:23:36,375 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:36,808 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:23:36,973 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:37,012 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3094.800000 2021-02-19 04:23:37,220 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5761.200000 2021-02-19 04:23:37,517 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 511.700000 2021-02-19 04:23:37,523 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:37,555 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8563.600000 2021-02-19 04:23:37,569 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3895.200000 2021-02-19 04:23:37,655 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5922.700000 2021-02-19 04:23:37,976 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:38,019 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.42 % 2021-02-19 04:23:38,019 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 9.42300170847 2021-02-19 04:23:38,411 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:23:38,572 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:38,627 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3094.800000 2021-02-19 04:23:38,819 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5761.200000 2021-02-19 04:23:39,163 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 511.700000 2021-02-19 04:23:39,177 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:39,217 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8563.600000 2021-02-19 04:23:39,236 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3895.200000 2021-02-19 04:23:39,290 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5922.700000 2021-02-19 04:23:39,615 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:40,063 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:23:40,181 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:40,243 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3094.800000 2021-02-19 04:23:40,434 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5761.200000 2021-02-19 04:23:40,799 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 492.900000 2021-02-19 04:23:40,808 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:40,846 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8563.600000 2021-02-19 04:23:40,894 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3895.200000 2021-02-19 04:23:40,920 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5922.700000 2021-02-19 04:23:41,253 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:41,677 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.800000 2021-02-19 04:23:41,803 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:23:41,852 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3094.800000 2021-02-19 04:23:42,058 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5761.200000 2021-02-19 04:23:42,066 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.56 % 2021-02-19 04:23:42,078 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:23:42,079 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:23:42,424 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:42,440 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 458.900000 2021-02-19 04:23:42,483 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8231.800000 2021-02-19 04:23:42,529 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3851.600000 2021-02-19 04:23:42,546 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5458.500000 2021-02-19 04:23:42,849 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:43,062 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.60 % 2021-02-19 04:23:43,062 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 9.59834141382 2021-02-19 04:23:43,303 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1669.500000 2021-02-19 04:23:43,483 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1231.200000 2021-02-19 04:23:43,530 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3595.100000 2021-02-19 04:23:43,674 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6958.800000 2021-02-19 04:23:44,091 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:44,140 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 8231.800000 2021-02-19 04:23:44,164 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 458.900000 2021-02-19 04:23:44,180 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3851.600000 2021-02-19 04:23:44,190 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5458.500000 2021-02-19 04:23:44,519 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:44,901 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1669.500000 2021-02-19 04:23:45,105 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1231.200000 2021-02-19 04:23:45,144 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3595.100000 2021-02-19 04:23:45,289 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6958.800000 2021-02-19 04:23:45,704 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:45,779 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7784.600000 2021-02-19 04:23:45,854 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5458.500000 2021-02-19 04:23:45,887 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3851.600000 2021-02-19 04:23:45,895 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 421.300000 2021-02-19 04:23:46,118 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:46,519 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4021.000000 2021-02-19 04:23:46,720 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3002.600000 2021-02-19 04:23:46,778 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3929.300000 2021-02-19 04:23:46,953 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7792.100000 2021-02-19 04:23:47,316 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:47,418 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7784.600000 2021-02-19 04:23:47,487 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4938.700000 2021-02-19 04:23:47,502 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3691.900000 2021-02-19 04:23:47,530 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 410.500000 2021-02-19 04:23:47,709 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:48,111 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.72 % 2021-02-19 04:23:48,111 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 9.71896955504 2021-02-19 04:23:48,114 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4021.000000 2021-02-19 04:23:48,328 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3002.600000 2021-02-19 04:23:48,398 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3929.300000 2021-02-19 04:23:48,572 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7792.100000 2021-02-19 04:23:48,927 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:49,048 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7784.600000 2021-02-19 04:23:49,121 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4938.700000 2021-02-19 04:23:49,130 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3691.900000 2021-02-19 04:23:49,167 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 410.500000 2021-02-19 04:23:49,328 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:49,736 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4021.000000 2021-02-19 04:23:49,933 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3002.600000 2021-02-19 04:23:50,025 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3929.300000 2021-02-19 04:23:50,190 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7792.100000 2021-02-19 04:23:50,552 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:50,677 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7784.600000 2021-02-19 04:23:50,773 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3691.900000 2021-02-19 04:23:50,775 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4938.700000 2021-02-19 04:23:50,798 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 330.700000 2021-02-19 04:23:50,940 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:51,357 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4021.000000 2021-02-19 04:23:51,538 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3002.600000 2021-02-19 04:23:51,655 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3929.300000 2021-02-19 04:23:51,792 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7792.100000 2021-02-19 04:23:52,094 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.74 % 2021-02-19 04:23:52,107 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:23:52,107 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:23:52,173 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:52,306 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7638.100000 2021-02-19 04:23:52,428 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4819.500000 2021-02-19 04:23:52,437 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3613.900000 2021-02-19 04:23:52,450 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 227.200000 2021-02-19 04:23:52,579 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:52,957 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4681.700000 2021-02-19 04:23:53,155 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.77 % 2021-02-19 04:23:53,155 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 9.76580796253 2021-02-19 04:23:53,160 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3784.000000 2021-02-19 04:23:53,269 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3983.300000 2021-02-19 04:23:53,401 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7921.200000 2021-02-19 04:23:53,798 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:53,940 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7638.100000 2021-02-19 04:23:54,061 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3613.900000 2021-02-19 04:23:54,082 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4819.500000 2021-02-19 04:23:54,111 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 227.200000 2021-02-19 04:23:54,194 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:54,565 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4681.700000 2021-02-19 04:23:54,775 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3784.000000 2021-02-19 04:23:54,868 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3983.300000 2021-02-19 04:23:55,000 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7921.200000 2021-02-19 04:23:55,407 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:55,565 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7630.118039 2021-02-19 04:23:55,700 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3570.396955 2021-02-19 04:23:55,723 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4803.229300 2021-02-19 04:23:55,752 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 112.899661 2021-02-19 04:23:55,818 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:56,181 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4594.249755 2021-02-19 04:23:56,408 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4006.809843 2021-02-19 04:23:56,487 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3991.418668 2021-02-19 04:23:56,632 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7897.425417 2021-02-19 04:23:57,017 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:57,177 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7630.118039 2021-02-19 04:23:57,319 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3570.396955 2021-02-19 04:23:57,348 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4803.229300 2021-02-19 04:23:57,408 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 112.899661 2021-02-19 04:23:57,448 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:57,779 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4594.249755 2021-02-19 04:23:58,020 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4006.809843 2021-02-19 04:23:58,105 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3991.418668 2021-02-19 04:23:58,197 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.81 % 2021-02-19 04:23:58,198 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 9.81264637002 2021-02-19 04:23:58,259 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7897.425417 2021-02-19 04:23:58,651 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:23:58,803 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7630.118039 2021-02-19 04:23:58,977 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3570.396955 2021-02-19 04:23:59,000 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4803.229300 2021-02-19 04:23:59,071 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 112.899661 2021-02-19 04:23:59,092 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:23:59,388 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4594.249755 2021-02-19 04:23:59,621 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4006.809843 2021-02-19 04:23:59,723 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3991.418668 2021-02-19 04:23:59,868 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7897.425417 2021-02-19 04:24:00,250 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:00,411 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7630.118039 2021-02-19 04:24:00,604 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3570.396955 2021-02-19 04:24:00,631 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4803.229300 2021-02-19 04:24:00,698 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 82.799661 2021-02-19 04:24:00,717 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:01,013 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4594.249755 2021-02-19 04:24:01,221 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4006.809843 2021-02-19 04:24:01,335 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3991.418668 2021-02-19 04:24:01,505 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7897.425417 2021-02-19 04:24:01,878 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:02,019 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7630.118039 2021-02-19 04:24:02,125 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.84 % 2021-02-19 04:24:02,141 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:24:02,141 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:24:02,286 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3570.396955 2021-02-19 04:24:02,355 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 69.299661 2021-02-19 04:24:02,372 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4803.229300 2021-02-19 04:24:02,398 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:02,641 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4541.849755 2021-02-19 04:24:02,836 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3965.209843 2021-02-19 04:24:02,983 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3982.718668 2021-02-19 04:24:03,132 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7902.725417 2021-02-19 04:24:03,253 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.84 % 2021-02-19 04:24:03,253 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 9.83606557377 2021-02-19 04:24:03,490 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:03,667 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7714.618039 2021-02-19 04:24:03,914 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3485.396955 2021-02-19 04:24:04,000 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 69.299661 2021-02-19 04:24:04,016 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:04,020 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4814.929300 2021-02-19 04:24:04,252 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4541.849755 2021-02-19 04:24:04,476 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3965.209843 2021-02-19 04:24:04,632 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3982.718668 2021-02-19 04:24:04,782 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7902.725417 2021-02-19 04:24:04,980 | infra | INFO | pool-2-thread-45 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:24:04,980 | infra | INFO | pool-2-thread-45 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:24:05,088 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:05,275 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7714.618039 2021-02-19 04:24:05,526 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3457.255204 2021-02-19 04:24:05,664 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 60.300000 2021-02-19 04:24:05,678 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:05,706 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4874.471922 2021-02-19 04:24:05,865 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4541.849755 2021-02-19 04:24:06,082 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3989.631674 2021-02-19 04:24:06,234 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4004.017540 2021-02-19 04:24:06,405 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7980.506812 2021-02-19 04:24:06,681 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:06,881 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7866.740569 2021-02-19 04:24:07,134 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3457.255204 2021-02-19 04:24:07,326 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:07,339 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 60.300000 2021-02-19 04:24:07,348 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4874.471922 2021-02-19 04:24:07,480 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4599.848843 2021-02-19 04:24:07,687 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3989.631674 2021-02-19 04:24:07,846 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4004.017540 2021-02-19 04:24:08,019 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7980.506812 2021-02-19 04:24:08,301 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.88 % 2021-02-19 04:24:08,302 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 9.88290398126 2021-02-19 04:24:08,312 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:08,502 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7866.740569 2021-02-19 04:24:08,734 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3457.255204 2021-02-19 04:24:08,933 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:08,960 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 60.300000 2021-02-19 04:24:08,973 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4874.471922 2021-02-19 04:24:09,095 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4599.848843 2021-02-19 04:24:09,286 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3989.631674 2021-02-19 04:24:09,447 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4004.017540 2021-02-19 04:24:09,621 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7980.506812 2021-02-19 04:24:09,911 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:10,101 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7866.740569 2021-02-19 04:24:10,375 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3457.255204 2021-02-19 04:24:10,555 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:10,592 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 64.300000 2021-02-19 04:24:10,607 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4874.471922 2021-02-19 04:24:10,711 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4599.848843 2021-02-19 04:24:10,877 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3989.631674 2021-02-19 04:24:11,055 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4004.017540 2021-02-19 04:24:11,219 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7980.506812 2021-02-19 04:24:11,507 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:11,694 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7866.740569 2021-02-19 04:24:11,970 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3457.255204 2021-02-19 04:24:12,150 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.91 % 2021-02-19 04:24:12,161 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:12,161 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:24:12,161 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:24:12,220 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 64.300000 2021-02-19 04:24:12,236 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4874.471922 2021-02-19 04:24:12,335 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4697.348843 2021-02-19 04:24:12,469 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4024.331674 2021-02-19 04:24:12,651 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4010.017540 2021-02-19 04:24:12,813 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7988.906812 2021-02-19 04:24:13,088 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:13,290 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6850.540569 2021-02-19 04:24:13,339 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.91 % 2021-02-19 04:24:13,339 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 9.90632318501 2021-02-19 04:24:13,562 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3546.755204 2021-02-19 04:24:13,815 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:13,871 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4909.371922 2021-02-19 04:24:13,891 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 67.900000 2021-02-19 04:24:13,953 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4697.348843 2021-02-19 04:24:14,078 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4024.331674 2021-02-19 04:24:14,250 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4010.017540 2021-02-19 04:24:14,403 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7988.906812 2021-02-19 04:24:14,684 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:14,892 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6850.540569 2021-02-19 04:24:15,176 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3546.755204 2021-02-19 04:24:15,480 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:15,572 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 65.900000 2021-02-19 04:24:15,578 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4206.000000 2021-02-19 04:24:15,615 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4083.400000 2021-02-19 04:24:15,716 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3443.500000 2021-02-19 04:24:15,878 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4010.017540 2021-02-19 04:24:16,022 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7988.906812 2021-02-19 04:24:16,276 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:16,532 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4663.800000 2021-02-19 04:24:16,809 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3126.000000 2021-02-19 04:24:17,111 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:17,244 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4206.000000 2021-02-19 04:24:17,269 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 65.900000 2021-02-19 04:24:17,313 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4083.400000 2021-02-19 04:24:17,394 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3443.500000 2021-02-19 04:24:17,523 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3438.000000 2021-02-19 04:24:17,638 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6868.800000 2021-02-19 04:24:17,890 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:18,148 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4663.800000 2021-02-19 04:24:18,375 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.92 % 2021-02-19 04:24:18,375 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 9.91803278689 2021-02-19 04:24:18,418 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3126.000000 2021-02-19 04:24:18,726 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:18,904 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 65.900000 2021-02-19 04:24:18,951 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4206.000000 2021-02-19 04:24:18,973 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4083.400000 2021-02-19 04:24:19,112 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3443.500000 2021-02-19 04:24:19,171 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3438.000000 2021-02-19 04:24:19,243 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6868.800000 2021-02-19 04:24:19,512 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:19,750 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4663.800000 2021-02-19 04:24:20,046 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3126.000000 2021-02-19 04:24:20,358 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:20,549 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 46.000000 2021-02-19 04:24:20,591 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4206.000000 2021-02-19 04:24:20,604 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4083.400000 2021-02-19 04:24:20,729 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3443.500000 2021-02-19 04:24:20,802 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3438.000000 2021-02-19 04:24:20,848 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6868.800000 2021-02-19 04:24:21,115 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:21,349 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4663.800000 2021-02-19 04:24:21,680 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3126.000000 2021-02-19 04:24:21,947 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:22,160 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 46.000000 2021-02-19 04:24:22,183 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.97 % 2021-02-19 04:24:22,194 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:24:22,194 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:24:22,240 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4206.000000 2021-02-19 04:24:22,269 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4083.400000 2021-02-19 04:24:22,351 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1438.400000 2021-02-19 04:24:22,411 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1438.900000 2021-02-19 04:24:22,484 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2885.900000 2021-02-19 04:24:22,713 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:22,957 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1779.000000 2021-02-19 04:24:23,270 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1318.900000 2021-02-19 04:24:23,415 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 9.99 % 2021-02-19 04:24:23,415 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 9.99414519906 2021-02-19 04:24:23,568 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:23,799 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 27.800000 2021-02-19 04:24:23,920 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1710.800000 2021-02-19 04:24:23,933 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1752.000000 2021-02-19 04:24:24,022 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1438.400000 2021-02-19 04:24:24,059 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1438.900000 2021-02-19 04:24:24,098 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2885.900000 2021-02-19 04:24:24,319 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:24,578 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1779.000000 2021-02-19 04:24:24,861 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1318.900000 2021-02-19 04:24:25,184 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:25,437 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 16.700000 2021-02-19 04:24:25,569 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2.200000 2021-02-19 04:24:25,585 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2.000000 2021-02-19 04:24:25,704 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.800000 2021-02-19 04:24:25,720 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.900000 2021-02-19 04:24:25,734 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 521.500000 2021-02-19 04:24:25,938 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:26,180 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1.500000 2021-02-19 04:24:26,461 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2.000000 2021-02-19 04:24:26,769 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:27,058 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 16.700000 2021-02-19 04:24:27,210 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2.200000 2021-02-19 04:24:27,221 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2.000000 2021-02-19 04:24:27,309 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.800000 2021-02-19 04:24:27,335 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.900000 2021-02-19 04:24:27,371 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 521.500000 2021-02-19 04:24:27,555 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:27,793 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1.500000 2021-02-19 04:24:28,082 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2.000000 2021-02-19 04:24:28,414 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:28,453 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 10.00 % 2021-02-19 04:24:28,454 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 10.0 2021-02-19 04:24:28,693 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 16.700000 2021-02-19 04:24:28,871 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2.000000 2021-02-19 04:24:28,890 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2.200000 2021-02-19 04:24:28,999 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.900000 2021-02-19 04:24:29,022 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.800000 2021-02-19 04:24:29,039 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 521.500000 2021-02-19 04:24:29,183 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:29,446 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1.500000 2021-02-19 04:24:29,698 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2.000000 2021-02-19 04:24:30,016 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:30,344 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1182.400000 2021-02-19 04:24:30,506 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2.000000 2021-02-19 04:24:30,569 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2.200000 2021-02-19 04:24:30,677 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.800000 2021-02-19 04:24:30,693 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 521.500000 2021-02-19 04:24:30,711 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.900000 2021-02-19 04:24:30,826 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:31,076 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1.500000 2021-02-19 04:24:31,313 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2.000000 2021-02-19 04:24:31,625 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:31,984 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1182.400000 2021-02-19 04:24:32,128 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2.000000 2021-02-19 04:24:32,200 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2.200000 2021-02-19 04:24:32,210 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 10.00 % 2021-02-19 04:24:32,223 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:24:32,223 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:24:32,328 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 531.900000 2021-02-19 04:24:32,362 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3541.300000 2021-02-19 04:24:32,378 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 562.200000 2021-02-19 04:24:32,440 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:32,707 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 605.600000 2021-02-19 04:24:32,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 425.700000 2021-02-19 04:24:33,247 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:33,499 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 10.00 % 2021-02-19 04:24:33,499 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 10.0 2021-02-19 04:24:33,607 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3039.700000 2021-02-19 04:24:33,734 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 703.200000 2021-02-19 04:24:33,815 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 688.200000 2021-02-19 04:24:33,993 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 531.900000 2021-02-19 04:24:34,020 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3541.300000 2021-02-19 04:24:34,053 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 562.200000 2021-02-19 04:24:34,079 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:34,323 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 605.600000 2021-02-19 04:24:34,546 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 425.700000 2021-02-19 04:24:34,858 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:35,226 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5435.900000 2021-02-19 04:24:35,336 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 703.200000 2021-02-19 04:24:35,441 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2034.900000 2021-02-19 04:24:35,663 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6581.000000 2021-02-19 04:24:35,677 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1583.600000 2021-02-19 04:24:35,686 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1505.600000 2021-02-19 04:24:35,739 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:35,957 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 605.600000 2021-02-19 04:24:36,167 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1333.800000 2021-02-19 04:24:36,464 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:36,832 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5435.900000 2021-02-19 04:24:36,953 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1924.400000 2021-02-19 04:24:37,058 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2034.900000 2021-02-19 04:24:37,321 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6581.000000 2021-02-19 04:24:37,332 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1583.600000 2021-02-19 04:24:37,352 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1505.600000 2021-02-19 04:24:37,401 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:37,569 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1588.500000 2021-02-19 04:24:37,796 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1333.800000 2021-02-19 04:24:38,131 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:38,443 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5435.900000 2021-02-19 04:24:38,555 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 10.35 % 2021-02-19 04:24:38,555 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 10.3531223092 2021-02-19 04:24:38,584 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1924.400000 2021-02-19 04:24:38,707 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2034.900000 2021-02-19 04:24:38,969 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6581.000000 2021-02-19 04:24:39,010 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1505.600000 2021-02-19 04:24:39,012 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1583.600000 2021-02-19 04:24:39,019 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:39,220 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1588.500000 2021-02-19 04:24:39,427 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1333.800000 2021-02-19 04:24:39,763 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:40,065 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5435.900000 2021-02-19 04:24:40,213 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1924.400000 2021-02-19 04:24:40,345 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2034.900000 2021-02-19 04:24:40,627 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6581.000000 2021-02-19 04:24:40,658 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:40,674 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1583.600000 2021-02-19 04:24:40,687 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1505.600000 2021-02-19 04:24:40,926 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1588.500000 2021-02-19 04:24:41,039 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1333.800000 2021-02-19 04:24:41,375 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:41,681 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6638.600000 2021-02-19 04:24:41,848 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1924.400000 2021-02-19 04:24:41,999 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2034.900000 2021-02-19 04:24:42,236 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 10.77 % 2021-02-19 04:24:42,250 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:24:42,252 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:24:42,263 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6581.000000 2021-02-19 04:24:42,305 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:42,336 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2462.400000 2021-02-19 04:24:42,352 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1789.500000 2021-02-19 04:24:42,552 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2353.400000 2021-02-19 04:24:42,654 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2190.700000 2021-02-19 04:24:42,983 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:43,311 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7147.900000 2021-02-19 04:24:43,463 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3323.100000 2021-02-19 04:24:43,601 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 10.91 % 2021-02-19 04:24:43,601 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 10.9069761426 2021-02-19 04:24:43,624 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3294.400000 2021-02-19 04:24:43,891 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6983.900000 2021-02-19 04:24:43,941 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:43,996 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2462.400000 2021-02-19 04:24:44,010 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1789.500000 2021-02-19 04:24:44,170 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2353.400000 2021-02-19 04:24:44,299 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2190.700000 2021-02-19 04:24:44,608 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:44,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7147.900000 2021-02-19 04:24:45,107 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3323.100000 2021-02-19 04:24:45,239 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3294.400000 2021-02-19 04:24:45,572 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6711.100000 2021-02-19 04:24:45,599 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:45,661 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1751.600000 2021-02-19 04:24:45,671 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2769.800000 2021-02-19 04:24:45,789 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2727.100000 2021-02-19 04:24:45,947 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2190.700000 2021-02-19 04:24:46,201 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:46,566 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7103.100000 2021-02-19 04:24:46,714 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4371.400000 2021-02-19 04:24:46,854 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3653.900000 2021-02-19 04:24:47,198 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6711.100000 2021-02-19 04:24:47,221 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:47,292 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1751.600000 2021-02-19 04:24:47,312 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2769.800000 2021-02-19 04:24:47,414 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2727.100000 2021-02-19 04:24:47,592 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2325.700000 2021-02-19 04:24:47,819 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:48,190 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7103.100000 2021-02-19 04:24:48,357 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4371.400000 2021-02-19 04:24:48,471 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3653.900000 2021-02-19 04:24:48,661 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 11.48 % 2021-02-19 04:24:48,661 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 11.4839219867 2021-02-19 04:24:48,855 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6711.100000 2021-02-19 04:24:48,871 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:48,934 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1751.600000 2021-02-19 04:24:48,966 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2769.800000 2021-02-19 04:24:49,065 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2727.100000 2021-02-19 04:24:49,207 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2325.700000 2021-02-19 04:24:49,427 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:49,796 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7256.000000 2021-02-19 04:24:49,966 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4371.400000 2021-02-19 04:24:50,079 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3653.900000 2021-02-19 04:24:50,510 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6711.100000 2021-02-19 04:24:50,519 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:50,572 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1751.600000 2021-02-19 04:24:50,625 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2769.800000 2021-02-19 04:24:50,683 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2727.100000 2021-02-19 04:24:50,835 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2425.200000 2021-02-19 04:24:51,036 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:51,413 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7256.000000 2021-02-19 04:24:51,573 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4371.400000 2021-02-19 04:24:51,687 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3653.900000 2021-02-19 04:24:52,153 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6711.100000 2021-02-19 04:24:52,174 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:52,220 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1751.600000 2021-02-19 04:24:52,242 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2769.800000 2021-02-19 04:24:52,269 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 11.87 % 2021-02-19 04:24:52,283 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:24:52,283 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:24:52,315 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2805.600000 2021-02-19 04:24:52,487 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2053.600000 2021-02-19 04:24:52,641 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:53,022 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7424.700000 2021-02-19 04:24:53,197 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4685.600000 2021-02-19 04:24:53,315 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3460.400000 2021-02-19 04:24:53,707 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 12.02 % 2021-02-19 04:24:53,707 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 12.0159333267 2021-02-19 04:24:53,772 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6788.200000 2021-02-19 04:24:53,815 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:53,904 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2275.300000 2021-02-19 04:24:53,933 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2479.300000 2021-02-19 04:24:54,005 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2805.600000 2021-02-19 04:24:54,125 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2053.600000 2021-02-19 04:24:54,242 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:54,644 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7597.200000 2021-02-19 04:24:54,801 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4685.600000 2021-02-19 04:24:54,917 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3460.400000 2021-02-19 04:24:55,407 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6788.200000 2021-02-19 04:24:55,417 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:55,523 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2615.900000 2021-02-19 04:24:55,565 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2180.200000 2021-02-19 04:24:55,631 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2948.200000 2021-02-19 04:24:55,742 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2173.900000 2021-02-19 04:24:55,849 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:56,249 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7597.200000 2021-02-19 04:24:56,400 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4804.200000 2021-02-19 04:24:56,523 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3690.500000 2021-02-19 04:24:57,056 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7077.800000 2021-02-19 04:24:57,072 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:57,147 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2615.900000 2021-02-19 04:24:57,191 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2180.200000 2021-02-19 04:24:57,253 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2948.200000 2021-02-19 04:24:57,357 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2173.900000 2021-02-19 04:24:57,461 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:57,855 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7597.200000 2021-02-19 04:24:58,013 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4804.200000 2021-02-19 04:24:58,154 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3690.500000 2021-02-19 04:24:58,674 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:24:58,713 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7077.800000 2021-02-19 04:24:58,753 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 12.63 % 2021-02-19 04:24:58,753 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 12.6304794125 2021-02-19 04:24:58,779 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2615.900000 2021-02-19 04:24:58,821 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2180.200000 2021-02-19 04:24:58,881 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2948.200000 2021-02-19 04:24:59,032 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2173.900000 2021-02-19 04:24:59,101 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:24:59,456 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7528.400000 2021-02-19 04:24:59,635 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4804.200000 2021-02-19 04:24:59,766 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3690.500000 2021-02-19 04:25:00,270 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:00,331 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7077.800000 2021-02-19 04:25:00,431 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2615.900000 2021-02-19 04:25:00,467 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2180.200000 2021-02-19 04:25:00,513 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2948.200000 2021-02-19 04:25:00,657 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2370.400000 2021-02-19 04:25:00,724 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:01,071 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7528.400000 2021-02-19 04:25:01,263 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4804.200000 2021-02-19 04:25:01,381 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3690.500000 2021-02-19 04:25:01,872 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:01,950 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7077.800000 2021-02-19 04:25:02,043 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2615.900000 2021-02-19 04:25:02,092 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2180.200000 2021-02-19 04:25:02,188 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2948.200000 2021-02-19 04:25:02,296 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 12.97 % 2021-02-19 04:25:02,309 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:25:02,309 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:25:02,315 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2156.800000 2021-02-19 04:25:02,371 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:02,687 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7479.900000 2021-02-19 04:25:02,880 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4723.300000 2021-02-19 04:25:02,992 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4103.300000 2021-02-19 04:25:03,473 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:03,579 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7072.700000 2021-02-19 04:25:03,667 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2072.800000 2021-02-19 04:25:03,730 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2482.200000 2021-02-19 04:25:03,795 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 13.13 % 2021-02-19 04:25:03,795 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 13.1279361864 2021-02-19 04:25:03,835 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3044.300000 2021-02-19 04:25:03,979 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2156.800000 2021-02-19 04:25:03,992 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:04,303 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7407.350939 2021-02-19 04:25:04,483 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4723.300000 2021-02-19 04:25:04,625 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4103.300000 2021-02-19 04:25:05,078 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:05,209 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7072.700000 2021-02-19 04:25:05,316 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2072.800000 2021-02-19 04:25:05,354 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2482.200000 2021-02-19 04:25:05,381 | infra | INFO | pool-2-thread-22 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' completed 2021-02-19 04:25:05,381 | infra | INFO | pool-2-thread-22 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:25:05,477 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3081.900000 2021-02-19 04:25:05,621 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:05,624 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1698.807950 2021-02-19 04:25:05,928 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7407.350939 2021-02-19 04:25:06,086 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4723.300000 2021-02-19 04:25:06,230 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4372.700000 2021-02-19 04:25:06,676 | infra | INFO | pool-2-thread-63 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:25:06,676 | infra | INFO | pool-2-thread-63 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:25:06,680 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:06,831 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6921.000000 2021-02-19 04:25:06,937 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1505.900000 2021-02-19 04:25:06,980 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2957.700000 2021-02-19 04:25:07,092 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3081.900000 2021-02-19 04:25:07,236 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:07,253 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1698.807950 2021-02-19 04:25:07,543 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7407.350939 2021-02-19 04:25:07,697 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4741.300000 2021-02-19 04:25:07,842 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4372.700000 2021-02-19 04:25:08,321 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:08,473 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6921.000000 2021-02-19 04:25:08,552 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1505.900000 2021-02-19 04:25:08,601 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2957.700000 2021-02-19 04:25:08,717 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3081.900000 2021-02-19 04:25:08,838 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 13.79 % 2021-02-19 04:25:08,838 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 13.7904338135 2021-02-19 04:25:08,855 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:08,905 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1698.807950 2021-02-19 04:25:09,150 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7407.350939 2021-02-19 04:25:09,305 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4741.300000 2021-02-19 04:25:09,464 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4372.700000 2021-02-19 04:25:09,937 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:10,160 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6921.000000 2021-02-19 04:25:10,226 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1505.900000 2021-02-19 04:25:10,247 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2957.700000 2021-02-19 04:25:10,351 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3081.900000 2021-02-19 04:25:10,484 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:10,532 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1507.207950 2021-02-19 04:25:10,766 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7469.650939 2021-02-19 04:25:10,918 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4741.300000 2021-02-19 04:25:11,102 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4372.700000 2021-02-19 04:25:11,559 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:11,782 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6921.000000 2021-02-19 04:25:11,845 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1505.900000 2021-02-19 04:25:11,875 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2957.700000 2021-02-19 04:25:11,986 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3081.900000 2021-02-19 04:25:12,099 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:12,154 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1507.207950 2021-02-19 04:25:12,323 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 14.28 % 2021-02-19 04:25:12,338 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:25:12,338 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:25:12,375 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7460.050939 2021-02-19 04:25:12,532 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4909.300000 2021-02-19 04:25:12,719 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4402.900000 2021-02-19 04:25:13,160 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:13,428 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6615.300000 2021-02-19 04:25:13,515 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1673.900000 2021-02-19 04:25:13,519 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3371.400000 2021-02-19 04:25:13,635 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3778.500000 2021-02-19 04:25:13,716 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:13,765 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1006.707950 2021-02-19 04:25:13,880 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 14.50 % 2021-02-19 04:25:13,880 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 14.495428814 2021-02-19 04:25:13,983 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7460.050939 2021-02-19 04:25:14,153 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4909.300000 2021-02-19 04:25:14,341 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4402.900000 2021-02-19 04:25:14,766 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:15,042 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6615.300000 2021-02-19 04:25:15,151 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3371.400000 2021-02-19 04:25:15,170 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1673.900000 2021-02-19 04:25:15,263 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3778.500000 2021-02-19 04:25:15,334 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:15,398 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 967.144573 2021-02-19 04:25:15,598 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7496.492791 2021-02-19 04:25:15,782 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4970.792000 2021-02-19 04:25:15,983 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4402.900000 2021-02-19 04:25:16,404 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:16,671 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6310.944073 2021-02-19 04:25:16,792 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3640.353950 2021-02-19 04:25:16,865 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2277.032578 2021-02-19 04:25:16,936 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4903.838180 2021-02-19 04:25:16,967 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:17,019 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 530.194389 2021-02-19 04:25:17,213 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7496.492791 2021-02-19 04:25:17,384 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4970.792000 2021-02-19 04:25:17,591 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4334.020963 2021-02-19 04:25:18,003 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:18,279 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6310.944073 2021-02-19 04:25:18,427 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3640.353950 2021-02-19 04:25:18,502 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2277.032578 2021-02-19 04:25:18,569 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4903.838180 2021-02-19 04:25:18,594 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:18,640 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 530.194389 2021-02-19 04:25:18,823 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7496.492791 2021-02-19 04:25:18,921 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 15.09 % 2021-02-19 04:25:18,923 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 15.0861550631 2021-02-19 04:25:19,000 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4970.792000 2021-02-19 04:25:19,190 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4334.020963 2021-02-19 04:25:19,601 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:19,937 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6310.944073 2021-02-19 04:25:20,115 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3640.353950 2021-02-19 04:25:20,165 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2277.032578 2021-02-19 04:25:20,196 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4903.838180 2021-02-19 04:25:20,237 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:20,298 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 502.494389 2021-02-19 04:25:20,444 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7476.392791 2021-02-19 04:25:20,624 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4970.792000 2021-02-19 04:25:20,835 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4334.020963 2021-02-19 04:25:21,200 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:21,562 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6310.944073 2021-02-19 04:25:21,736 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3640.353950 2021-02-19 04:25:21,785 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2277.032578 2021-02-19 04:25:21,859 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4903.838180 2021-02-19 04:25:21,890 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:21,944 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 502.494389 2021-02-19 04:25:22,084 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7476.392791 2021-02-19 04:25:22,234 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4970.792000 2021-02-19 04:25:22,355 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 15.58 % 2021-02-19 04:25:22,367 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:25:22,367 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:25:22,453 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4214.120963 2021-02-19 04:25:22,806 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:23,176 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6009.944073 2021-02-19 04:25:23,369 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3652.053950 2021-02-19 04:25:23,408 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2886.932578 2021-02-19 04:25:23,494 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5539.438180 2021-02-19 04:25:23,552 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:23,585 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 429.194389 2021-02-19 04:25:23,714 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7522.692791 2021-02-19 04:25:23,855 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4764.592000 2021-02-19 04:25:23,990 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 15.73 % 2021-02-19 04:25:23,990 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 15.7257380754 2021-02-19 04:25:24,069 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4214.120963 2021-02-19 04:25:24,424 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:24,811 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6009.944073 2021-02-19 04:25:24,987 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3652.053950 2021-02-19 04:25:25,032 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2886.932578 2021-02-19 04:25:25,108 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5539.438180 2021-02-19 04:25:25,177 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:25,207 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 432.249815 2021-02-19 04:25:25,338 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7564.100000 2021-02-19 04:25:25,476 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4545.350929 2021-02-19 04:25:25,690 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4197.327444 2021-02-19 04:25:26,040 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:26,431 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5706.510094 2021-02-19 04:25:26,681 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3729.470758 2021-02-19 04:25:26,719 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3207.438117 2021-02-19 04:25:26,788 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5746.078253 2021-02-19 04:25:26,832 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:26,858 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 372.920128 2021-02-19 04:25:26,966 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7564.100000 2021-02-19 04:25:27,076 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4545.350929 2021-02-19 04:25:27,302 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4197.327444 2021-02-19 04:25:27,650 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:28,046 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5706.510094 2021-02-19 04:25:28,313 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3729.470758 2021-02-19 04:25:28,365 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3207.438117 2021-02-19 04:25:28,433 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5746.078253 2021-02-19 04:25:28,470 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:28,519 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 372.920128 2021-02-19 04:25:28,598 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7564.100000 2021-02-19 04:25:28,703 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4545.350929 2021-02-19 04:25:28,957 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4197.327444 2021-02-19 04:25:29,039 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 16.26 % 2021-02-19 04:25:29,039 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 16.2624576155 2021-02-19 04:25:29,256 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:29,648 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5706.510094 2021-02-19 04:25:29,961 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3729.470758 2021-02-19 04:25:30,036 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3207.438117 2021-02-19 04:25:30,095 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:30,104 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5746.078253 2021-02-19 04:25:30,167 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 372.920128 2021-02-19 04:25:30,226 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7565.000000 2021-02-19 04:25:30,342 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4545.350929 2021-02-19 04:25:30,578 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4197.327444 2021-02-19 04:25:30,867 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:31,262 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5706.510094 2021-02-19 04:25:31,621 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3729.470758 2021-02-19 04:25:31,721 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3207.438117 2021-02-19 04:25:31,742 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5746.078253 2021-02-19 04:25:31,743 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:31,825 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 413.520128 2021-02-19 04:25:31,875 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7565.000000 2021-02-19 04:25:31,986 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4545.350929 2021-02-19 04:25:32,188 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4197.327444 2021-02-19 04:25:32,384 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 16.49 % 2021-02-19 04:25:32,398 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:25:32,398 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:25:32,483 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:32,875 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5771.610094 2021-02-19 04:25:33,240 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3725.870758 2021-02-19 04:25:33,371 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3355.838117 2021-02-19 04:25:33,387 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5836.078253 2021-02-19 04:25:33,388 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:33,515 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7452.700000 2021-02-19 04:25:33,542 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 650.420128 2021-02-19 04:25:33,648 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4452.850929 2021-02-19 04:25:33,790 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4251.527444 2021-02-19 04:25:34,088 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:34,101 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 16.60 % 2021-02-19 04:25:34,101 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 16.6044549578 2021-02-19 04:25:34,486 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5771.610094 2021-02-19 04:25:34,859 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3725.870758 2021-02-19 04:25:35,002 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3355.838117 2021-02-19 04:25:35,032 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5836.078253 2021-02-19 04:25:35,036 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:35,154 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7452.700000 2021-02-19 04:25:35,200 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 845.520128 2021-02-19 04:25:35,265 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4452.850929 2021-02-19 04:25:35,397 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4251.527444 2021-02-19 04:25:35,697 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:36,111 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5771.610094 2021-02-19 04:25:36,540 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3650.833363 2021-02-19 04:25:36,621 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3518.755505 2021-02-19 04:25:36,655 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:36,690 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5993.952159 2021-02-19 04:25:36,845 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7281.800000 2021-02-19 04:25:36,861 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1236.996734 2021-02-19 04:25:36,875 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4372.118665 2021-02-19 04:25:37,007 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4180.795371 2021-02-19 04:25:37,311 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:37,717 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6102.980974 2021-02-19 04:25:38,153 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3650.833363 2021-02-19 04:25:38,246 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3518.755505 2021-02-19 04:25:38,286 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:38,357 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5993.952159 2021-02-19 04:25:38,466 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7281.800000 2021-02-19 04:25:38,493 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4372.118665 2021-02-19 04:25:38,552 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1236.996734 2021-02-19 04:25:38,634 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4180.795371 2021-02-19 04:25:38,907 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:39,142 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 16.96 % 2021-02-19 04:25:39,142 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 16.958666491 2021-02-19 04:25:39,354 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6102.980974 2021-02-19 04:25:39,766 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3650.833363 2021-02-19 04:25:39,878 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3518.755505 2021-02-19 04:25:39,930 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:40,022 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5993.952159 2021-02-19 04:25:40,105 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7281.800000 2021-02-19 04:25:40,131 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4372.118665 2021-02-19 04:25:40,243 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1671.496734 2021-02-19 04:25:40,266 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4180.795371 2021-02-19 04:25:40,512 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:40,982 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6102.980974 2021-02-19 04:25:41,388 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3650.833363 2021-02-19 04:25:41,496 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3518.755505 2021-02-19 04:25:41,575 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:41,645 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5993.952159 2021-02-19 04:25:41,746 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7169.400000 2021-02-19 04:25:41,773 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4372.118665 2021-02-19 04:25:41,895 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4180.795371 2021-02-19 04:25:41,917 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1671.496734 2021-02-19 04:25:42,135 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:42,414 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 17.18 % 2021-02-19 04:25:42,426 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:25:42,427 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:25:42,601 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6834.480974 2021-02-19 04:25:43,023 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3677.033363 2021-02-19 04:25:43,115 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3385.955505 2021-02-19 04:25:43,197 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:43,266 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5909.352159 2021-02-19 04:25:43,362 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7224.800000 2021-02-19 04:25:43,398 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4265.018665 2021-02-19 04:25:43,543 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4068.495371 2021-02-19 04:25:43,586 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2066.596734 2021-02-19 04:25:43,743 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:44,184 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 17.33 % 2021-02-19 04:25:44,184 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 17.325092215 2021-02-19 04:25:44,210 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6834.480974 2021-02-19 04:25:44,645 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3677.033363 2021-02-19 04:25:44,746 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3385.955505 2021-02-19 04:25:44,858 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:44,890 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5909.352159 2021-02-19 04:25:45,009 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4265.018665 2021-02-19 04:25:45,028 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7224.800000 2021-02-19 04:25:45,204 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4068.495371 2021-02-19 04:25:45,224 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2228.096734 2021-02-19 04:25:45,361 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:45,842 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7414.263402 2021-02-19 04:25:46,266 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3738.978613 2021-02-19 04:25:46,375 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3214.243394 2021-02-19 04:25:46,516 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5660.332940 2021-02-19 04:25:46,523 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:46,660 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7347.700000 2021-02-19 04:25:46,661 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4179.450710 2021-02-19 04:25:46,835 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4019.299400 2021-02-19 04:25:46,859 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2235.980512 2021-02-19 04:25:46,993 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:47,467 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7414.263402 2021-02-19 04:25:47,871 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3738.978613 2021-02-19 04:25:48,003 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3214.243394 2021-02-19 04:25:48,161 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:48,177 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5660.332940 2021-02-19 04:25:48,292 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7347.700000 2021-02-19 04:25:48,299 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4179.450710 2021-02-19 04:25:48,467 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4019.299400 2021-02-19 04:25:48,484 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2235.980512 2021-02-19 04:25:48,614 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:49,078 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7414.263402 2021-02-19 04:25:49,234 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 17.65 % 2021-02-19 04:25:49,236 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 17.6548753666 2021-02-19 04:25:49,496 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3738.978613 2021-02-19 04:25:49,641 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3214.243394 2021-02-19 04:25:49,798 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:49,812 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5660.332940 2021-02-19 04:25:49,905 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7347.700000 2021-02-19 04:25:49,914 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4179.450710 2021-02-19 04:25:50,131 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2235.980512 2021-02-19 04:25:50,145 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4019.299400 2021-02-19 04:25:50,272 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:50,680 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7414.263402 2021-02-19 04:25:51,112 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3738.978613 2021-02-19 04:25:51,276 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3214.243394 2021-02-19 04:25:51,444 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5660.332940 2021-02-19 04:25:51,454 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:51,555 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4179.450710 2021-02-19 04:25:51,572 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7449.700000 2021-02-19 04:25:51,775 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2200.880512 2021-02-19 04:25:51,799 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4019.299400 2021-02-19 04:25:51,885 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:52,289 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7342.663402 2021-02-19 04:25:52,441 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 17.86 % 2021-02-19 04:25:52,454 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:25:52,454 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:25:52,726 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3687.478613 2021-02-19 04:25:52,910 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3125.943394 2021-02-19 04:25:53,071 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5682.532940 2021-02-19 04:25:53,078 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:53,213 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7454.800000 2021-02-19 04:25:53,224 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4142.750710 2021-02-19 04:25:53,420 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2169.280512 2021-02-19 04:25:53,427 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4046.199400 2021-02-19 04:25:53,500 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:53,890 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7342.663402 2021-02-19 04:25:54,276 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 18.02 % 2021-02-19 04:25:54,276 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 18.0213010905 2021-02-19 04:25:54,381 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3687.478613 2021-02-19 04:25:54,529 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3125.943394 2021-02-19 04:25:54,730 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5682.532940 2021-02-19 04:25:54,742 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:54,838 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4142.750710 2021-02-19 04:25:54,862 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7432.300000 2021-02-19 04:25:55,052 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2169.280512 2021-02-19 04:25:55,061 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4046.199400 2021-02-19 04:25:55,101 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:55,509 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7242.476486 2021-02-19 04:25:56,013 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3687.478613 2021-02-19 04:25:56,154 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3125.943394 2021-02-19 04:25:56,361 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6031.976726 2021-02-19 04:25:56,385 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:56,492 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4112.331039 2021-02-19 04:25:56,525 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7432.300000 2021-02-19 04:25:56,711 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:56,740 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4164.171383 2021-02-19 04:25:56,769 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2033.634861 2021-02-19 04:25:57,128 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7242.476486 2021-02-19 04:25:57,641 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3655.302081 2021-02-19 04:25:57,770 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3064.419692 2021-02-19 04:25:58,048 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6031.976726 2021-02-19 04:25:58,053 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:58,154 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7432.300000 2021-02-19 04:25:58,154 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4112.331039 2021-02-19 04:25:58,342 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:25:58,377 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4164.171383 2021-02-19 04:25:58,424 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2033.634861 2021-02-19 04:25:58,743 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7242.476486 2021-02-19 04:25:59,278 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3655.302081 2021-02-19 04:25:59,329 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 18.44 % 2021-02-19 04:25:59,331 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 18.4365835777 2021-02-19 04:25:59,407 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3064.419692 2021-02-19 04:25:59,676 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6031.976726 2021-02-19 04:25:59,697 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:25:59,801 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7390.700000 2021-02-19 04:25:59,809 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4112.331039 2021-02-19 04:25:59,971 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:00,045 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4164.171383 2021-02-19 04:26:00,086 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2033.634861 2021-02-19 04:26:00,378 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7242.476486 2021-02-19 04:26:00,887 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3655.302081 2021-02-19 04:26:01,028 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3064.419692 2021-02-19 04:26:01,342 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6031.976726 2021-02-19 04:26:01,359 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:01,440 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7390.700000 2021-02-19 04:26:01,447 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4112.331039 2021-02-19 04:26:01,621 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:01,686 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4164.171383 2021-02-19 04:26:01,736 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2079.134861 2021-02-19 04:26:01,982 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7242.476486 2021-02-19 04:26:02,471 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 18.55 % 2021-02-19 04:26:02,483 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:26:02,483 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:26:02,494 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3623.902081 2021-02-19 04:26:02,635 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3090.219692 2021-02-19 04:26:03,006 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6543.976726 2021-02-19 04:26:03,053 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:03,069 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7386.100000 2021-02-19 04:26:03,079 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3996.631039 2021-02-19 04:26:03,242 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:03,312 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4156.971383 2021-02-19 04:26:03,368 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2025.134861 2021-02-19 04:26:03,592 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7164.276486 2021-02-19 04:26:04,092 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3623.902081 2021-02-19 04:26:04,256 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3090.219692 2021-02-19 04:26:04,397 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 18.71 % 2021-02-19 04:26:04,397 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 18.7052957753 2021-02-19 04:26:04,615 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6543.976726 2021-02-19 04:26:04,700 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7426.100000 2021-02-19 04:26:04,711 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:04,755 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3996.631039 2021-02-19 04:26:04,848 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:04,973 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4156.971383 2021-02-19 04:26:05,009 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2025.134861 2021-02-19 04:26:05,226 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7164.276486 2021-02-19 04:26:05,696 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3538.500000 2021-02-19 04:26:05,882 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3187.900000 2021-02-19 04:26:06,252 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6790.900000 2021-02-19 04:26:06,335 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7426.100000 2021-02-19 04:26:06,357 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:06,401 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3883.300000 2021-02-19 04:26:06,480 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:06,612 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4013.300000 2021-02-19 04:26:06,654 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1935.000000 2021-02-19 04:26:06,874 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6976.600000 2021-02-19 04:26:07,323 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3538.500000 2021-02-19 04:26:07,502 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3187.900000 2021-02-19 04:26:07,871 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6790.900000 2021-02-19 04:26:07,948 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7426.100000 2021-02-19 04:26:07,961 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:08,039 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3883.300000 2021-02-19 04:26:08,092 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:08,263 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4013.300000 2021-02-19 04:26:08,286 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1935.000000 2021-02-19 04:26:08,486 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6976.600000 2021-02-19 04:26:08,926 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3538.500000 2021-02-19 04:26:09,114 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3187.900000 2021-02-19 04:26:09,437 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 19.04 % 2021-02-19 04:26:09,437 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 19.0350789269 2021-02-19 04:26:09,528 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6790.900000 2021-02-19 04:26:09,559 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7415.700000 2021-02-19 04:26:09,622 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:09,697 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3883.300000 2021-02-19 04:26:09,723 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:09,890 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4013.300000 2021-02-19 04:26:09,908 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2014.100000 2021-02-19 04:26:10,108 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6976.600000 2021-02-19 04:26:10,552 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3538.500000 2021-02-19 04:26:10,733 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3187.900000 2021-02-19 04:26:11,181 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6790.900000 2021-02-19 04:26:11,207 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7415.700000 2021-02-19 04:26:11,249 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:11,364 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3883.300000 2021-02-19 04:26:11,371 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:11,528 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4013.300000 2021-02-19 04:26:11,568 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2014.100000 2021-02-19 04:26:11,732 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6976.600000 2021-02-19 04:26:12,165 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3538.500000 2021-02-19 04:26:12,338 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3429.900000 2021-02-19 04:26:12,506 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 19.27 % 2021-02-19 04:26:12,519 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:26:12,519 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:26:12,844 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6735.000000 2021-02-19 04:26:12,848 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7401.500000 2021-02-19 04:26:12,892 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:13,023 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3954.700000 2021-02-19 04:26:13,032 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:13,145 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3982.000000 2021-02-19 04:26:13,201 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1984.600000 2021-02-19 04:26:13,375 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6641.100000 2021-02-19 04:26:13,805 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3361.900000 2021-02-19 04:26:13,976 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3429.900000 2021-02-19 04:26:14,486 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7315.100000 2021-02-19 04:26:14,502 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6735.000000 2021-02-19 04:26:14,526 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:14,540 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 19.39 % 2021-02-19 04:26:14,542 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 19.38929046 2021-02-19 04:26:14,653 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3954.700000 2021-02-19 04:26:14,668 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:14,763 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3982.000000 2021-02-19 04:26:14,826 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2089.600000 2021-02-19 04:26:14,996 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6641.100000 2021-02-19 04:26:15,414 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3361.900000 2021-02-19 04:26:15,589 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3534.600000 2021-02-19 04:26:16,125 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7315.100000 2021-02-19 04:26:16,155 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6735.000000 2021-02-19 04:26:16,177 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:16,299 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:16,312 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3991.200000 2021-02-19 04:26:16,401 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4017.200000 2021-02-19 04:26:16,459 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2000.200000 2021-02-19 04:26:16,611 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6404.000000 2021-02-19 04:26:17,026 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3167.500000 2021-02-19 04:26:17,191 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3534.600000 2021-02-19 04:26:17,759 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7315.100000 2021-02-19 04:26:17,799 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6674.600000 2021-02-19 04:26:17,818 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:17,923 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:17,944 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3991.200000 2021-02-19 04:26:18,051 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4017.200000 2021-02-19 04:26:18,108 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2000.200000 2021-02-19 04:26:18,259 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6404.000000 2021-02-19 04:26:18,625 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3167.500000 2021-02-19 04:26:18,816 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3534.600000 2021-02-19 04:26:19,387 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7312.900000 2021-02-19 04:26:19,438 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:19,444 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6674.600000 2021-02-19 04:26:19,565 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:19,582 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3991.200000 2021-02-19 04:26:19,595 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 19.74 % 2021-02-19 04:26:19,595 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 19.7435019932 2021-02-19 04:26:19,697 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4017.200000 2021-02-19 04:26:19,752 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2106.300000 2021-02-19 04:26:19,882 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6404.000000 2021-02-19 04:26:20,243 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3167.500000 2021-02-19 04:26:20,430 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3534.600000 2021-02-19 04:26:21,029 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7312.900000 2021-02-19 04:26:21,072 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:21,096 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6674.600000 2021-02-19 04:26:21,181 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:21,209 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3991.200000 2021-02-19 04:26:21,354 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4017.200000 2021-02-19 04:26:21,395 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2106.300000 2021-02-19 04:26:21,512 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6404.000000 2021-02-19 04:26:21,848 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3167.500000 2021-02-19 04:26:22,065 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3534.600000 2021-02-19 04:26:22,530 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 19.85 % 2021-02-19 04:26:22,543 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:26:22,543 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:26:22,683 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7254.700000 2021-02-19 04:26:22,700 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:22,742 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6748.800000 2021-02-19 04:26:22,789 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:22,845 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3962.700000 2021-02-19 04:26:22,982 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3980.200000 2021-02-19 04:26:23,046 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2222.800000 2021-02-19 04:26:23,161 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6791.100000 2021-02-19 04:26:23,467 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3226.700000 2021-02-19 04:26:23,684 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3474.800000 2021-02-19 04:26:24,335 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:24,355 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7233.500000 2021-02-19 04:26:24,400 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6748.800000 2021-02-19 04:26:24,460 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:24,474 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3962.700000 2021-02-19 04:26:24,592 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3980.200000 2021-02-19 04:26:24,638 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 20.00 % 2021-02-19 04:26:24,638 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 20.0 2021-02-19 04:26:24,678 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2312.700000 2021-02-19 04:26:24,765 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6791.100000 2021-02-19 04:26:25,055 | infra | INFO | pool-2-thread-23 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:26:25,055 | infra | INFO | pool-2-thread-23 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:26:25,101 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3226.700000 2021-02-19 04:26:25,309 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3474.800000 2021-02-19 04:26:25,964 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:25,983 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7233.500000 2021-02-19 04:26:26,042 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6748.800000 2021-02-19 04:26:26,095 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:26,144 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3962.700000 2021-02-19 04:26:26,236 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3989.900000 2021-02-19 04:26:26,332 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2204.900000 2021-02-19 04:26:26,395 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7243.500000 2021-02-19 04:26:26,729 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3435.400000 2021-02-19 04:26:26,934 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3543.700000 2021-02-19 04:26:27,576 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:27,612 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7233.500000 2021-02-19 04:26:27,687 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6883.200000 2021-02-19 04:26:27,746 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:27,778 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4000.000000 2021-02-19 04:26:27,882 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3989.900000 2021-02-19 04:26:27,954 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2204.900000 2021-02-19 04:26:28,023 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7243.500000 2021-02-19 04:26:28,365 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3435.400000 2021-02-19 04:26:28,565 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3543.700000 2021-02-19 04:26:29,180 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:29,240 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7233.500000 2021-02-19 04:26:29,308 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6883.200000 2021-02-19 04:26:29,380 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:29,423 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4000.000000 2021-02-19 04:26:29,575 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3989.900000 2021-02-19 04:26:29,608 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2296.800000 2021-02-19 04:26:29,667 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7243.500000 2021-02-19 04:26:29,691 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 20.00 % 2021-02-19 04:26:29,691 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 20.0 2021-02-19 04:26:29,999 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3435.400000 2021-02-19 04:26:30,171 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3543.700000 2021-02-19 04:26:30,786 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:30,871 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7212.600000 2021-02-19 04:26:30,937 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6883.200000 2021-02-19 04:26:31,023 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:31,048 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4000.000000 2021-02-19 04:26:31,207 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3989.900000 2021-02-19 04:26:31,262 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2296.800000 2021-02-19 04:26:31,308 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7243.500000 2021-02-19 04:26:31,624 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3435.400000 2021-02-19 04:26:31,779 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3543.700000 2021-02-19 04:26:32,403 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:32,513 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7292.800000 2021-02-19 04:26:32,566 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 20.00 % 2021-02-19 04:26:32,582 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:26:32,582 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:26:32,589 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6776.800000 2021-02-19 04:26:32,642 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:32,690 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3988.700000 2021-02-19 04:26:32,877 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3990.100000 2021-02-19 04:26:32,940 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7046.300000 2021-02-19 04:26:32,953 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2430.800000 2021-02-19 04:26:33,256 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3502.100000 2021-02-19 04:26:33,387 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4409.000000 2021-02-19 04:26:33,990 | infra | INFO | pool-2-thread-60 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' completed 2021-02-19 04:26:33,990 | infra | INFO | pool-2-thread-60 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:26:34,016 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:34,164 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7292.800000 2021-02-19 04:26:34,220 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6776.800000 2021-02-19 04:26:34,341 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:34,371 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3988.700000 2021-02-19 04:26:34,552 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3990.100000 2021-02-19 04:26:34,598 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2695.000000 2021-02-19 04:26:34,598 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7046.300000 2021-02-19 04:26:34,825 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 20.00 % 2021-02-19 04:26:34,825 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 20.0 2021-02-19 04:26:34,900 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3502.100000 2021-02-19 04:26:35,036 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4409.000000 2021-02-19 04:26:35,663 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:35,836 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7409.500000 2021-02-19 04:26:35,881 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6627.600000 2021-02-19 04:26:35,963 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:36,055 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3988.700000 2021-02-19 04:26:36,194 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3990.100000 2021-02-19 04:26:36,223 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6699.800000 2021-02-19 04:26:36,240 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2695.000000 2021-02-19 04:26:36,535 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3406.100000 2021-02-19 04:26:36,657 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5618.800000 2021-02-19 04:26:37,280 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:37,474 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7409.500000 2021-02-19 04:26:37,532 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6627.600000 2021-02-19 04:26:37,586 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:37,686 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3943.300000 2021-02-19 04:26:37,819 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3903.600000 2021-02-19 04:26:37,880 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6699.800000 2021-02-19 04:26:37,898 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2695.000000 2021-02-19 04:26:38,151 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3406.100000 2021-02-19 04:26:38,298 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5618.800000 2021-02-19 04:26:38,924 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:39,164 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6627.600000 2021-02-19 04:26:39,191 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7409.500000 2021-02-19 04:26:39,197 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:39,325 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3943.300000 2021-02-19 04:26:39,440 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3903.600000 2021-02-19 04:26:39,520 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6699.800000 2021-02-19 04:26:39,555 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2815.300000 2021-02-19 04:26:39,789 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3406.100000 2021-02-19 04:26:39,878 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 20.82 % 2021-02-19 04:26:39,878 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 20.8226289746 2021-02-19 04:26:39,938 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5618.800000 2021-02-19 04:26:40,585 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:40,815 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6627.600000 2021-02-19 04:26:40,828 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7429.400000 2021-02-19 04:26:40,848 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:41,026 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3943.300000 2021-02-19 04:26:41,107 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3903.600000 2021-02-19 04:26:41,154 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6699.800000 2021-02-19 04:26:41,194 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2815.300000 2021-02-19 04:26:41,428 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3406.100000 2021-02-19 04:26:41,553 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5618.800000 2021-02-19 04:26:42,200 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:42,470 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7348.700000 2021-02-19 04:26:42,482 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 911.700000 2021-02-19 04:26:42,489 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6254.400000 2021-02-19 04:26:42,582 | test | INFO | MainThread | [rest_client:rebalance_reached:108] Rebalance reached >20.0% in 401.085999966 seconds 2021-02-19 04:26:42,595 | test | DEBUG | MainThread | [rest_client:diag_eval:1363] /diag/eval status on 172.23.110.64:8091: 1 content: true command: ns_orchestrator:needs_rebalance() 2021-02-19 04:26:42,595 | test | INFO | MainThread | [Magma:abort_rebalance:912] Abort rebalance 2021-02-19 04:26:42,671 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3609.300000 2021-02-19 04:26:42,730 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3708.800000 2021-02-19 04:26:42,795 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6260.200000 2021-02-19 04:26:42,825 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2918.100000 2021-02-19 04:26:43,033 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3212.100000 2021-02-19 04:26:43,059 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L914 2021-02-19 04:26:43,059 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 60 seconds. Reason: Sleep after error introduction 2021-02-19 04:26:43,174 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6029.400000 2021-02-19 04:26:43,773 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:44,071 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7348.700000 2021-02-19 04:26:44,085 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6254.400000 2021-02-19 04:26:44,111 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 911.700000 2021-02-19 04:26:44,315 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3609.300000 2021-02-19 04:26:44,345 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3708.800000 2021-02-19 04:26:44,414 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2946.600000 2021-02-19 04:26:44,434 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6260.200000 2021-02-19 04:26:44,628 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3212.100000 2021-02-19 04:26:44,766 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6029.400000 2021-02-19 04:26:45,099 | test | DEBUG | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 21.39 % 2021-02-19 04:26:45,099 | test | INFO | pool-1-thread-29 | [task:check:330] Rebalance - status: running, progress: 21.3892988369 2021-02-19 04:26:45,381 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:45,742 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2224.900000 2021-02-19 04:26:45,967 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3063.200000 2021-02-19 04:26:45,989 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3708.800000 2021-02-19 04:26:46,023 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2946.600000 2021-02-19 04:26:46,038 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5767.000000 2021-02-19 04:26:46,042 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6260.200000 2021-02-19 04:26:46,046 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7196.800000 2021-02-19 04:26:46,270 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3078.300000 2021-02-19 04:26:46,398 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5922.800000 2021-02-19 04:26:46,974 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:47,369 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2224.900000 2021-02-19 04:26:47,575 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3063.200000 2021-02-19 04:26:47,601 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3438.600000 2021-02-19 04:26:47,641 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5767.000000 2021-02-19 04:26:47,673 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2946.600000 2021-02-19 04:26:47,711 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5767.000000 2021-02-19 04:26:47,756 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7196.800000 2021-02-19 04:26:47,874 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3078.300000 2021-02-19 04:26:48,005 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5922.800000 2021-02-19 04:26:48,559 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:48,980 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2224.900000 2021-02-19 04:26:49,239 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3063.200000 2021-02-19 04:26:49,247 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5767.000000 2021-02-19 04:26:49,259 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3438.600000 2021-02-19 04:26:49,273 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2946.600000 2021-02-19 04:26:49,309 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5767.000000 2021-02-19 04:26:49,349 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7196.800000 2021-02-19 04:26:49,479 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3078.300000 2021-02-19 04:26:49,595 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5922.800000 2021-02-19 04:26:50,132 | test | ERROR | pool-1-thread-29 | [rest_client:_rebalance_status_and_progress:1494] {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 04:26:50,138 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:50,161 | test | INFO | pool-1-thread-29 | [rest_client:print_UI_logs:2599] Latest logs from UI on 172.23.110.64: 2021-02-19 04:26:50,161 | test | ERROR | pool-1-thread-29 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_orchestrator', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613737604050L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:26:44.050Z', u'text': u'Rebalance exited with reason {mover_crashed,\n {unexpected_exit,\n {\'EXIT\',<0.26370.53>,\n {{{badmatch,{error,closed}},\n [{mc_client_binary,cmd_vocal_recv,5,\n [{file,"src/mc_client_binary.erl"},\n {line,158}]},\n {mc_client_binary,\n wait_for_seqno_persistence,3,\n [{file,"src/mc_client_binary.erl"},\n {line,763}]},\n {ns_memcached,\n \'-wait_for_seqno_persistence/3-fun-0-\',3,\n [{file,"src/ns_memcached.erl"},\n {line,1392}]},\n {ns_memcached,\n \'-perform_very_long_call/3-fun-0-\',2,\n [{file,"src/ns_memcached.erl"},\n {line,324}]},\n {ns_memcached_sockets_pool,\n \'-executing_on_socket/3-fun-0-\',3,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,92}]},\n {async,\'-async_init/4-fun-1-\',3,\n [{file,"src/async.erl"},{line,197}]}]},\n {gen_server,call,\n [{\'janitor_agent-GleamBookUsers2\',\n \'ns_1@172.23.110.64\'},\n {if_rebalance,<0.16559.53>,\n {update_vbucket_state,962,active,paused,\n undefined,\n [[\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.65\']]}},\n infinity]}}}}}.\nRebalance Operation Id = 9f1162d66519c1dac3e6edb4d876eb75'} 2021-02-19 04:26:50,163 | test | ERROR | pool-1-thread-29 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_log', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613737604018L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:26:44.018Z', u'text': u"Service 'memcached' exited with status 137. Restarting. Messages:\nWARNING: Logging before InitGoogleLogging() is written to STDERR\nW0219 04:14:09.453732 44482 HazptrDomain.h:671] Using the default inline executor for asynchronous reclamation may be susceptible to deadlock if the current thread happens to hold a resource needed by the deleter of a reclaimable object"} 2021-02-19 04:26:50,163 | test | ERROR | pool-1-thread-29 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613737604016L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:26:44.016Z', u'text': u'Worker <0.26277.53> (for action {move,{962,\n [\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.65\'],\n [\'ns_1@172.23.110.69\',\n \'ns_1@172.23.110.64\'],\n []}}) exited with reason {unexpected_exit,\n {\'EXIT\',\n <0.26370.53>,\n {{{badmatch,\n {error,\n closed}},\n [{mc_client_binary,\n cmd_vocal_recv,\n 5,\n [{file,\n "src/mc_client_binary.erl"},\n {line,\n 158}]},\n {mc_client_binary,\n wait_for_seqno_persistence,\n 3,\n [{file,\n "src/mc_client_binary.erl"},\n {line,\n 763}]},\n {ns_memcached,\n \'-wait_for_seqno_persistence/3-fun-0-\',\n 3,\n [{file,\n "src/ns_memcached.erl"},\n {line,\n 1392}]},\n {ns_memcached,\n \'-perform_very_long_call/3-fun-0-\',\n 2,\n [{file,\n "src/ns_memcached.erl"},\n {line,\n 324}]},\n {ns_memcached_sockets_pool,\n \'-executing_on_socket/3-fun-0-\',\n 3,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,\n 92}]},\n {async,\n \'-async_init/4-fun-1-\',\n 3,\n [{file,\n "src/async.erl"},\n {line,\n 197}]}]},\n {gen_server,\n call,\n [{\'janitor_agent-GleamBookUsers2\',\n \'ns_1@172.23.110.64\'},\n {if_rebalance,\n <0.16559.53>,\n {update_vbucket_state,\n 962,\n active,\n paused,\n undefined,\n [[\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.65\']]}},\n infinity]}}}}'} 2021-02-19 04:26:50,164 | test | ERROR | pool-1-thread-29 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613737604013L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:26:44.013Z', u'text': u"Control connection to memcached on 'ns_1@172.23.110.64' disconnected. Check logs for details."} 2021-02-19 04:26:50,164 | test | ERROR | pool-1-thread-29 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613737593921L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:26:33.921Z', u'text': u'Bucket "GleamBookUsers2" rebalance does not seem to be swap rebalance'} 2021-02-19 04:26:50,164 | test | ERROR | pool-1-thread-29 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613737593447L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:26:33.447Z', u'text': u'Bucket "GleamBookUsers2" loaded on node \'ns_1@172.23.110.69\' in 0 seconds.'} 2021-02-19 04:26:50,164 | test | ERROR | pool-1-thread-29 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.65', u'tstamp': 1613737593271L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:26:33.271Z', u'text': u'Shutting down bucket "GleamBookUsers1" on \'ns_1@172.23.110.65\' for deletion'} 2021-02-19 04:26:50,164 | test | ERROR | pool-1-thread-29 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_rebalancer', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613737592753L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:26:32.753Z', u'text': u'Started rebalancing bucket GleamBookUsers2'} 2021-02-19 04:26:50,164 | test | ERROR | pool-1-thread-29 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.68', u'tstamp': 1613737592657L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:26:32.657Z', u'text': u'Bucket "GleamBookUsers2" loaded on node \'ns_1@172.23.110.68\' in 0 seconds.'} 2021-02-19 04:26:50,164 | test | ERROR | pool-1-thread-29 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613737474128L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:24:34.128Z', u'text': u'Bucket "GleamBookUsers1" rebalance does not seem to be swap rebalance'} 2021-02-19 04:26:50,164 | test | ERROR | pool-1-thread-29 | [task:call:242] Rebalance Failed: {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 04:26:50,569 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2224.900000 2021-02-19 04:26:50,871 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3128.500000 2021-02-19 04:26:50,885 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5767.000000 2021-02-19 04:26:50,904 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3438.600000 2021-02-19 04:26:50,917 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2565.100000 2021-02-19 04:26:50,941 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5767.000000 2021-02-19 04:26:50,956 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6085.000000 2021-02-19 04:26:51,089 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3078.300000 2021-02-19 04:26:51,197 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5922.800000 2021-02-19 04:26:51,720 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:52,150 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2224.900000 2021-02-19 04:26:52,513 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1486.000000 2021-02-19 04:26:52,555 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2812.200000 2021-02-19 04:26:52,573 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1663.500000 2021-02-19 04:26:52,576 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2815.400000 2021-02-19 04:26:52,598 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1572.000000 2021-02-19 04:26:52,611 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3685.900000 2021-02-19 04:26:52,734 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1535.900000 2021-02-19 04:26:52,799 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2907.300000 2021-02-19 04:26:53,301 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:53,752 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1313.200000 2021-02-19 04:26:54,180 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2812.200000 2021-02-19 04:26:54,213 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1663.500000 2021-02-19 04:26:54,213 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1486.000000 2021-02-19 04:26:54,226 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1572.000000 2021-02-19 04:26:54,246 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2815.400000 2021-02-19 04:26:54,282 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3685.900000 2021-02-19 04:26:54,371 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1535.900000 2021-02-19 04:26:54,407 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2907.300000 2021-02-19 04:26:54,888 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:55,341 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1313.200000 2021-02-19 04:26:55,795 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:26:55,835 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 70.500000 2021-02-19 04:26:55,875 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:26:55,891 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 628.900000 2021-02-19 04:26:55,908 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1450.600000 2021-02-19 04:26:55,918 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:26:56,042 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1535.900000 2021-02-19 04:26:56,045 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2907.300000 2021-02-19 04:26:56,486 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:56,926 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:57,388 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:26:57,500 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 70.500000 2021-02-19 04:26:57,509 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 628.900000 2021-02-19 04:26:57,513 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:26:57,523 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1450.600000 2021-02-19 04:26:57,532 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:26:57,645 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:26:57,664 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:26:58,066 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:26:58,503 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:26:58,969 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:26:59,099 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 70.500000 2021-02-19 04:26:59,115 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:26:59,128 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 628.900000 2021-02-19 04:26:59,145 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:26:59,173 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1450.600000 2021-02-19 04:26:59,253 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:26:59,280 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:26:59,634 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:00,095 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:00,585 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:00,719 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5.200000 2021-02-19 04:27:00,739 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:27:00,756 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:27:00,779 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 569.000000 2021-02-19 04:27:00,796 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 126.800000 2021-02-19 04:27:00,849 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:00,897 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:27:01,203 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:01,665 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:02,190 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:02,358 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:27:02,375 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:27:02,397 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1235.400000 2021-02-19 04:27:02,440 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5.200000 2021-02-19 04:27:02,451 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:02,464 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 126.800000 2021-02-19 04:27:02,496 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:27:02,756 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:03,233 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:03,759 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:03,941 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:27:03,963 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:27:04,020 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1235.400000 2021-02-19 04:27:04,033 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5.200000 2021-02-19 04:27:04,088 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:04,102 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 126.800000 2021-02-19 04:27:04,117 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:27:04,336 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:04,828 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:05,349 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:05,515 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:27:05,533 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:27:05,624 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3169.800000 2021-02-19 04:27:05,632 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:27:05,707 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:05,730 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:05,743 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:27:05,914 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:06,392 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:06,986 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:07,118 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:27:07,134 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:27:07,229 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:27:07,244 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3169.800000 2021-02-19 04:27:07,309 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:07,332 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:27:07,348 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:07,479 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:07,960 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:08,601 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:08,719 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:27:08,730 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:27:08,848 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:27:08,855 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3169.800000 2021-02-19 04:27:08,924 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:08,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:08,947 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:27:09,032 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:09,519 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:10,187 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:10,345 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:27:10,371 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:27:10,430 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:27:10,496 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 5681.400000 2021-02-19 04:27:10,507 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:10,526 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:27:10,569 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:10,598 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:11,072 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:11,759 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:11,928 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:27:11,947 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:27:12,013 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:27:12,085 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:12,105 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:27:12,130 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 5681.400000 2021-02-19 04:27:12,177 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:12,193 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:12,630 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:13,331 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:13,517 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:27:13,529 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:27:13,596 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:27:13,683 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:13,694 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:27:13,717 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 8042.700000 2021-02-19 04:27:13,767 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:13,785 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:14,187 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:14,901 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:15,102 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:27:15,115 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:27:15,187 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:27:15,266 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:15,285 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:27:15,316 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 9081.000000 2021-02-19 04:27:15,344 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:15,365 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:15,743 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:16,484 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:16,688 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:27:16,707 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:27:16,770 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:27:16,855 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1.999200 2021-02-19 04:27:16,868 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:27:16,908 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 9081.000000 2021-02-19 04:27:16,924 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:16,951 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:17,299 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:18,043 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:18,267 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:27:18,296 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:27:18,359 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:27:18,440 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1.999200 2021-02-19 04:27:18,453 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:27:18,497 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 9081.000000 2021-02-19 04:27:18,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:18,538 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:18,861 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:19,602 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:19,861 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:27:19,878 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:27:19,950 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:27:20,042 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:27:20,058 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1.999200 2021-02-19 04:27:20,085 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:20,098 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 9081.000000 2021-02-19 04:27:20,121 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:20,421 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:21,177 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:21,436 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:27:21,457 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:27:21,584 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:27:21,657 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1.999200 2021-02-19 04:27:21,668 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:27:21,680 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:21,704 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 9085.900000 2021-02-19 04:27:21,723 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:21,993 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:22,750 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:23,022 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 104.500000 2021-02-19 04:27:23,062 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 771.000000 2021-02-19 04:27:23,198 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:27:23,246 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 22.399200 2021-02-19 04:27:23,289 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 241.200000 2021-02-19 04:27:23,305 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 9001.100000 2021-02-19 04:27:23,328 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:23,332 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:23,582 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:24,328 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:24,599 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 104.500000 2021-02-19 04:27:24,641 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 771.000000 2021-02-19 04:27:24,799 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:27:24,855 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 22.399200 2021-02-19 04:27:24,904 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 241.200000 2021-02-19 04:27:24,931 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 8698.000000 2021-02-19 04:27:24,943 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.300000 2021-02-19 04:27:24,973 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:25,153 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:25,908 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:26,174 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 104.500000 2021-02-19 04:27:26,221 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 771.000000 2021-02-19 04:27:26,395 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599460 2021-02-19 04:27:26,493 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 20.400000 2021-02-19 04:27:26,506 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1235.505125 2021-02-19 04:27:26,535 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 8698.000000 2021-02-19 04:27:26,546 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.300000 2021-02-19 04:27:26,572 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:26,714 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:27,482 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:27,536 | infra | INFO | pool-2-thread-50 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' completed 2021-02-19 04:27:27,538 | infra | INFO | pool-2-thread-50 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:27:27,756 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 979.712309 2021-02-19 04:27:27,796 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2446.591967 2021-02-19 04:27:27,996 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.599460 2021-02-19 04:27:28,085 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 20.400000 2021-02-19 04:27:28,099 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1235.505125 2021-02-19 04:27:28,141 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.300000 2021-02-19 04:27:28,154 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 8698.000000 2021-02-19 04:27:28,160 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:28,282 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:29,056 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:29,339 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 979.712309 2021-02-19 04:27:29,372 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2446.591967 2021-02-19 04:27:29,592 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 73.399460 2021-02-19 04:27:29,688 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 20.400000 2021-02-19 04:27:29,717 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1235.505125 2021-02-19 04:27:29,740 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3.200000 2021-02-19 04:27:29,769 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:29,782 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 7722.600000 2021-02-19 04:27:29,868 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:30,625 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:30,940 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 979.712309 2021-02-19 04:27:30,967 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2446.591967 2021-02-19 04:27:31,183 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 73.399460 2021-02-19 04:27:31,290 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 20.400000 2021-02-19 04:27:31,309 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1235.505125 2021-02-19 04:27:31,361 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3.200000 2021-02-19 04:27:31,384 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:31,388 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 7722.600000 2021-02-19 04:27:31,459 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:27:32,204 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:27:32,513 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3500.212309 2021-02-19 04:27:32,559 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5594.891967 2021-02-19 04:27:32,783 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1276.599460 2021-02-19 04:27:32,894 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1.100000 2021-02-19 04:27:32,920 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3430.705125 2021-02-19 04:27:32,957 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8.300000 2021-02-19 04:27:32,986 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 6467.200000 2021-02-19 04:27:33,000 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:33,053 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 390.900000 2021-02-19 04:27:33,819 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 895.700000 2021-02-19 04:27:34,137 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3500.212309 2021-02-19 04:27:34,194 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5594.891967 2021-02-19 04:27:34,388 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1490.999460 2021-02-19 04:27:34,536 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1.100000 2021-02-19 04:27:34,565 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7.100000 2021-02-19 04:27:34,589 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3430.705125 2021-02-19 04:27:34,598 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 5278.000000 2021-02-19 04:27:34,605 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:34,647 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 390.900000 2021-02-19 04:27:35,394 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 895.700000 2021-02-19 04:27:35,726 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5150.382998 2021-02-19 04:27:35,788 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8101.837298 2021-02-19 04:27:35,953 | infra | INFO | pool-2-thread-26 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' completed 2021-02-19 04:27:35,953 | infra | INFO | pool-2-thread-26 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:27:36,007 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3427.518254 2021-02-19 04:27:36,141 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1.100000 2021-02-19 04:27:36,187 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7.100000 2021-02-19 04:27:36,193 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3430.705125 2021-02-19 04:27:36,220 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:36,237 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 5278.000000 2021-02-19 04:27:36,242 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 390.900000 2021-02-19 04:27:36,953 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2652.083298 2021-02-19 04:27:37,309 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5150.382998 2021-02-19 04:27:37,361 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8101.837298 2021-02-19 04:27:37,674 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3427.518254 2021-02-19 04:27:37,782 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1.500521 2021-02-19 04:27:37,795 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7.100000 2021-02-19 04:27:37,815 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:37,859 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4720.068769 2021-02-19 04:27:37,884 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1055.163543 2021-02-19 04:27:37,891 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 5278.000000 2021-02-19 04:27:38,520 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2652.083298 2021-02-19 04:27:38,887 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5150.382998 2021-02-19 04:27:38,940 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8101.837298 2021-02-19 04:27:39,318 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3427.518254 2021-02-19 04:27:39,365 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1.500521 2021-02-19 04:27:39,392 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5.200000 2021-02-19 04:27:39,404 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:39,464 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4720.068769 2021-02-19 04:27:39,492 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4553.600000 2021-02-19 04:27:39,505 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1055.163543 2021-02-19 04:27:40,088 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2652.083298 2021-02-19 04:27:40,477 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5150.382998 2021-02-19 04:27:40,525 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8101.837298 2021-02-19 04:27:40,951 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3721.418254 2021-02-19 04:27:41,030 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5.200000 2021-02-19 04:27:41,042 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1.500521 2021-02-19 04:27:41,055 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:41,096 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4720.068769 2021-02-19 04:27:41,114 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1055.163543 2021-02-19 04:27:41,131 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4553.600000 2021-02-19 04:27:41,654 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2652.083298 2021-02-19 04:27:42,056 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5150.382998 2021-02-19 04:27:42,104 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8101.837298 2021-02-19 04:27:42,579 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5094.918254 2021-02-19 04:27:42,621 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.200000 2021-02-19 04:27:42,645 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.400521 2021-02-19 04:27:42,673 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:42,707 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1675.063543 2021-02-19 04:27:42,713 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4443.668769 2021-02-19 04:27:42,757 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4216.800000 2021-02-19 04:27:43,078 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.69:8091 2021-02-19 04:27:43,079 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 04:27:43,098 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.69:8091 is running 2021-02-19 04:27:43,098 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:43,220 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4826.183298 2021-02-19 04:27:43,516 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.418999910355. 2021-02-19 04:27:43,516 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:43,670 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5076.382998 2021-02-19 04:27:43,688 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7453.537298 2021-02-19 04:27:43,926 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.40900015831. 2021-02-19 04:27:43,926 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:44,191 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5094.918254 2021-02-19 04:27:44,240 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.200000 2021-02-19 04:27:44,263 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.400521 2021-02-19 04:27:44,273 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:44,338 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1675.063543 2021-02-19 04:27:44,345 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.419999837875. 2021-02-19 04:27:44,346 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:44,358 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4443.668769 2021-02-19 04:27:44,375 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4035.500000 2021-02-19 04:27:44,785 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.438000202179. 2021-02-19 04:27:44,786 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:44,792 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4826.183298 2021-02-19 04:27:45,220 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.434000015259. 2021-02-19 04:27:45,220 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:45,243 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5076.382998 2021-02-19 04:27:45,270 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7453.537298 2021-02-19 04:27:45,650 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.429000139236. 2021-02-19 04:27:45,650 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:45,802 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5833.500000 2021-02-19 04:27:45,838 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.100000 2021-02-19 04:27:45,881 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:45,898 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:45,950 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1985.000000 2021-02-19 04:27:45,963 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4338.500000 2021-02-19 04:27:45,980 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4035.500000 2021-02-19 04:27:46,111 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.461999893188. 2021-02-19 04:27:46,112 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:46,365 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6176.000000 2021-02-19 04:27:46,552 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.44000005722. 2021-02-19 04:27:46,552 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:46,834 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5154.200000 2021-02-19 04:27:46,858 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5987.500000 2021-02-19 04:27:46,976 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.421999931335. 2021-02-19 04:27:46,976 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:47,408 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5833.500000 2021-02-19 04:27:47,421 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.445999860764. 2021-02-19 04:27:47,437 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.64:8091 2021-02-19 04:27:47,438 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 04:27:47,447 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.100000 2021-02-19 04:27:47,454 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.64:8091 is running 2021-02-19 04:27:47,454 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:47,529 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:47,552 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:47,565 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1985.000000 2021-02-19 04:27:47,582 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4338.500000 2021-02-19 04:27:47,592 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4035.500000 2021-02-19 04:27:47,898 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.443000078201. 2021-02-19 04:27:47,898 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:47,931 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6176.000000 2021-02-19 04:27:48,354 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.455000162125. 2021-02-19 04:27:48,355 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:48,434 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5154.200000 2021-02-19 04:27:48,464 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5987.500000 2021-02-19 04:27:48,799 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.444999933243. 2021-02-19 04:27:48,799 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:49,026 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5833.500000 2021-02-19 04:27:49,081 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.100000 2021-02-19 04:27:49,127 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:49,170 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:49,197 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4035.500000 2021-02-19 04:27:49,210 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1985.000000 2021-02-19 04:27:49,233 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.434000015259. 2021-02-19 04:27:49,234 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:49,239 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4338.500000 2021-02-19 04:27:49,493 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6176.000000 2021-02-19 04:27:49,657 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.423000097275. 2021-02-19 04:27:49,657 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:50,026 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5154.200000 2021-02-19 04:27:50,048 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5987.500000 2021-02-19 04:27:50,076 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.418999910355. 2021-02-19 04:27:50,078 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:50,509 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.431999921799. 2021-02-19 04:27:50,509 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:50,611 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5838.800000 2021-02-19 04:27:50,671 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.100000 2021-02-19 04:27:50,756 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:50,792 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:50,799 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3994.200000 2021-02-19 04:27:50,821 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1985.000000 2021-02-19 04:27:50,865 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4338.500000 2021-02-19 04:27:50,980 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.470999956131. 2021-02-19 04:27:50,980 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:51,065 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6176.000000 2021-02-19 04:27:51,434 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.453000068665. 2021-02-19 04:27:51,434 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:51,625 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5154.200000 2021-02-19 04:27:51,631 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5987.500000 2021-02-19 04:27:51,875 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.441999912262. 2021-02-19 04:27:51,897 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.68:8091 2021-02-19 04:27:51,897 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 04:27:51,914 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.68:8091 is running 2021-02-19 04:27:51,914 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:52,191 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5838.800000 2021-02-19 04:27:52,309 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:52,348 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.431999921799. 2021-02-19 04:27:52,348 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:52,394 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:52,460 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3921.400000 2021-02-19 04:27:52,480 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2024.000000 2021-02-19 04:27:52,516 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:52,585 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4366.800000 2021-02-19 04:27:52,611 | infra | INFO | pool-2-thread-43 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' completed 2021-02-19 04:27:52,611 | infra | INFO | pool-2-thread-43 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:27:52,700 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6357.300000 2021-02-19 04:27:52,772 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.424000024796. 2021-02-19 04:27:52,772 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:52,903 | infra | INFO | pool-2-thread-51 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' completed 2021-02-19 04:27:52,903 | infra | INFO | pool-2-thread-51 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:27:53,191 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.419999837875. 2021-02-19 04:27:53,191 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:53,255 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5165.600000 2021-02-19 04:27:53,269 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4837.200000 2021-02-19 04:27:53,632 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.440999984741. 2021-02-19 04:27:53,634 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:53,815 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5815.500000 2021-02-19 04:27:53,957 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:54,026 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:27:54,072 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.43799996376. 2021-02-19 04:27:54,072 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:54,117 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3921.400000 2021-02-19 04:27:54,144 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2024.000000 2021-02-19 04:27:54,158 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:54,221 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4366.800000 2021-02-19 04:27:54,328 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6357.300000 2021-02-19 04:27:54,516 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.444000005722. 2021-02-19 04:27:54,516 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:54,895 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5165.600000 2021-02-19 04:27:54,911 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4837.200000 2021-02-19 04:27:54,950 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.434000015259. 2021-02-19 04:27:54,950 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:55,358 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.407999992371. 2021-02-19 04:27:55,358 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:55,493 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5763.200000 2021-02-19 04:27:55,628 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:55,690 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 136.300000 2021-02-19 04:27:55,782 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3815.900000 2021-02-19 04:27:55,805 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.447000026703. 2021-02-19 04:27:55,806 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:27:55,818 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2240.500000 2021-02-19 04:27:55,828 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:55,872 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4338.900000 2021-02-19 04:27:55,983 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6545.700000 2021-02-19 04:27:56,217 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.410000085831. 2021-02-19 04:27:56,217 | test | INFO | MainThread | [Magma:abort_rebalance:927] Restarting Rebalance after killing at 20 2021-02-19 04:27:56,280 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[]_OUT=[172.23.110.65]_1613737676.22 2021-02-19 04:27:56,282 | infra | INFO | pool-1-thread-30 | [task:start_task:84] Thread 'Rebalance_task_IN=[]_OUT=[172.23.110.65]_1613737676.22' started 2021-02-19 04:27:56,296 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L932 2021-02-19 04:27:56,296 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 120 seconds. Reason: Let the rebalance begin after abort 2021-02-19 04:27:56,315 | test | DEBUG | pool-1-thread-30 | [task:start_rebalance:301] Removing node 172.23.110.65:8091 from cluster 2021-02-19 04:27:56,315 | test | DEBUG | pool-1-thread-30 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.68,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': u'ns_1@172.23.110.65', 'user': 'Administrator'} 2021-02-19 04:27:56,355 | test | DEBUG | pool-1-thread-30 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 04:27:56,362 | test | INFO | pool-1-thread-30 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+---------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 15.835393953 | Cluster node | | 172.23.110.68 | kv | 7.0.0-4498-enterprise | 5.98171284986 | Cluster node | | 172.23.110.69 | kv | 7.0.0-4498-enterprise | 4.87478386971 | Cluster node | | 172.23.110.65 | kv | 7.0.0-4498-enterprise | 15.2333497088 | --- OUT ---> | +---------------+----------+-----------------------+---------------+--------------+ 2021-02-19 04:27:56,375 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 04:27:56,375 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 04:27:56,528 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5103.400000 2021-02-19 04:27:56,546 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4078.400000 2021-02-19 04:27:57,151 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5763.200000 2021-02-19 04:27:57,290 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:57,342 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 136.300000 2021-02-19 04:27:57,450 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3815.900000 2021-02-19 04:27:57,474 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2240.500000 2021-02-19 04:27:57,519 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:57,542 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4338.900000 2021-02-19 04:27:57,625 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6545.700000 2021-02-19 04:27:58,176 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5103.400000 2021-02-19 04:27:58,184 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4078.400000 2021-02-19 04:27:58,836 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5763.200000 2021-02-19 04:27:58,971 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:27:59,020 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 136.300000 2021-02-19 04:27:59,117 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3815.900000 2021-02-19 04:27:59,127 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2240.500000 2021-02-19 04:27:59,216 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4338.900000 2021-02-19 04:27:59,232 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:27:59,275 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6545.700000 2021-02-19 04:27:59,835 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4078.400000 2021-02-19 04:27:59,865 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5103.400000 2021-02-19 04:28:00,492 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5758.200000 2021-02-19 04:28:00,671 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:00,756 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 136.300000 2021-02-19 04:28:00,796 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2240.500000 2021-02-19 04:28:00,828 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3783.500000 2021-02-19 04:28:00,901 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4338.900000 2021-02-19 04:28:00,917 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:28:00,934 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6545.700000 2021-02-19 04:28:01,413 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 20.59 % 2021-02-19 04:28:01,413 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 20.590109408 2021-02-19 04:28:01,486 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4078.400000 2021-02-19 04:28:01,519 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5103.400000 2021-02-19 04:28:02,140 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5758.200000 2021-02-19 04:28:02,302 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:02,390 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1825.400000 2021-02-19 04:28:02,418 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2738.800000 2021-02-19 04:28:02,476 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3748.100000 2021-02-19 04:28:02,533 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4213.500000 2021-02-19 04:28:02,569 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6776.400000 2021-02-19 04:28:02,578 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 352.500000 2021-02-19 04:28:03,091 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2404.100000 2021-02-19 04:28:03,130 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5120.300000 2021-02-19 04:28:03,769 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5320.900000 2021-02-19 04:28:03,934 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:04,003 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1825.400000 2021-02-19 04:28:04,055 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2738.800000 2021-02-19 04:28:04,107 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3748.100000 2021-02-19 04:28:04,187 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4213.500000 2021-02-19 04:28:04,203 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6776.400000 2021-02-19 04:28:04,275 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 352.500000 2021-02-19 04:28:04,711 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2404.100000 2021-02-19 04:28:04,759 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5120.300000 2021-02-19 04:28:05,384 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5235.500000 2021-02-19 04:28:05,591 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:05,676 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3821.200000 2021-02-19 04:28:05,690 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3299.000000 2021-02-19 04:28:05,734 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3712.100000 2021-02-19 04:28:05,819 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3975.400000 2021-02-19 04:28:05,845 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7028.900000 2021-02-19 04:28:05,901 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1657.500000 2021-02-19 04:28:06,321 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 446.400000 2021-02-19 04:28:06,375 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5071.300000 2021-02-19 04:28:06,450 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 21.69 % 2021-02-19 04:28:06,450 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 21.6864045802 2021-02-19 04:28:07,005 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4349.700000 2021-02-19 04:28:07,214 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:07,311 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3821.200000 2021-02-19 04:28:07,351 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3299.000000 2021-02-19 04:28:07,381 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3712.100000 2021-02-19 04:28:07,489 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3975.400000 2021-02-19 04:28:07,502 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7028.900000 2021-02-19 04:28:07,517 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1657.500000 2021-02-19 04:28:07,953 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 446.400000 2021-02-19 04:28:08,009 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5071.300000 2021-02-19 04:28:08,619 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4349.700000 2021-02-19 04:28:08,844 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:08,928 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3821.200000 2021-02-19 04:28:08,993 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3299.000000 2021-02-19 04:28:09,007 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3712.100000 2021-02-19 04:28:09,151 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7028.900000 2021-02-19 04:28:09,173 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3975.400000 2021-02-19 04:28:09,190 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1657.500000 2021-02-19 04:28:09,561 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 446.400000 2021-02-19 04:28:09,612 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5071.300000 2021-02-19 04:28:10,236 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4349.700000 2021-02-19 04:28:10,493 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:10,615 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3821.200000 2021-02-19 04:28:10,628 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3577.400000 2021-02-19 04:28:10,668 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3299.000000 2021-02-19 04:28:10,801 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7028.900000 2021-02-19 04:28:10,828 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1657.500000 2021-02-19 04:28:10,838 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3975.400000 2021-02-19 04:28:11,167 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 446.400000 2021-02-19 04:28:11,229 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5071.300000 2021-02-19 04:28:11,496 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 22.58 % 2021-02-19 04:28:11,497 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 22.5774295912 2021-02-19 04:28:11,861 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4194.500000 2021-02-19 04:28:12,148 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:12,273 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3821.200000 2021-02-19 04:28:12,288 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3577.400000 2021-02-19 04:28:12,302 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3709.600000 2021-02-19 04:28:12,421 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7037.100000 2021-02-19 04:28:12,513 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3590.800000 2021-02-19 04:28:12,532 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4702.100000 2021-02-19 04:28:12,790 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:12,836 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4673.000000 2021-02-19 04:28:13,480 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2840.000000 2021-02-19 04:28:13,765 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:13,891 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4101.600000 2021-02-19 04:28:13,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3453.600000 2021-02-19 04:28:13,928 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3709.600000 2021-02-19 04:28:14,091 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7037.100000 2021-02-19 04:28:14,163 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4702.100000 2021-02-19 04:28:14,174 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3590.800000 2021-02-19 04:28:14,427 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:14,457 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4673.000000 2021-02-19 04:28:15,095 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2840.000000 2021-02-19 04:28:15,388 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:15,546 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3849.700000 2021-02-19 04:28:15,588 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3369.600000 2021-02-19 04:28:15,595 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3872.100000 2021-02-19 04:28:15,711 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6987.900000 2021-02-19 04:28:15,789 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6851.900000 2021-02-19 04:28:15,815 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3386.800000 2021-02-19 04:28:16,036 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:16,069 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4673.000000 2021-02-19 04:28:16,542 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 23.52 % 2021-02-19 04:28:16,542 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 23.522648832 2021-02-19 04:28:16,733 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1856.500000 2021-02-19 04:28:17,016 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:17,157 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3849.700000 2021-02-19 04:28:17,201 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3369.600000 2021-02-19 04:28:17,214 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3872.100000 2021-02-19 04:28:17,358 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6987.900000 2021-02-19 04:28:17,420 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6851.900000 2021-02-19 04:28:17,446 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3386.800000 2021-02-19 04:28:17,664 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:17,696 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4397.900000 2021-02-19 04:28:18,369 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1856.500000 2021-02-19 04:28:18,647 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:18,765 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3849.700000 2021-02-19 04:28:18,836 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3369.600000 2021-02-19 04:28:18,892 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3872.100000 2021-02-19 04:28:18,994 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6987.900000 2021-02-19 04:28:19,058 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6851.900000 2021-02-19 04:28:19,069 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3386.800000 2021-02-19 04:28:19,322 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:19,345 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4397.900000 2021-02-19 04:28:19,994 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1868.000000 2021-02-19 04:28:20,275 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:20,420 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3849.700000 2021-02-19 04:28:20,470 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3375.300000 2021-02-19 04:28:20,584 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3872.100000 2021-02-19 04:28:20,618 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6987.900000 2021-02-19 04:28:20,681 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6851.900000 2021-02-19 04:28:20,710 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3386.800000 2021-02-19 04:28:20,954 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:20,957 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4397.900000 2021-02-19 04:28:21,582 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 24.32 % 2021-02-19 04:28:21,584 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 24.3239087265 2021-02-19 04:28:21,618 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1868.000000 2021-02-19 04:28:21,903 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.300000 2021-02-19 04:28:22,045 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3849.700000 2021-02-19 04:28:22,105 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3375.300000 2021-02-19 04:28:22,221 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3872.100000 2021-02-19 04:28:22,285 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6987.900000 2021-02-19 04:28:22,342 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6991.500000 2021-02-19 04:28:22,352 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3405.100000 2021-02-19 04:28:22,571 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:22,584 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4480.000000 2021-02-19 04:28:23,263 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1492.300000 2021-02-19 04:28:23,536 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.600000 2021-02-19 04:28:23,687 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3774.900000 2021-02-19 04:28:23,730 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3385.100000 2021-02-19 04:28:23,849 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3795.900000 2021-02-19 04:28:23,961 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6991.500000 2021-02-19 04:28:23,986 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6998.400000 2021-02-19 04:28:24,043 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3405.100000 2021-02-19 04:28:24,200 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:24,209 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4480.000000 2021-02-19 04:28:24,924 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1427.200000 2021-02-19 04:28:25,144 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.600000 2021-02-19 04:28:25,313 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3774.900000 2021-02-19 04:28:25,359 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3374.400000 2021-02-19 04:28:25,470 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3845.000000 2021-02-19 04:28:25,592 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7014.100000 2021-02-19 04:28:25,621 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6954.600000 2021-02-19 04:28:25,667 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3377.200000 2021-02-19 04:28:25,812 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:25,826 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4514.000000 2021-02-19 04:28:26,545 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1023.300000 2021-02-19 04:28:26,621 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 25.15 % 2021-02-19 04:28:26,621 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 25.1450061728 2021-02-19 04:28:26,778 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.200000 2021-02-19 04:28:26,937 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3847.500000 2021-02-19 04:28:26,997 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3374.400000 2021-02-19 04:28:27,104 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3845.000000 2021-02-19 04:28:27,207 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7014.100000 2021-02-19 04:28:27,252 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6954.600000 2021-02-19 04:28:27,302 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3377.200000 2021-02-19 04:28:27,437 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:27,451 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4514.000000 2021-02-19 04:28:28,164 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1023.300000 2021-02-19 04:28:28,400 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.200000 2021-02-19 04:28:28,569 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3847.500000 2021-02-19 04:28:28,615 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3374.400000 2021-02-19 04:28:28,733 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3845.000000 2021-02-19 04:28:28,845 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7014.100000 2021-02-19 04:28:28,894 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6954.600000 2021-02-19 04:28:28,930 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3377.200000 2021-02-19 04:28:29,096 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:29,111 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4514.000000 2021-02-19 04:28:29,778 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 915.900000 2021-02-19 04:28:30,013 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.400000 2021-02-19 04:28:30,196 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3847.500000 2021-02-19 04:28:30,233 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3374.400000 2021-02-19 04:28:30,342 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3845.000000 2021-02-19 04:28:30,460 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7014.100000 2021-02-19 04:28:30,578 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6954.600000 2021-02-19 04:28:30,595 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3377.200000 2021-02-19 04:28:30,714 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:30,767 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4514.000000 2021-02-19 04:28:31,384 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 915.900000 2021-02-19 04:28:31,632 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.400000 2021-02-19 04:28:31,657 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 25.89 % 2021-02-19 04:28:31,657 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 25.8864710782 2021-02-19 04:28:31,808 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3847.500000 2021-02-19 04:28:31,838 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3341.600000 2021-02-19 04:28:31,940 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3845.000000 2021-02-19 04:28:32,095 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7014.100000 2021-02-19 04:28:32,203 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3377.200000 2021-02-19 04:28:32,237 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6954.600000 2021-02-19 04:28:32,315 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:32,384 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4532.800000 2021-02-19 04:28:33,019 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 727.600000 2021-02-19 04:28:33,246 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.100000 2021-02-19 04:28:33,428 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4054.400000 2021-02-19 04:28:33,471 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3335.100000 2021-02-19 04:28:33,565 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3965.400000 2021-02-19 04:28:33,710 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6896.400000 2021-02-19 04:28:33,829 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3380.800000 2021-02-19 04:28:33,913 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6846.500000 2021-02-19 04:28:33,963 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:33,990 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4532.800000 2021-02-19 04:28:34,638 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 708.700000 2021-02-19 04:28:34,875 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.500000 2021-02-19 04:28:35,082 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4054.400000 2021-02-19 04:28:35,109 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3335.100000 2021-02-19 04:28:35,206 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3965.400000 2021-02-19 04:28:35,331 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6896.400000 2021-02-19 04:28:35,441 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3380.900000 2021-02-19 04:28:35,581 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6782.300000 2021-02-19 04:28:35,607 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4553.600000 2021-02-19 04:28:35,624 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:36,249 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 708.700000 2021-02-19 04:28:36,483 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.500000 2021-02-19 04:28:36,696 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 26.62 % 2021-02-19 04:28:36,696 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 26.6219635633 2021-02-19 04:28:36,716 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4174.900000 2021-02-19 04:28:36,742 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3337.100000 2021-02-19 04:28:36,836 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3963.200000 2021-02-19 04:28:36,944 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6856.400000 2021-02-19 04:28:37,059 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3380.900000 2021-02-19 04:28:37,204 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6782.300000 2021-02-19 04:28:37,253 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4553.600000 2021-02-19 04:28:37,269 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:37,877 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 584.700000 2021-02-19 04:28:38,086 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.500000 2021-02-19 04:28:38,339 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4174.900000 2021-02-19 04:28:38,357 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3337.100000 2021-02-19 04:28:38,453 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3963.200000 2021-02-19 04:28:38,559 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6856.400000 2021-02-19 04:28:38,664 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3380.900000 2021-02-19 04:28:38,822 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6782.300000 2021-02-19 04:28:38,878 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4553.600000 2021-02-19 04:28:38,885 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:39,489 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 598.200000 2021-02-19 04:28:39,697 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:39,982 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3373.400000 2021-02-19 04:28:40,005 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4174.900000 2021-02-19 04:28:40,115 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3963.200000 2021-02-19 04:28:40,174 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6856.400000 2021-02-19 04:28:40,286 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3380.900000 2021-02-19 04:28:40,443 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6782.300000 2021-02-19 04:28:40,483 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4553.600000 2021-02-19 04:28:40,503 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:41,108 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 598.200000 2021-02-19 04:28:41,315 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:41,602 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3373.400000 2021-02-19 04:28:41,627 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4174.900000 2021-02-19 04:28:41,739 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 27.16 % 2021-02-19 04:28:41,740 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 27.1558846262 2021-02-19 04:28:41,746 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3963.200000 2021-02-19 04:28:41,796 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6856.400000 2021-02-19 04:28:41,890 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3380.900000 2021-02-19 04:28:42,053 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6782.300000 2021-02-19 04:28:42,118 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4553.600000 2021-02-19 04:28:42,130 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:42,729 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 760.100000 2021-02-19 04:28:42,917 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:43,249 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3381.500000 2021-02-19 04:28:43,253 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4166.700000 2021-02-19 04:28:43,381 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3727.600000 2021-02-19 04:28:43,415 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7001.300000 2021-02-19 04:28:43,507 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3282.600000 2021-02-19 04:28:43,681 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6824.200000 2021-02-19 04:28:43,759 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:43,765 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4502.000000 2021-02-19 04:28:44,382 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1004.100000 2021-02-19 04:28:44,565 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:44,871 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3408.800000 2021-02-19 04:28:44,891 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4166.700000 2021-02-19 04:28:45,032 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3727.600000 2021-02-19 04:28:45,049 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7001.300000 2021-02-19 04:28:45,121 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3282.600000 2021-02-19 04:28:45,311 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6824.200000 2021-02-19 04:28:45,385 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:45,414 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4502.000000 2021-02-19 04:28:45,986 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1241.700000 2021-02-19 04:28:46,160 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:46,500 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3408.800000 2021-02-19 04:28:46,516 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4092.100000 2021-02-19 04:28:46,671 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3582.600000 2021-02-19 04:28:46,674 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7176.400000 2021-02-19 04:28:46,736 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3284.700000 2021-02-19 04:28:46,780 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 27.55 % 2021-02-19 04:28:46,780 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 27.5458266316 2021-02-19 04:28:46,938 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6992.800000 2021-02-19 04:28:47,013 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:47,039 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4492.700000 2021-02-19 04:28:47,611 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1241.700000 2021-02-19 04:28:47,762 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:48,122 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3408.800000 2021-02-19 04:28:48,134 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4092.100000 2021-02-19 04:28:48,302 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3582.600000 2021-02-19 04:28:48,312 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7176.400000 2021-02-19 04:28:48,388 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3284.700000 2021-02-19 04:28:48,565 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6992.800000 2021-02-19 04:28:48,621 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:48,661 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4492.700000 2021-02-19 04:28:49,243 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1241.700000 2021-02-19 04:28:49,381 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:49,736 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3410.700000 2021-02-19 04:28:49,746 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4092.100000 2021-02-19 04:28:49,924 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3582.600000 2021-02-19 04:28:49,937 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7176.400000 2021-02-19 04:28:50,009 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3284.700000 2021-02-19 04:28:50,203 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6992.800000 2021-02-19 04:28:50,236 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:50,276 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4492.700000 2021-02-19 04:28:50,881 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1865.400000 2021-02-19 04:28:51,002 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:51,361 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3410.700000 2021-02-19 04:28:51,375 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4092.100000 2021-02-19 04:28:51,562 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3582.600000 2021-02-19 04:28:51,588 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7176.400000 2021-02-19 04:28:51,619 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3284.700000 2021-02-19 04:28:51,818 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6992.800000 2021-02-19 04:28:51,845 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 27.97 % 2021-02-19 04:28:51,845 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 27.965829177 2021-02-19 04:28:51,851 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:51,901 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4492.700000 2021-02-19 04:28:52,513 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2583.300000 2021-02-19 04:28:52,615 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:52,977 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3664.800000 2021-02-19 04:28:52,984 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3440.700000 2021-02-19 04:28:53,206 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3799.500000 2021-02-19 04:28:53,243 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7122.200000 2021-02-19 04:28:53,263 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3573.900000 2021-02-19 04:28:53,450 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7260.200000 2021-02-19 04:28:53,473 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:53,522 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4511.600000 2021-02-19 04:28:54,140 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2583.300000 2021-02-19 04:28:54,226 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:54,572 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3664.800000 2021-02-19 04:28:54,591 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3431.700000 2021-02-19 04:28:54,828 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3799.500000 2021-02-19 04:28:54,882 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7122.200000 2021-02-19 04:28:54,888 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3573.900000 2021-02-19 04:28:55,122 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:55,148 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7260.200000 2021-02-19 04:28:55,186 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4511.600000 2021-02-19 04:28:55,802 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3142.900000 2021-02-19 04:28:55,869 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:56,184 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3664.800000 2021-02-19 04:28:56,198 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3431.700000 2021-02-19 04:28:56,433 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3976.900000 2021-02-19 04:28:56,509 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6959.700000 2021-02-19 04:28:56,528 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3767.100000 2021-02-19 04:28:56,743 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:56,803 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7336.200000 2021-02-19 04:28:56,812 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4489.000000 2021-02-19 04:28:56,908 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 28.41 % 2021-02-19 04:28:56,910 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 28.4144620565 2021-02-19 04:28:57,448 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3142.900000 2021-02-19 04:28:57,548 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:57,776 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3283.000000 2021-02-19 04:28:57,799 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3431.700000 2021-02-19 04:28:58,055 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3976.900000 2021-02-19 04:28:58,138 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6959.700000 2021-02-19 04:28:58,154 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3767.100000 2021-02-19 04:28:58,361 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:28:58,483 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4489.000000 2021-02-19 04:28:58,489 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7336.200000 2021-02-19 04:28:59,066 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3142.900000 2021-02-19 04:28:59,214 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:28:59,401 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3283.000000 2021-02-19 04:28:59,430 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3426.100000 2021-02-19 04:28:59,700 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3976.900000 2021-02-19 04:28:59,762 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6959.700000 2021-02-19 04:28:59,792 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3767.100000 2021-02-19 04:28:59,973 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:00,101 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4489.000000 2021-02-19 04:29:00,111 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7336.200000 2021-02-19 04:29:00,706 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3425.200000 2021-02-19 04:29:00,834 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:01,039 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3283.000000 2021-02-19 04:29:01,053 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3426.100000 2021-02-19 04:29:01,338 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3976.900000 2021-02-19 04:29:01,388 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6959.700000 2021-02-19 04:29:01,407 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3767.100000 2021-02-19 04:29:01,592 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:01,736 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4489.000000 2021-02-19 04:29:01,756 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7336.200000 2021-02-19 04:29:01,966 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 28.85 % 2021-02-19 04:29:01,966 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 28.8482076866 2021-02-19 04:29:02,336 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3598.100000 2021-02-19 04:29:02,467 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:02,670 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3385.600000 2021-02-19 04:29:02,687 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3374.500000 2021-02-19 04:29:02,963 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3699.900000 2021-02-19 04:29:03,053 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6861.200000 2021-02-19 04:29:03,055 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3543.300000 2021-02-19 04:29:03,213 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:03,374 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4641.800000 2021-02-19 04:29:03,403 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7115.700000 2021-02-19 04:29:03,987 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3598.100000 2021-02-19 04:29:04,086 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:04,306 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3385.600000 2021-02-19 04:29:04,319 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3374.500000 2021-02-19 04:29:04,576 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3699.900000 2021-02-19 04:29:04,706 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6861.200000 2021-02-19 04:29:04,719 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3543.300000 2021-02-19 04:29:04,874 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:04,999 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4641.800000 2021-02-19 04:29:05,012 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7115.700000 2021-02-19 04:29:05,575 | infra | INFO | pool-2-thread-30 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' completed 2021-02-19 04:29:05,578 | infra | INFO | pool-2-thread-30 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:29:05,612 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3560.700000 2021-02-19 04:29:05,700 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:05,931 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3524.600000 2021-02-19 04:29:05,950 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3358.400000 2021-02-19 04:29:06,184 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3699.900000 2021-02-19 04:29:06,332 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6861.200000 2021-02-19 04:29:06,346 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3543.300000 2021-02-19 04:29:06,509 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:06,601 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4841.700000 2021-02-19 04:29:06,671 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6925.200000 2021-02-19 04:29:07,017 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 29.27 % 2021-02-19 04:29:07,017 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 29.2664939849 2021-02-19 04:29:07,236 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3560.700000 2021-02-19 04:29:07,318 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:07,579 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3524.600000 2021-02-19 04:29:07,586 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3358.400000 2021-02-19 04:29:07,793 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3405.500000 2021-02-19 04:29:07,963 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6819.000000 2021-02-19 04:29:07,990 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3337.900000 2021-02-19 04:29:08,128 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:08,217 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4841.700000 2021-02-19 04:29:08,292 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6925.200000 2021-02-19 04:29:08,858 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3560.700000 2021-02-19 04:29:08,933 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:09,184 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3524.600000 2021-02-19 04:29:09,207 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3358.400000 2021-02-19 04:29:09,410 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3405.500000 2021-02-19 04:29:09,594 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6819.000000 2021-02-19 04:29:09,611 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3337.900000 2021-02-19 04:29:09,746 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:09,819 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4841.700000 2021-02-19 04:29:09,901 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6925.200000 2021-02-19 04:29:10,494 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3589.700000 2021-02-19 04:29:10,551 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:10,805 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3524.600000 2021-02-19 04:29:10,821 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3309.500000 2021-02-19 04:29:11,036 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3405.500000 2021-02-19 04:29:11,219 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6819.000000 2021-02-19 04:29:11,250 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3337.900000 2021-02-19 04:29:11,355 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:11,461 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4841.700000 2021-02-19 04:29:11,532 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6925.200000 2021-02-19 04:29:12,065 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 29.66 % 2021-02-19 04:29:12,065 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 29.6564359902 2021-02-19 04:29:12,137 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3589.700000 2021-02-19 04:29:12,188 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:12,424 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3648.800000 2021-02-19 04:29:12,440 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3293.300000 2021-02-19 04:29:12,663 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4119.100000 2021-02-19 04:29:12,898 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7132.400000 2021-02-19 04:29:12,918 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2642.400000 2021-02-19 04:29:12,976 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:13,068 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4717.500000 2021-02-19 04:29:13,148 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7012.000000 2021-02-19 04:29:13,816 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3494.100000 2021-02-19 04:29:13,855 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.300000 2021-02-19 04:29:14,032 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3648.800000 2021-02-19 04:29:14,058 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3293.300000 2021-02-19 04:29:14,289 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4119.100000 2021-02-19 04:29:14,519 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7132.400000 2021-02-19 04:29:14,536 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2642.400000 2021-02-19 04:29:14,588 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:14,710 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4717.500000 2021-02-19 04:29:14,769 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7012.000000 2021-02-19 04:29:15,493 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3441.000000 2021-02-19 04:29:15,525 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.600000 2021-02-19 04:29:15,638 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3813.900000 2021-02-19 04:29:15,684 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3250.800000 2021-02-19 04:29:15,928 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5290.200000 2021-02-19 04:29:16,187 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2642.400000 2021-02-19 04:29:16,203 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7132.400000 2021-02-19 04:29:16,211 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:16,351 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4717.500000 2021-02-19 04:29:16,411 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7187.100000 2021-02-19 04:29:17,111 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 30.00 % 2021-02-19 04:29:17,111 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 30.0 2021-02-19 04:29:17,119 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3441.000000 2021-02-19 04:29:17,154 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.600000 2021-02-19 04:29:17,269 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3813.900000 2021-02-19 04:29:17,312 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3250.800000 2021-02-19 04:29:17,542 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5290.200000 2021-02-19 04:29:17,795 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1444.900000 2021-02-19 04:29:17,831 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7558.700000 2021-02-19 04:29:17,845 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:17,971 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4514.900000 2021-02-19 04:29:18,036 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7187.100000 2021-02-19 04:29:18,759 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3441.000000 2021-02-19 04:29:18,769 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.600000 2021-02-19 04:29:18,878 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3813.900000 2021-02-19 04:29:18,941 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3250.800000 2021-02-19 04:29:19,210 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5290.200000 2021-02-19 04:29:19,450 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1444.900000 2021-02-19 04:29:19,492 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:19,500 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7558.700000 2021-02-19 04:29:19,596 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4514.900000 2021-02-19 04:29:19,660 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7187.100000 2021-02-19 04:29:20,403 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.100000 2021-02-19 04:29:20,431 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3662.900000 2021-02-19 04:29:20,549 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3813.900000 2021-02-19 04:29:20,585 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3228.400000 2021-02-19 04:29:20,842 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5290.200000 2021-02-19 04:29:21,150 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1444.900000 2021-02-19 04:29:21,155 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7558.700000 2021-02-19 04:29:21,157 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:21,242 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4514.900000 2021-02-19 04:29:21,292 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7187.100000 2021-02-19 04:29:22,013 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.100000 2021-02-19 04:29:22,069 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3662.900000 2021-02-19 04:29:22,160 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 30.00 % 2021-02-19 04:29:22,161 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 30.0 2021-02-19 04:29:22,164 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3813.900000 2021-02-19 04:29:22,223 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3228.400000 2021-02-19 04:29:22,463 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6516.300000 2021-02-19 04:29:22,786 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7635.800000 2021-02-19 04:29:22,815 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:22,841 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 473.100000 2021-02-19 04:29:22,904 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4469.800000 2021-02-19 04:29:22,957 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7392.800000 2021-02-19 04:29:23,622 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.900000 2021-02-19 04:29:23,769 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3928.000000 2021-02-19 04:29:23,851 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3175.100000 2021-02-19 04:29:23,865 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3871.600000 2021-02-19 04:29:24,073 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6516.300000 2021-02-19 04:29:24,417 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7635.800000 2021-02-19 04:29:24,444 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:24,483 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 473.100000 2021-02-19 04:29:24,538 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4469.800000 2021-02-19 04:29:24,595 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7392.800000 2021-02-19 04:29:25,223 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.000000 2021-02-19 04:29:25,400 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4398.200000 2021-02-19 04:29:25,463 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3118.600000 2021-02-19 04:29:25,490 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3882.700000 2021-02-19 04:29:25,691 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7480.500000 2021-02-19 04:29:26,062 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7601.700000 2021-02-19 04:29:26,105 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:26,177 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4469.800000 2021-02-19 04:29:26,181 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 473.100000 2021-02-19 04:29:26,236 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7392.800000 2021-02-19 04:29:26,823 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.000000 2021-02-19 04:29:27,029 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4249.800000 2021-02-19 04:29:27,104 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3118.600000 2021-02-19 04:29:27,108 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3882.700000 2021-02-19 04:29:27,204 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 30.01 % 2021-02-19 04:29:27,204 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 30.007810213 2021-02-19 04:29:27,302 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7480.500000 2021-02-19 04:29:27,700 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7601.700000 2021-02-19 04:29:27,750 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:27,842 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:27,844 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4461.900000 2021-02-19 04:29:27,868 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7592.500000 2021-02-19 04:29:28,453 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.000000 2021-02-19 04:29:28,653 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4249.800000 2021-02-19 04:29:28,742 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3118.600000 2021-02-19 04:29:28,753 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3882.700000 2021-02-19 04:29:28,918 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7480.500000 2021-02-19 04:29:29,332 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7601.700000 2021-02-19 04:29:29,384 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:29,487 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7592.500000 2021-02-19 04:29:29,519 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:29,538 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4461.900000 2021-02-19 04:29:30,062 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.500000 2021-02-19 04:29:30,272 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4249.800000 2021-02-19 04:29:30,361 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3882.700000 2021-02-19 04:29:30,377 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3118.600000 2021-02-19 04:29:30,523 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7480.500000 2021-02-19 04:29:30,950 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7601.700000 2021-02-19 04:29:31,013 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:31,109 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7592.500000 2021-02-19 04:29:31,131 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:31,154 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4461.900000 2021-02-19 04:29:31,680 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.500000 2021-02-19 04:29:31,901 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4578.000000 2021-02-19 04:29:31,983 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3882.700000 2021-02-19 04:29:32,016 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2995.500000 2021-02-19 04:29:32,150 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7480.500000 2021-02-19 04:29:32,259 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 30.47 % 2021-02-19 04:29:32,259 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 30.4650512797 2021-02-19 04:29:32,579 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7550.400000 2021-02-19 04:29:32,621 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:32,737 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7611.000000 2021-02-19 04:29:32,778 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:32,790 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4445.200000 2021-02-19 04:29:33,286 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.400000 2021-02-19 04:29:33,519 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4729.200000 2021-02-19 04:29:33,604 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3652.600000 2021-02-19 04:29:33,634 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2870.600000 2021-02-19 04:29:33,782 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7725.000000 2021-02-19 04:29:34,187 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7550.400000 2021-02-19 04:29:34,227 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:34,375 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7611.000000 2021-02-19 04:29:34,411 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:34,440 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4445.200000 2021-02-19 04:29:34,913 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:35,150 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4729.200000 2021-02-19 04:29:35,263 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3652.600000 2021-02-19 04:29:35,266 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2724.300000 2021-02-19 04:29:35,398 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7725.000000 2021-02-19 04:29:35,802 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7490.500000 2021-02-19 04:29:35,842 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:36,006 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7548.500000 2021-02-19 04:29:36,023 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:36,058 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4482.600000 2021-02-19 04:29:36,523 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:36,789 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4750.700000 2021-02-19 04:29:36,897 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2916.700000 2021-02-19 04:29:36,907 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2724.300000 2021-02-19 04:29:37,033 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7881.000000 2021-02-19 04:29:37,303 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 30.67 % 2021-02-19 04:29:37,303 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 30.6658228772 2021-02-19 04:29:37,421 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7490.500000 2021-02-19 04:29:37,443 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:37,631 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7548.500000 2021-02-19 04:29:37,647 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:37,686 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4482.600000 2021-02-19 04:29:38,132 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:38,408 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4750.700000 2021-02-19 04:29:38,525 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2916.700000 2021-02-19 04:29:38,552 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2724.300000 2021-02-19 04:29:38,647 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7881.000000 2021-02-19 04:29:39,035 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7490.500000 2021-02-19 04:29:39,049 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:39,272 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:39,302 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7548.500000 2021-02-19 04:29:39,315 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4482.600000 2021-02-19 04:29:39,733 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:40,035 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4845.400000 2021-02-19 04:29:40,171 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2916.700000 2021-02-19 04:29:40,180 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2724.300000 2021-02-19 04:29:40,260 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7881.000000 2021-02-19 04:29:40,668 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7490.500000 2021-02-19 04:29:40,677 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:40,888 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:40,937 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7548.500000 2021-02-19 04:29:40,948 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4482.600000 2021-02-19 04:29:41,335 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:41,654 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4845.400000 2021-02-19 04:29:41,790 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2987.300000 2021-02-19 04:29:41,809 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2685.100000 2021-02-19 04:29:41,882 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7881.000000 2021-02-19 04:29:42,286 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:42,302 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7527.100000 2021-02-19 04:29:42,348 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 30.96 % 2021-02-19 04:29:42,348 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 30.9610858687 2021-02-19 04:29:42,502 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:42,562 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4630.100000 2021-02-19 04:29:42,582 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7518.300000 2021-02-19 04:29:42,960 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:43,276 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4941.800000 2021-02-19 04:29:43,420 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1845.000000 2021-02-19 04:29:43,427 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2649.000000 2021-02-19 04:29:43,513 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8013.400000 2021-02-19 04:29:43,891 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:43,911 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7527.100000 2021-02-19 04:29:44,124 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:44,168 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4630.100000 2021-02-19 04:29:44,213 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7518.300000 2021-02-19 04:29:44,575 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:44,914 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5017.500000 2021-02-19 04:29:45,036 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1851.800000 2021-02-19 04:29:45,059 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2637.600000 2021-02-19 04:29:45,111 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8013.400000 2021-02-19 04:29:45,496 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:45,532 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7534.551469 2021-02-19 04:29:45,730 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:45,799 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4754.965121 2021-02-19 04:29:45,823 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7506.253448 2021-02-19 04:29:46,180 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:46,546 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5017.500000 2021-02-19 04:29:46,647 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1282.117609 2021-02-19 04:29:46,677 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2637.600000 2021-02-19 04:29:46,730 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8107.256406 2021-02-19 04:29:47,125 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:47,167 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7534.551469 2021-02-19 04:29:47,352 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:47,391 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 31.35 % 2021-02-19 04:29:47,391 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 31.3531734287 2021-02-19 04:29:47,450 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7506.253448 2021-02-19 04:29:47,470 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4754.965121 2021-02-19 04:29:47,813 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:48,190 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5017.500000 2021-02-19 04:29:48,253 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1282.117609 2021-02-19 04:29:48,309 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2637.600000 2021-02-19 04:29:48,342 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8107.256406 2021-02-19 04:29:48,727 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:48,779 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7534.551469 2021-02-19 04:29:48,964 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:49,055 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7506.253448 2021-02-19 04:29:49,084 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4754.965121 2021-02-19 04:29:49,427 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:49,809 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4838.500000 2021-02-19 04:29:49,861 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1238.517609 2021-02-19 04:29:49,924 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2553.000000 2021-02-19 04:29:49,947 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8107.256406 2021-02-19 04:29:50,332 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:50,391 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7534.551469 2021-02-19 04:29:50,572 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:50,667 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7506.253448 2021-02-19 04:29:50,710 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4754.965121 2021-02-19 04:29:51,039 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:51,441 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4838.500000 2021-02-19 04:29:51,477 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1238.517609 2021-02-19 04:29:51,542 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2553.000000 2021-02-19 04:29:51,555 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8107.256406 2021-02-19 04:29:51,943 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:51,996 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7534.551469 2021-02-19 04:29:52,170 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:52,345 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7402.453448 2021-02-19 04:29:52,382 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4932.265121 2021-02-19 04:29:52,444 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 31.85 % 2021-02-19 04:29:52,444 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 31.8485078909 2021-02-19 04:29:52,665 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:53,063 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4685.600000 2021-02-19 04:29:53,082 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 787.417609 2021-02-19 04:29:53,187 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8304.356406 2021-02-19 04:29:53,193 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2495.600000 2021-02-19 04:29:53,566 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:53,657 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7388.551469 2021-02-19 04:29:53,822 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:54,017 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7402.453448 2021-02-19 04:29:54,048 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4932.265121 2021-02-19 04:29:54,279 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:54,694 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4547.800000 2021-02-19 04:29:54,700 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 785.917609 2021-02-19 04:29:54,842 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8304.356406 2021-02-19 04:29:54,845 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2457.800000 2021-02-19 04:29:55,181 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:55,269 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7388.551469 2021-02-19 04:29:55,417 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:55,684 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7288.177987 2021-02-19 04:29:55,706 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5075.020532 2021-02-19 04:29:55,890 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:56,309 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 32.22 % 2021-02-19 04:29:56,309 | test | INFO | MainThread | [Magma:abort_rebalance:933] Rebalance % = 32.2192861848 2021-02-19 04:29:56,322 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 785.917609 2021-02-19 04:29:56,332 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 32.22 % 2021-02-19 04:29:56,335 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4547.800000 2021-02-19 04:29:56,345 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:29:56,346 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:29:56,463 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8400.000981 2021-02-19 04:29:56,486 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2457.800000 2021-02-19 04:29:56,783 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:56,885 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7247.663998 2021-02-19 04:29:57,020 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:57,332 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7288.177987 2021-02-19 04:29:57,345 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5075.020532 2021-02-19 04:29:57,496 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 32.37 % 2021-02-19 04:29:57,496 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 32.3721701237 2021-02-19 04:29:57,507 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:57,967 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4547.800000 2021-02-19 04:29:57,979 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 336.012447 2021-02-19 04:29:58,085 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8400.000981 2021-02-19 04:29:58,111 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2457.800000 2021-02-19 04:29:58,388 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:29:58,496 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7247.663998 2021-02-19 04:29:58,631 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:29:58,963 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7288.177987 2021-02-19 04:29:58,973 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5075.020532 2021-02-19 04:29:59,125 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:29:59,601 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4538.600000 2021-02-19 04:29:59,608 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 361.312447 2021-02-19 04:29:59,729 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8400.000981 2021-02-19 04:29:59,747 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2446.000000 2021-02-19 04:29:59,984 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:00,095 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7247.663998 2021-02-19 04:30:00,223 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:00,572 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7288.177987 2021-02-19 04:30:00,584 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5075.020532 2021-02-19 04:30:00,724 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:01,223 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4538.600000 2021-02-19 04:30:01,240 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 361.312447 2021-02-19 04:30:01,342 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8400.000981 2021-02-19 04:30:01,404 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2446.000000 2021-02-19 04:30:01,588 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:01,703 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7247.663998 2021-02-19 04:30:01,832 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:02,187 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7288.177987 2021-02-19 04:30:02,194 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5075.020532 2021-02-19 04:30:02,342 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:02,538 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 32.72 % 2021-02-19 04:30:02,538 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 32.7196217346 2021-02-19 04:30:02,851 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 367.812447 2021-02-19 04:30:02,898 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4580.000000 2021-02-19 04:30:03,005 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8336.300981 2021-02-19 04:30:03,023 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2436.300000 2021-02-19 04:30:03,216 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:03,338 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7212.963998 2021-02-19 04:30:03,441 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:03,805 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7287.777987 2021-02-19 04:30:03,815 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5065.620532 2021-02-19 04:30:03,947 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:04,476 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 366.405829 2021-02-19 04:30:04,526 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4632.655216 2021-02-19 04:30:04,618 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8336.300981 2021-02-19 04:30:04,648 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2417.332465 2021-02-19 04:30:04,823 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:04,963 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7212.963998 2021-02-19 04:30:05,052 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:05,428 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5065.620532 2021-02-19 04:30:05,438 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7287.777987 2021-02-19 04:30:05,555 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:06,088 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 285.793381 2021-02-19 04:30:06,196 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4632.655216 2021-02-19 04:30:06,219 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8336.300981 2021-02-19 04:30:06,263 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2417.332465 2021-02-19 04:30:06,358 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 33.01 % 2021-02-19 04:30:06,372 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:30:06,372 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:30:06,434 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:06,598 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7273.300000 2021-02-19 04:30:06,697 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:07,033 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5041.300000 2021-02-19 04:30:07,056 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7366.300000 2021-02-19 04:30:07,174 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:07,578 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 33.04 % 2021-02-19 04:30:07,578 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 33.0436541419 2021-02-19 04:30:07,709 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 285.793381 2021-02-19 04:30:07,845 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8395.100000 2021-02-19 04:30:07,875 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4632.655216 2021-02-19 04:30:07,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2417.332465 2021-02-19 04:30:08,055 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:08,226 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7273.300000 2021-02-19 04:30:08,293 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:08,667 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5041.300000 2021-02-19 04:30:08,671 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7366.300000 2021-02-19 04:30:08,786 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:09,313 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 285.793381 2021-02-19 04:30:09,463 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8395.100000 2021-02-19 04:30:09,496 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4765.355216 2021-02-19 04:30:09,523 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2473.632465 2021-02-19 04:30:09,667 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:09,829 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7273.300000 2021-02-19 04:30:09,895 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:10,288 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5041.300000 2021-02-19 04:30:10,309 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7366.300000 2021-02-19 04:30:10,415 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.500000 2021-02-19 04:30:10,934 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 262.693381 2021-02-19 04:30:11,078 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8395.100000 2021-02-19 04:30:11,122 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4765.355216 2021-02-19 04:30:11,153 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2473.632465 2021-02-19 04:30:11,276 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:11,447 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7273.300000 2021-02-19 04:30:11,489 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:11,924 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5041.300000 2021-02-19 04:30:11,963 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7366.300000 2021-02-19 04:30:12,062 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.500000 2021-02-19 04:30:12,540 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 331.293381 2021-02-19 04:30:12,625 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 33.08 % 2021-02-19 04:30:12,625 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 33.0802967143 2021-02-19 04:30:12,703 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8377.400000 2021-02-19 04:30:12,743 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4886.655216 2021-02-19 04:30:12,779 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2589.632465 2021-02-19 04:30:12,875 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:13,068 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7574.200000 2021-02-19 04:30:13,104 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:13,542 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4936.100000 2021-02-19 04:30:13,575 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7557.900000 2021-02-19 04:30:13,676 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.900000 2021-02-19 04:30:14,145 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 331.293381 2021-02-19 04:30:14,332 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8377.400000 2021-02-19 04:30:14,365 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4886.655216 2021-02-19 04:30:14,417 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2589.632465 2021-02-19 04:30:14,487 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:14,706 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7574.200000 2021-02-19 04:30:14,711 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:15,177 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4936.100000 2021-02-19 04:30:15,201 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7557.900000 2021-02-19 04:30:15,303 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.601192 2021-02-19 04:30:15,747 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 551.924522 2021-02-19 04:30:15,957 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8234.900000 2021-02-19 04:30:16,030 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5071.058269 2021-02-19 04:30:16,099 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2769.373094 2021-02-19 04:30:16,119 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:16,321 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7574.200000 2021-02-19 04:30:16,332 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:16,382 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 33.49 % 2021-02-19 04:30:16,397 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:30:16,397 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:30:16,792 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4787.800000 2021-02-19 04:30:16,813 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7815.100000 2021-02-19 04:30:16,917 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.601192 2021-02-19 04:30:17,371 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 551.924522 2021-02-19 04:30:17,585 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8234.900000 2021-02-19 04:30:17,651 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5071.058269 2021-02-19 04:30:17,671 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 33.65 % 2021-02-19 04:30:17,671 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 33.6478040258 2021-02-19 04:30:17,737 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2769.373094 2021-02-19 04:30:17,743 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:17,954 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:17,954 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7909.000000 2021-02-19 04:30:18,410 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4787.800000 2021-02-19 04:30:18,430 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7815.100000 2021-02-19 04:30:18,532 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.601192 2021-02-19 04:30:19,028 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 551.924522 2021-02-19 04:30:19,213 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8234.900000 2021-02-19 04:30:19,273 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5071.058269 2021-02-19 04:30:19,361 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:19,380 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2769.373094 2021-02-19 04:30:19,578 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:19,596 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7909.000000 2021-02-19 04:30:20,032 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4787.800000 2021-02-19 04:30:20,039 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7815.100000 2021-02-19 04:30:20,141 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.101192 2021-02-19 04:30:20,647 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 807.824522 2021-02-19 04:30:20,826 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8234.900000 2021-02-19 04:30:20,898 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5210.358269 2021-02-19 04:30:21,002 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:21,022 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2881.973094 2021-02-19 04:30:21,194 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:21,220 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7909.000000 2021-02-19 04:30:21,657 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4787.800000 2021-02-19 04:30:21,674 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7815.100000 2021-02-19 04:30:21,752 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.101192 2021-02-19 04:30:22,270 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1227.624522 2021-02-19 04:30:22,446 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7870.500000 2021-02-19 04:30:22,565 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5314.158269 2021-02-19 04:30:22,614 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:22,668 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2908.173094 2021-02-19 04:30:22,716 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 34.15 % 2021-02-19 04:30:22,716 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 34.1473764045 2021-02-19 04:30:22,815 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:22,859 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8028.600000 2021-02-19 04:30:23,267 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4562.800000 2021-02-19 04:30:23,282 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7941.300000 2021-02-19 04:30:23,355 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.701192 2021-02-19 04:30:23,911 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1227.624522 2021-02-19 04:30:24,053 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7870.500000 2021-02-19 04:30:24,197 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5314.158269 2021-02-19 04:30:24,217 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:24,276 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2908.173094 2021-02-19 04:30:24,438 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:24,480 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8028.600000 2021-02-19 04:30:24,874 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4562.800000 2021-02-19 04:30:24,903 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7941.300000 2021-02-19 04:30:24,967 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:25,581 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1986.900000 2021-02-19 04:30:25,664 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7448.700000 2021-02-19 04:30:25,831 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:25,845 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5332.300000 2021-02-19 04:30:25,927 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2839.400000 2021-02-19 04:30:26,052 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:26,088 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7985.900000 2021-02-19 04:30:26,408 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 34.50 % 2021-02-19 04:30:26,421 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:30:26,421 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:30:26,526 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4399.200000 2021-02-19 04:30:26,549 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7827.200000 2021-02-19 04:30:26,591 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:27,247 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1986.900000 2021-02-19 04:30:27,309 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7448.700000 2021-02-19 04:30:27,423 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:27,470 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5332.300000 2021-02-19 04:30:27,549 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2839.400000 2021-02-19 04:30:27,658 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:27,706 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7985.900000 2021-02-19 04:30:27,756 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 34.60 % 2021-02-19 04:30:27,756 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 34.6049559989 2021-02-19 04:30:28,131 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4399.200000 2021-02-19 04:30:28,163 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7827.200000 2021-02-19 04:30:28,200 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:28,911 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1986.900000 2021-02-19 04:30:28,967 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7448.700000 2021-02-19 04:30:29,017 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:29,088 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5332.300000 2021-02-19 04:30:29,180 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2839.400000 2021-02-19 04:30:29,269 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:29,309 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7985.900000 2021-02-19 04:30:29,756 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4399.200000 2021-02-19 04:30:29,769 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7827.200000 2021-02-19 04:30:29,823 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:30,559 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2109.000000 2021-02-19 04:30:30,683 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7448.700000 2021-02-19 04:30:30,724 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5322.100000 2021-02-19 04:30:30,760 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:30,819 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2762.500000 2021-02-19 04:30:30,901 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:30,928 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7985.900000 2021-02-19 04:30:31,381 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4399.200000 2021-02-19 04:30:31,401 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7827.200000 2021-02-19 04:30:31,464 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:32,269 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2109.000000 2021-02-19 04:30:32,293 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7437.900000 2021-02-19 04:30:32,381 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:32,408 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5359.800000 2021-02-19 04:30:32,469 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2687.900000 2021-02-19 04:30:32,519 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:32,545 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7942.800000 2021-02-19 04:30:32,801 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 35.10 % 2021-02-19 04:30:32,802 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 35.0986735767 2021-02-19 04:30:33,005 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4448.400000 2021-02-19 04:30:33,029 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7706.700000 2021-02-19 04:30:33,104 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:33,933 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7437.900000 2021-02-19 04:30:33,983 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2185.000000 2021-02-19 04:30:34,019 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:34,046 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5359.800000 2021-02-19 04:30:34,122 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2687.900000 2021-02-19 04:30:34,150 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:34,209 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7942.800000 2021-02-19 04:30:34,657 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7706.700000 2021-02-19 04:30:34,663 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4448.400000 2021-02-19 04:30:34,750 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:35,552 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7592.100000 2021-02-19 04:30:35,638 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2018.300000 2021-02-19 04:30:35,641 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:35,678 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5400.900000 2021-02-19 04:30:35,762 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2645.800000 2021-02-19 04:30:35,769 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:35,836 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7974.200000 2021-02-19 04:30:36,292 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4448.400000 2021-02-19 04:30:36,302 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7706.700000 2021-02-19 04:30:36,374 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:36,438 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 35.44 % 2021-02-19 04:30:36,453 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:30:36,453 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:30:37,184 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7592.100000 2021-02-19 04:30:37,262 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:37,272 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2018.300000 2021-02-19 04:30:37,313 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5400.900000 2021-02-19 04:30:37,411 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:37,417 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2645.800000 2021-02-19 04:30:37,466 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7974.200000 2021-02-19 04:30:37,839 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 35.59 % 2021-02-19 04:30:37,841 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 35.5870409425 2021-02-19 04:30:37,934 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7764.800000 2021-02-19 04:30:37,940 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4505.400000 2021-02-19 04:30:37,986 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:38,805 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7592.100000 2021-02-19 04:30:38,924 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:38,936 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2018.300000 2021-02-19 04:30:38,971 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5400.900000 2021-02-19 04:30:39,075 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2645.800000 2021-02-19 04:30:39,101 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:39,102 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7974.200000 2021-02-19 04:30:39,578 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7764.800000 2021-02-19 04:30:39,594 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4505.400000 2021-02-19 04:30:39,624 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:40,428 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7592.100000 2021-02-19 04:30:40,595 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:40,621 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5386.900000 2021-02-19 04:30:40,628 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2027.800000 2021-02-19 04:30:40,737 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:40,746 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7974.200000 2021-02-19 04:30:40,766 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2631.100000 2021-02-19 04:30:41,220 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7764.800000 2021-02-19 04:30:41,226 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4505.400000 2021-02-19 04:30:41,233 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:42,059 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7592.100000 2021-02-19 04:30:42,257 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5386.900000 2021-02-19 04:30:42,269 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:42,285 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2027.800000 2021-02-19 04:30:42,369 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7900.600000 2021-02-19 04:30:42,388 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2661.300000 2021-02-19 04:30:42,401 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:42,868 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:42,891 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 36.06 % 2021-02-19 04:30:42,891 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 36.0563301387 2021-02-19 04:30:42,907 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7874.300000 2021-02-19 04:30:42,920 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4508.300000 2021-02-19 04:30:43,665 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7586.600000 2021-02-19 04:30:43,888 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:43,943 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2010.100000 2021-02-19 04:30:43,950 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5333.100000 2021-02-19 04:30:44,063 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2661.300000 2021-02-19 04:30:44,075 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:44,076 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7900.600000 2021-02-19 04:30:44,209 | infra | INFO | pool-2-thread-22 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' completed 2021-02-19 04:30:44,209 | infra | INFO | pool-2-thread-22 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:30:44,487 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:44,526 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7874.300000 2021-02-19 04:30:44,542 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4508.300000 2021-02-19 04:30:45,283 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7586.600000 2021-02-19 04:30:45,542 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:45,579 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1960.100000 2021-02-19 04:30:45,599 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5307.000000 2021-02-19 04:30:45,700 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2696.700000 2021-02-19 04:30:45,710 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:45,750 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7818.000000 2021-02-19 04:30:46,109 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:46,193 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7963.600000 2021-02-19 04:30:46,201 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4451.800000 2021-02-19 04:30:46,463 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 36.36 % 2021-02-19 04:30:46,479 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:30:46,479 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:30:46,888 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7548.100000 2021-02-19 04:30:47,151 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:47,220 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1960.100000 2021-02-19 04:30:47,246 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5307.000000 2021-02-19 04:30:47,331 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2696.700000 2021-02-19 04:30:47,338 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:47,375 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7818.000000 2021-02-19 04:30:47,721 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:47,805 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7963.600000 2021-02-19 04:30:47,815 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4451.800000 2021-02-19 04:30:47,937 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 36.52 % 2021-02-19 04:30:47,937 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 36.5189556223 2021-02-19 04:30:48,490 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7548.100000 2021-02-19 04:30:48,762 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:48,871 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5307.000000 2021-02-19 04:30:48,898 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1960.100000 2021-02-19 04:30:48,959 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:48,993 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7818.000000 2021-02-19 04:30:49,019 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2696.700000 2021-02-19 04:30:49,335 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:49,407 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7963.600000 2021-02-19 04:30:49,424 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4451.800000 2021-02-19 04:30:50,105 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7548.100000 2021-02-19 04:30:50,357 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:50,496 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5269.500000 2021-02-19 04:30:50,569 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2218.400000 2021-02-19 04:30:50,582 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:50,647 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7818.000000 2021-02-19 04:30:50,684 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2749.300000 2021-02-19 04:30:50,944 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:51,030 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7963.600000 2021-02-19 04:30:51,043 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4451.800000 2021-02-19 04:30:51,720 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7548.100000 2021-02-19 04:30:51,970 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:52,132 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5269.500000 2021-02-19 04:30:52,203 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2218.400000 2021-02-19 04:30:52,232 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:52,263 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7818.000000 2021-02-19 04:30:52,315 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2807.900000 2021-02-19 04:30:52,558 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:52,651 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6796.900000 2021-02-19 04:30:52,660 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4519.900000 2021-02-19 04:30:52,983 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 37.01 % 2021-02-19 04:30:52,983 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 37.0075232542 2021-02-19 04:30:53,331 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7740.600000 2021-02-19 04:30:53,566 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:53,776 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5234.000000 2021-02-19 04:30:53,852 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:53,867 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2633.800000 2021-02-19 04:30:53,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7875.700000 2021-02-19 04:30:53,953 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2807.900000 2021-02-19 04:30:54,163 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:54,273 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 6796.900000 2021-02-19 04:30:54,286 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4519.900000 2021-02-19 04:30:54,953 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7740.600000 2021-02-19 04:30:55,170 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:55,424 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5177.500000 2021-02-19 04:30:55,473 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:55,545 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3312.500000 2021-02-19 04:30:55,578 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7981.500000 2021-02-19 04:30:55,591 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2881.000000 2021-02-19 04:30:55,775 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:55,898 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5012.800000 2021-02-19 04:30:55,915 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4739.000000 2021-02-19 04:30:56,496 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 37.35 % 2021-02-19 04:30:56,507 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:30:56,507 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:30:56,559 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7987.600000 2021-02-19 04:30:56,773 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:57,048 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5177.500000 2021-02-19 04:30:57,088 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:57,217 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3312.500000 2021-02-19 04:30:57,227 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2881.000000 2021-02-19 04:30:57,240 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7981.500000 2021-02-19 04:30:57,384 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:57,515 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5012.800000 2021-02-19 04:30:57,540 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4739.000000 2021-02-19 04:30:58,023 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 37.46 % 2021-02-19 04:30:58,023 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 37.4594483138 2021-02-19 04:30:58,168 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7987.600000 2021-02-19 04:30:58,387 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:30:58,671 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5177.500000 2021-02-19 04:30:58,694 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:30:58,858 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2881.000000 2021-02-19 04:30:58,878 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3312.500000 2021-02-19 04:30:58,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7981.500000 2021-02-19 04:30:59,009 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:30:59,131 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5012.800000 2021-02-19 04:30:59,168 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4739.000000 2021-02-19 04:30:59,782 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7987.600000 2021-02-19 04:30:59,976 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:00,335 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5177.500000 2021-02-19 04:31:00,344 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:00,510 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2938.100000 2021-02-19 04:31:00,532 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7981.500000 2021-02-19 04:31:00,543 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3713.800000 2021-02-19 04:31:00,657 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:31:00,755 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5012.800000 2021-02-19 04:31:00,799 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4739.000000 2021-02-19 04:31:01,397 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7987.600000 2021-02-19 04:31:01,579 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:01,956 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:01,969 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5185.700000 2021-02-19 04:31:02,130 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2938.100000 2021-02-19 04:31:02,154 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7981.500000 2021-02-19 04:31:02,187 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3713.800000 2021-02-19 04:31:02,292 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.100000 2021-02-19 04:31:02,408 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4167.800000 2021-02-19 04:31:02,476 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4831.800000 2021-02-19 04:31:02,671 | infra | INFO | pool-2-thread-63 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' completed 2021-02-19 04:31:02,671 | infra | INFO | pool-2-thread-63 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:31:03,015 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7933.300000 2021-02-19 04:31:03,072 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 37.90 % 2021-02-19 04:31:03,072 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 37.8991591826 2021-02-19 04:31:03,164 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:03,565 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:03,585 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5207.500000 2021-02-19 04:31:03,763 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8018.400000 2021-02-19 04:31:03,780 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2967.900000 2021-02-19 04:31:03,838 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3940.300000 2021-02-19 04:31:03,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.100000 2021-02-19 04:31:04,013 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4167.800000 2021-02-19 04:31:04,085 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4831.800000 2021-02-19 04:31:04,671 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7933.300000 2021-02-19 04:31:04,809 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:05,138 | infra | INFO | pool-2-thread-59 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' completed 2021-02-19 04:31:05,138 | infra | INFO | pool-2-thread-59 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:31:05,198 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:05,223 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5173.800000 2021-02-19 04:31:05,371 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8018.400000 2021-02-19 04:31:05,447 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2997.200000 2021-02-19 04:31:05,516 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4124.100000 2021-02-19 04:31:05,571 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.700000 2021-02-19 04:31:05,637 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3920.000000 2021-02-19 04:31:05,681 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4852.300000 2021-02-19 04:31:06,286 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7933.300000 2021-02-19 04:31:06,408 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:06,522 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 38.17 % 2021-02-19 04:31:06,536 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:31:06,536 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:31:06,822 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:06,845 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5173.800000 2021-02-19 04:31:07,010 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7886.700000 2021-02-19 04:31:07,108 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2997.200000 2021-02-19 04:31:07,203 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3842.500000 2021-02-19 04:31:07,224 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.700000 2021-02-19 04:31:07,259 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3920.000000 2021-02-19 04:31:07,308 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4852.300000 2021-02-19 04:31:07,885 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7825.100000 2021-02-19 04:31:08,019 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:08,107 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 38.36 % 2021-02-19 04:31:08,107 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 38.3632984329 2021-02-19 04:31:08,421 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:08,454 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5173.800000 2021-02-19 04:31:08,615 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7886.700000 2021-02-19 04:31:08,730 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2997.200000 2021-02-19 04:31:08,831 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3842.500000 2021-02-19 04:31:08,846 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.700000 2021-02-19 04:31:08,907 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3920.000000 2021-02-19 04:31:08,917 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4852.300000 2021-02-19 04:31:09,523 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7825.100000 2021-02-19 04:31:09,648 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:10,032 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:10,075 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4987.800000 2021-02-19 04:31:10,243 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7886.700000 2021-02-19 04:31:10,365 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2997.200000 2021-02-19 04:31:10,473 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.500000 2021-02-19 04:31:10,512 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3916.800000 2021-02-19 04:31:10,552 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3920.000000 2021-02-19 04:31:10,591 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4852.300000 2021-02-19 04:31:11,125 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7825.100000 2021-02-19 04:31:11,256 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:11,660 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:11,696 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4987.800000 2021-02-19 04:31:11,849 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7886.700000 2021-02-19 04:31:11,990 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3074.800000 2021-02-19 04:31:12,107 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.500000 2021-02-19 04:31:12,164 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3916.800000 2021-02-19 04:31:12,197 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3920.000000 2021-02-19 04:31:12,220 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4852.300000 2021-02-19 04:31:12,740 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7998.000000 2021-02-19 04:31:12,905 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:13,150 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 38.84 % 2021-02-19 04:31:13,150 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 38.8396518741 2021-02-19 04:31:13,267 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:13,302 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4789.800000 2021-02-19 04:31:13,461 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7433.000000 2021-02-19 04:31:13,618 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3184.000000 2021-02-19 04:31:13,726 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.700000 2021-02-19 04:31:13,822 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3890.800000 2021-02-19 04:31:13,842 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3983.300000 2021-02-19 04:31:13,851 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5047.800000 2021-02-19 04:31:14,358 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7998.000000 2021-02-19 04:31:14,506 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:14,892 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:14,924 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4701.000000 2021-02-19 04:31:15,076 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7433.000000 2021-02-19 04:31:15,257 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3258.200000 2021-02-19 04:31:15,354 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.100000 2021-02-19 04:31:15,473 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4048.000000 2021-02-19 04:31:15,496 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3983.300000 2021-02-19 04:31:15,506 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5047.800000 2021-02-19 04:31:16,005 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8140.800000 2021-02-19 04:31:16,141 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:16,487 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:16,545 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4701.000000 2021-02-19 04:31:16,549 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 39.18 % 2021-02-19 04:31:16,562 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:31:16,563 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:31:16,700 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7228.500000 2021-02-19 04:31:16,885 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3258.200000 2021-02-19 04:31:16,974 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.100000 2021-02-19 04:31:17,117 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4028.900000 2021-02-19 04:31:17,144 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3785.600000 2021-02-19 04:31:17,168 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5212.600000 2021-02-19 04:31:17,631 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8140.800000 2021-02-19 04:31:17,756 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:18,078 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:18,160 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4701.000000 2021-02-19 04:31:18,188 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 39.29 % 2021-02-19 04:31:18,188 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 39.2915769337 2021-02-19 04:31:18,315 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7228.500000 2021-02-19 04:31:18,522 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3258.200000 2021-02-19 04:31:18,586 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.100000 2021-02-19 04:31:18,789 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4028.900000 2021-02-19 04:31:18,816 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5212.600000 2021-02-19 04:31:18,822 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3785.600000 2021-02-19 04:31:19,232 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8140.800000 2021-02-19 04:31:19,348 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:19,677 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:19,782 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4799.700000 2021-02-19 04:31:19,940 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7228.500000 2021-02-19 04:31:20,144 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3255.400000 2021-02-19 04:31:20,193 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.300000 2021-02-19 04:31:20,424 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4028.900000 2021-02-19 04:31:20,463 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3956.500000 2021-02-19 04:31:20,473 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5212.600000 2021-02-19 04:31:20,868 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8140.800000 2021-02-19 04:31:20,976 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:21,293 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:21,392 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4799.700000 2021-02-19 04:31:21,552 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7228.500000 2021-02-19 04:31:21,770 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3255.400000 2021-02-19 04:31:21,808 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.300000 2021-02-19 04:31:22,043 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4028.900000 2021-02-19 04:31:22,095 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5212.600000 2021-02-19 04:31:22,118 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3956.500000 2021-02-19 04:31:22,480 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8001.100000 2021-02-19 04:31:22,578 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:22,895 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:23,003 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4946.800000 2021-02-19 04:31:23,163 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7569.800000 2021-02-19 04:31:23,234 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 39.79 % 2021-02-19 04:31:23,236 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 39.7923587564 2021-02-19 04:31:23,418 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3210.800000 2021-02-19 04:31:23,426 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:31:23,686 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4016.500000 2021-02-19 04:31:23,756 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5021.400000 2021-02-19 04:31:23,828 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4021.600000 2021-02-19 04:31:24,095 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8001.100000 2021-02-19 04:31:24,170 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:24,503 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:24,635 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5055.200000 2021-02-19 04:31:24,792 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7569.800000 2021-02-19 04:31:25,038 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3194.500000 2021-02-19 04:31:25,048 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:31:25,315 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4016.500000 2021-02-19 04:31:25,384 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5021.400000 2021-02-19 04:31:25,453 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4288.900000 2021-02-19 04:31:25,701 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7895.600000 2021-02-19 04:31:25,769 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:26,109 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:26,253 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5055.200000 2021-02-19 04:31:26,392 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7569.800000 2021-02-19 04:31:26,582 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 40.00 % 2021-02-19 04:31:26,595 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:31:26,595 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:31:26,644 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3194.500000 2021-02-19 04:31:26,665 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:31:26,947 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4036.700000 2021-02-19 04:31:26,997 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4871.700000 2021-02-19 04:31:27,065 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3996.600000 2021-02-19 04:31:27,315 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7895.600000 2021-02-19 04:31:27,394 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:27,710 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:27,884 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5055.200000 2021-02-19 04:31:27,989 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7779.600000 2021-02-19 04:31:28,282 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 40.00 % 2021-02-19 04:31:28,282 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 40.0 2021-02-19 04:31:28,301 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3194.500000 2021-02-19 04:31:28,331 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:31:28,555 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4036.700000 2021-02-19 04:31:28,615 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4871.700000 2021-02-19 04:31:28,697 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3996.600000 2021-02-19 04:31:28,926 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7895.600000 2021-02-19 04:31:29,013 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:29,308 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:29,516 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5055.200000 2021-02-19 04:31:29,585 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7779.600000 2021-02-19 04:31:29,924 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3168.600000 2021-02-19 04:31:29,957 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:31:30,197 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4036.700000 2021-02-19 04:31:30,267 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4871.700000 2021-02-19 04:31:30,354 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3996.600000 2021-02-19 04:31:30,545 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7895.600000 2021-02-19 04:31:30,621 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:30,897 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:31,125 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5089.400000 2021-02-19 04:31:31,217 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7779.600000 2021-02-19 04:31:31,561 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3168.600000 2021-02-19 04:31:31,572 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:31:31,812 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4036.700000 2021-02-19 04:31:31,881 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4871.700000 2021-02-19 04:31:31,982 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3980.000000 2021-02-19 04:31:32,165 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7895.600000 2021-02-19 04:31:32,236 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:32,484 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:32,747 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5106.200000 2021-02-19 04:31:32,815 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7795.200000 2021-02-19 04:31:33,184 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3133.900000 2021-02-19 04:31:33,197 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:31:33,351 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 40.00 % 2021-02-19 04:31:33,352 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 40.0 2021-02-19 04:31:33,437 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3960.100000 2021-02-19 04:31:33,503 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4840.300000 2021-02-19 04:31:33,594 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4016.600000 2021-02-19 04:31:33,780 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8003.400000 2021-02-19 04:31:33,848 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:34,072 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:34,346 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5106.200000 2021-02-19 04:31:34,414 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7795.200000 2021-02-19 04:31:34,816 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3082.100000 2021-02-19 04:31:34,834 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:31:35,059 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3960.100000 2021-02-19 04:31:35,115 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4840.300000 2021-02-19 04:31:35,234 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4355.200000 2021-02-19 04:31:35,401 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8003.400000 2021-02-19 04:31:35,459 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:35,687 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:35,967 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5098.900000 2021-02-19 04:31:36,026 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7880.800000 2021-02-19 04:31:36,453 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3082.100000 2021-02-19 04:31:36,469 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:31:36,596 | test | INFO | MainThread | [rest_client:rebalance_reached:108] Rebalance reached >40.0% in 100.285999775 seconds 2021-02-19 04:31:36,611 | test | DEBUG | MainThread | [rest_client:diag_eval:1363] /diag/eval status on 172.23.110.64:8091: 1 content: true command: ns_orchestrator:needs_rebalance() 2021-02-19 04:31:36,612 | test | INFO | MainThread | [Magma:abort_rebalance:912] Abort rebalance 2021-02-19 04:31:36,668 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3862.900000 2021-02-19 04:31:36,734 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4761.000000 2021-02-19 04:31:36,852 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4132.500000 2021-02-19 04:31:37,015 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8130.600000 2021-02-19 04:31:37,049 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:37,053 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L914 2021-02-19 04:31:37,053 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 60 seconds. Reason: Sleep after error introduction 2021-02-19 04:31:37,270 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:37,569 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5098.900000 2021-02-19 04:31:37,609 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7880.800000 2021-02-19 04:31:38,085 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3082.100000 2021-02-19 04:31:38,098 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:31:38,256 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3862.900000 2021-02-19 04:31:38,321 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4761.000000 2021-02-19 04:31:38,459 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4132.500000 2021-02-19 04:31:38,605 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8130.600000 2021-02-19 04:31:38,628 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:38,737 | test | DEBUG | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 40.00 % 2021-02-19 04:31:38,737 | test | INFO | pool-1-thread-30 | [task:check:330] Rebalance - status: running, progress: 40.0 2021-02-19 04:31:38,858 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:39,174 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5098.900000 2021-02-19 04:31:39,207 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7880.800000 2021-02-19 04:31:39,786 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:31:40,151 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4761.000000 2021-02-19 04:31:40,157 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4181.500000 2021-02-19 04:31:40,181 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3862.900000 2021-02-19 04:31:40,191 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2983.600000 2021-02-19 04:31:40,243 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8130.600000 2021-02-19 04:31:40,278 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:40,703 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:40,790 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4958.200000 2021-02-19 04:31:40,812 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7880.800000 2021-02-19 04:31:41,401 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:31:41,779 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4761.000000 2021-02-19 04:31:41,796 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4181.500000 2021-02-19 04:31:41,816 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3862.900000 2021-02-19 04:31:41,822 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2983.600000 2021-02-19 04:31:41,864 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8130.600000 2021-02-19 04:31:41,891 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:42,301 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:42,388 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3241.100000 2021-02-19 04:31:42,420 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3972.900000 2021-02-19 04:31:42,996 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:31:43,390 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2373.900000 2021-02-19 04:31:43,414 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2794.400000 2021-02-19 04:31:43,437 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1935.700000 2021-02-19 04:31:43,444 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1956.600000 2021-02-19 04:31:43,471 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4081.800000 2021-02-19 04:31:43,484 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:43,769 | test | ERROR | pool-1-thread-30 | [rest_client:_rebalance_status_and_progress:1494] {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 04:31:43,798 | test | INFO | pool-1-thread-30 | [rest_client:print_UI_logs:2599] Latest logs from UI on 172.23.110.69: 2021-02-19 04:31:43,798 | test | ERROR | pool-1-thread-30 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_orchestrator', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613737897727L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:31:37.727Z', u'text': u'Rebalance exited with reason {mover_crashed,\n {unexpected_exit,\n {\'EXIT\',<0.17246.58>,\n {{{badmatch,{error,closed}},\n [{mc_client_binary,cmd_vocal_recv,5,\n [{file,"src/mc_client_binary.erl"},\n {line,158}]},\n {mc_client_binary,\n wait_for_seqno_persistence,3,\n [{file,"src/mc_client_binary.erl"},\n {line,763}]},\n {ns_memcached,\n \'-wait_for_seqno_persistence/3-fun-0-\',3,\n [{file,"src/ns_memcached.erl"},\n {line,1392}]},\n {ns_memcached,\n \'-perform_very_long_call/3-fun-0-\',2,\n [{file,"src/ns_memcached.erl"},\n {line,324}]},\n {ns_memcached_sockets_pool,\n \'-executing_on_socket/3-fun-0-\',3,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,92}]},\n {async,\'-async_init/4-fun-1-\',3,\n [{file,"src/async.erl"},{line,197}]}]},\n {gen_server,call,\n [{\'janitor_agent-GleamBookUsers4\',\n \'ns_1@172.23.110.64\'},\n {if_rebalance,<0.16973.58>,\n {update_vbucket_state,170,active,\n undefined,undefined,\n [[\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.65\'],\n [\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.68\']]}},\n infinity]}}}}}.\nRebalance Operation Id = e63adcb14f18a5b354518e7c2e16284a'} 2021-02-19 04:31:43,798 | test | ERROR | pool-1-thread-30 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613737897684L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:31:37.684Z', u'text': u'Worker <0.17183.58> (for action {move,{170,\n [\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.65\'],\n [\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.68\'],\n []}}) exited with reason {unexpected_exit,\n {\'EXIT\',\n <0.17246.58>,\n {{{badmatch,\n {error,\n closed}},\n [{mc_client_binary,\n cmd_vocal_recv,\n 5,\n [{file,\n "src/mc_client_binary.erl"},\n {line,\n 158}]},\n {mc_client_binary,\n wait_for_seqno_persistence,\n 3,\n [{file,\n "src/mc_client_binary.erl"},\n {line,\n 763}]},\n {ns_memcached,\n \'-wait_for_seqno_persistence/3-fun-0-\',\n 3,\n [{file,\n "src/ns_memcached.erl"},\n {line,\n 1392}]},\n {ns_memcached,\n \'-perform_very_long_call/3-fun-0-\',\n 2,\n [{file,\n "src/ns_memcached.erl"},\n {line,\n 324}]},\n {ns_memcached_sockets_pool,\n \'-executing_on_socket/3-fun-0-\',\n 3,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,\n 92}]},\n {async,\n \'-async_init/4-fun-1-\',\n 3,\n [{file,\n "src/async.erl"},\n {line,\n 197}]}]},\n {gen_server,\n call,\n [{\'janitor_agent-GleamBookUsers4\',\n \'ns_1@172.23.110.64\'},\n {if_rebalance,\n <0.16973.58>,\n {update_vbucket_state,\n 170,\n active,\n undefined,\n undefined,\n [[\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.65\'],\n [\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.68\']]}},\n infinity]}}}}'} 2021-02-19 04:31:43,799 | test | ERROR | pool-1-thread-30 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_log', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613737897684L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:31:37.684Z', u'text': u"Service 'memcached' exited with status 137. Restarting. Messages:\nWARNING: Logging before InitGoogleLogging() is written to STDERR\nW0219 04:26:51.814513 46342 HazptrDomain.h:671] Using the default inline executor for asynchronous reclamation may be susceptible to deadlock if the current thread happens to hold a resource needed by the deleter of a reclaimable object"} 2021-02-19 04:31:43,799 | test | ERROR | pool-1-thread-30 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613737897684L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:31:37.684Z', u'text': u"Control connection to memcached on 'ns_1@172.23.110.64' disconnected. Check logs for details."} 2021-02-19 04:31:43,799 | test | ERROR | pool-1-thread-30 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613737895782L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:31:35.782Z', u'text': u'Bucket "GleamBookUsers4" rebalance does not seem to be swap rebalance'} 2021-02-19 04:31:43,799 | test | ERROR | pool-1-thread-30 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613737895310L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:31:35.310Z', u'text': u'Bucket "GleamBookUsers4" loaded on node \'ns_1@172.23.110.69\' in 0 seconds.'} 2021-02-19 04:31:43,799 | test | ERROR | pool-1-thread-30 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.65', u'tstamp': 1613737895132L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:31:35.132Z', u'text': u'Shutting down bucket "GleamBookUsers3" on \'ns_1@172.23.110.65\' for deletion'} 2021-02-19 04:31:43,799 | test | ERROR | pool-1-thread-30 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_rebalancer', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613737894614L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:31:34.614Z', u'text': u'Started rebalancing bucket GleamBookUsers4'} 2021-02-19 04:31:43,799 | test | ERROR | pool-1-thread-30 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.68', u'tstamp': 1613737894515L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:31:34.515Z', u'text': u'Bucket "GleamBookUsers4" loaded on node \'ns_1@172.23.110.68\' in 0 seconds.'} 2021-02-19 04:31:43,799 | test | ERROR | pool-1-thread-30 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613737765963L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:29:25.963Z', u'text': u'Bucket "GleamBookUsers3" rebalance does not seem to be swap rebalance'} 2021-02-19 04:31:43,799 | test | ERROR | pool-1-thread-30 | [task:call:242] Rebalance Failed: {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 04:31:43,881 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:43,983 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3241.100000 2021-02-19 04:31:44,013 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3972.900000 2021-02-19 04:31:44,586 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.400000 2021-02-19 04:31:45,009 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2373.900000 2021-02-19 04:31:45,016 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1938.500000 2021-02-19 04:31:45,043 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1374.300000 2021-02-19 04:31:45,068 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1935.700000 2021-02-19 04:31:45,076 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4081.800000 2021-02-19 04:31:45,088 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:45,460 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:45,582 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2236.800000 2021-02-19 04:31:45,604 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1497.150855 2021-02-19 04:31:46,191 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.400000 2021-02-19 04:31:46,657 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1374.300000 2021-02-19 04:31:46,681 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1938.500000 2021-02-19 04:31:46,710 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 858.942317 2021-02-19 04:31:46,710 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 708.387484 2021-02-19 04:31:46,719 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:46,736 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1483.255023 2021-02-19 04:31:47,058 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:47,184 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2236.800000 2021-02-19 04:31:47,204 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1497.150855 2021-02-19 04:31:47,792 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.400000 2021-02-19 04:31:48,286 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1374.300000 2021-02-19 04:31:48,319 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 708.387484 2021-02-19 04:31:48,332 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1938.500000 2021-02-19 04:31:48,352 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 858.942317 2021-02-19 04:31:48,358 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:48,384 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1483.255023 2021-02-19 04:31:48,638 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:48,779 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2236.800000 2021-02-19 04:31:48,805 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1497.150855 2021-02-19 04:31:49,378 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.400000 2021-02-19 04:31:49,907 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 434.900000 2021-02-19 04:31:49,953 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 584.600000 2021-02-19 04:31:49,960 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:49,986 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 708.387484 2021-02-19 04:31:49,990 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 858.942317 2021-02-19 04:31:50,002 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1483.255023 2021-02-19 04:31:50,216 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:50,361 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 691.100000 2021-02-19 04:31:50,380 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1497.150855 2021-02-19 04:31:50,959 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.800000 2021-02-19 04:31:51,552 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 434.900000 2021-02-19 04:31:51,571 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:51,575 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 584.600000 2021-02-19 04:31:51,641 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1483.255023 2021-02-19 04:31:51,654 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 858.942317 2021-02-19 04:31:51,676 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 708.387484 2021-02-19 04:31:51,836 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:52,006 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 691.100000 2021-02-19 04:31:52,023 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1497.150855 2021-02-19 04:31:52,529 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.800000 2021-02-19 04:31:53,147 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:53,180 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 584.600000 2021-02-19 04:31:53,193 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 434.900000 2021-02-19 04:31:53,221 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1483.255023 2021-02-19 04:31:53,236 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 858.942317 2021-02-19 04:31:53,269 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 708.387484 2021-02-19 04:31:53,405 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:53,596 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 691.100000 2021-02-19 04:31:53,609 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1498.200855 2021-02-19 04:31:54,108 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.800000 2021-02-19 04:31:54,724 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:54,822 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 109.600000 2021-02-19 04:31:54,845 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1483.255023 2021-02-19 04:31:54,859 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 858.942317 2021-02-19 04:31:54,878 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 708.387484 2021-02-19 04:31:54,891 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:31:54,973 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:55,191 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1498.200855 2021-02-19 04:31:55,221 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.700000 2021-02-19 04:31:55,690 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.400000 2021-02-19 04:31:56,355 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:56,448 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 109.600000 2021-02-19 04:31:56,470 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:31:56,484 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:31:56,510 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:31:56,552 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:31:56,578 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:56,769 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1.050000 2021-02-19 04:31:56,808 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.700000 2021-02-19 04:31:57,286 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.400000 2021-02-19 04:31:57,937 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:58,053 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 109.600000 2021-02-19 04:31:58,072 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:31:58,085 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:31:58,121 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:31:58,193 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:31:58,200 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:58,349 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1.050000 2021-02-19 04:31:58,384 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.700000 2021-02-19 04:31:58,857 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.400000 2021-02-19 04:31:59,519 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:31:59,648 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 969.900000 2021-02-19 04:31:59,721 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:31:59,734 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:31:59,753 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:31:59,828 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:31:59,836 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:31:59,940 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1.050000 2021-02-19 04:31:59,980 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3.200000 2021-02-19 04:32:00,434 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:32:01,079 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:01,265 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 969.900000 2021-02-19 04:32:01,312 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:32:01,358 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:32:01,371 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:32:01,450 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:01,467 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:01,533 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1.050000 2021-02-19 04:32:01,568 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3.200000 2021-02-19 04:32:02,013 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:32:02,645 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:02,852 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2416.600000 2021-02-19 04:32:02,905 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:32:02,950 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:32:02,989 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:32:03,035 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:03,063 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:03,107 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7.600000 2021-02-19 04:32:03,164 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6.300000 2021-02-19 04:32:03,621 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:32:04,200 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:04,434 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2416.600000 2021-02-19 04:32:04,487 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:32:04,572 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:32:04,588 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:32:04,657 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:04,665 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:04,700 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7.600000 2021-02-19 04:32:04,743 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6.900000 2021-02-19 04:32:05,197 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:32:05,756 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:06,019 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4146.100000 2021-02-19 04:32:06,066 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:32:06,168 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:32:06,176 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:32:06,250 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:06,257 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:06,286 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7.600000 2021-02-19 04:32:06,322 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6.900000 2021-02-19 04:32:06,785 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:32:07,325 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:07,611 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4146.100000 2021-02-19 04:32:07,657 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:32:07,759 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:32:07,776 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:32:07,835 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:07,875 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:07,885 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7.600000 2021-02-19 04:32:07,938 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6.900000 2021-02-19 04:32:08,362 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:32:08,905 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:09,198 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4146.100000 2021-02-19 04:32:09,224 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:32:09,362 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:32:09,391 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:32:09,434 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:09,477 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7.600000 2021-02-19 04:32:09,502 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:09,532 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 768.100000 2021-02-19 04:32:09,946 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:32:10,471 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:10,802 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5483.200000 2021-02-19 04:32:10,816 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:32:10,944 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:32:11,033 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:32:11,059 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:11,082 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7.600000 2021-02-19 04:32:11,092 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:11,115 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 768.100000 2021-02-19 04:32:11,522 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:32:12,033 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:12,410 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6168.800000 2021-02-19 04:32:12,427 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1846.100000 2021-02-19 04:32:12,528 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 622.100000 2021-02-19 04:32:12,625 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:32:12,645 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:12,661 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8.000000 2021-02-19 04:32:12,707 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:12,719 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2212.800000 2021-02-19 04:32:13,118 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:32:13,598 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:14,019 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1846.100000 2021-02-19 04:32:14,023 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6168.800000 2021-02-19 04:32:14,104 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 622.100000 2021-02-19 04:32:14,213 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:32:14,213 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:14,236 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8.000000 2021-02-19 04:32:14,596 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:14,621 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2211.500000 2021-02-19 04:32:14,778 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:32:15,157 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:15,609 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4329.700000 2021-02-19 04:32:15,617 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4941.600000 2021-02-19 04:32:15,680 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2142.600000 2021-02-19 04:32:15,806 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.200000 2021-02-19 04:32:15,806 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:15,821 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8.100000 2021-02-19 04:32:16,211 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:16,243 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2211.500000 2021-02-19 04:32:16,355 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:32:16,711 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:17,190 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4941.600000 2021-02-19 04:32:17,217 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4329.700000 2021-02-19 04:32:17,296 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2142.600000 2021-02-19 04:32:17,392 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:17,411 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8.100000 2021-02-19 04:32:17,430 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.200000 2021-02-19 04:32:17,813 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:17,838 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2211.500000 2021-02-19 04:32:17,934 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:32:18,266 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:18,786 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4941.600000 2021-02-19 04:32:18,812 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4329.700000 2021-02-19 04:32:18,869 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2142.600000 2021-02-19 04:32:18,986 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:19,007 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8.100000 2021-02-19 04:32:19,026 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.200000 2021-02-19 04:32:19,410 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:19,446 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2211.500000 2021-02-19 04:32:19,536 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:32:19,839 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:20,369 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4941.600000 2021-02-19 04:32:20,395 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2865.600000 2021-02-19 04:32:20,486 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2142.600000 2021-02-19 04:32:20,555 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:20,617 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.200000 2021-02-19 04:32:20,625 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8.100000 2021-02-19 04:32:21,069 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.200000 2021-02-19 04:32:21,085 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2419.200000 2021-02-19 04:32:21,194 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.900000 2021-02-19 04:32:21,404 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:21,941 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4941.600000 2021-02-19 04:32:21,984 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2865.600000 2021-02-19 04:32:22,075 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2142.600000 2021-02-19 04:32:22,135 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:22,230 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.200000 2021-02-19 04:32:22,240 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8.100000 2021-02-19 04:32:22,677 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.900000 2021-02-19 04:32:22,719 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1260.600000 2021-02-19 04:32:22,812 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.400000 2021-02-19 04:32:22,970 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:23,520 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7391.100000 2021-02-19 04:32:23,572 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 947.800000 2021-02-19 04:32:23,654 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4258.200000 2021-02-19 04:32:23,736 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:23,823 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1946.900000 2021-02-19 04:32:23,842 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1344.800000 2021-02-19 04:32:24,276 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2.450000 2021-02-19 04:32:24,329 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1260.600000 2021-02-19 04:32:24,398 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1.400000 2021-02-19 04:32:24,526 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:25,125 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7391.100000 2021-02-19 04:32:25,176 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 949.200000 2021-02-19 04:32:25,242 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4258.200000 2021-02-19 04:32:25,319 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:25,410 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1946.900000 2021-02-19 04:32:25,440 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1344.800000 2021-02-19 04:32:25,872 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2.450000 2021-02-19 04:32:25,976 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1261.800000 2021-02-19 04:32:26,022 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3.300000 2021-02-19 04:32:26,089 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:26,707 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8439.670337 2021-02-19 04:32:26,769 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 949.200000 2021-02-19 04:32:26,842 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5143.634659 2021-02-19 04:32:26,913 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:26,994 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4953.893616 2021-02-19 04:32:27,022 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3367.879049 2021-02-19 04:32:27,477 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2.450000 2021-02-19 04:32:27,589 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1261.800000 2021-02-19 04:32:27,615 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3.300000 2021-02-19 04:32:27,678 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:28,312 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8439.670337 2021-02-19 04:32:28,375 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 949.200000 2021-02-19 04:32:28,428 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5143.634659 2021-02-19 04:32:28,516 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:28,594 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4953.893616 2021-02-19 04:32:28,625 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3367.879049 2021-02-19 04:32:29,086 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2.450000 2021-02-19 04:32:29,203 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1261.800000 2021-02-19 04:32:29,232 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3.300000 2021-02-19 04:32:29,253 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:29,891 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8439.670337 2021-02-19 04:32:29,971 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 860.200000 2021-02-19 04:32:30,032 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5143.634659 2021-02-19 04:32:30,115 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:30,174 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4953.893616 2021-02-19 04:32:30,210 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3367.879049 2021-02-19 04:32:30,687 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.550000 2021-02-19 04:32:30,812 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1064.200000 2021-02-19 04:32:30,828 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3.300000 2021-02-19 04:32:30,842 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:31,470 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8439.670337 2021-02-19 04:32:31,561 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 860.200000 2021-02-19 04:32:31,618 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5143.634659 2021-02-19 04:32:31,756 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:31,766 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4953.893616 2021-02-19 04:32:31,818 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3367.879049 2021-02-19 04:32:32,282 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.050000 2021-02-19 04:32:32,424 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1976.900000 2021-02-19 04:32:32,460 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:32,474 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3.800000 2021-02-19 04:32:33,065 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8287.270337 2021-02-19 04:32:33,164 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1701.600000 2021-02-19 04:32:33,201 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4908.134659 2021-02-19 04:32:33,371 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6895.193616 2021-02-19 04:32:33,400 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:33,446 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4243.879049 2021-02-19 04:32:33,901 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.050000 2021-02-19 04:32:34,055 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:34,081 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1976.900000 2021-02-19 04:32:34,102 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3.800000 2021-02-19 04:32:34,664 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8287.270337 2021-02-19 04:32:34,792 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4908.134659 2021-02-19 04:32:34,796 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3099.300000 2021-02-19 04:32:34,994 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6895.193616 2021-02-19 04:32:35,022 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:35,052 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4243.879049 2021-02-19 04:32:35,486 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.500000 2021-02-19 04:32:35,641 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:35,683 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3510.100000 2021-02-19 04:32:35,709 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 109.900000 2021-02-19 04:32:36,220 | infra | INFO | pool-2-thread-43 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' completed 2021-02-19 04:32:36,221 | infra | INFO | pool-2-thread-43 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:32:36,253 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8397.829166 2021-02-19 04:32:36,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4908.134659 2021-02-19 04:32:36,388 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3099.300000 2021-02-19 04:32:36,585 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7878.991803 2021-02-19 04:32:36,605 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:36,667 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4387.049805 2021-02-19 04:32:37,075 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.69:8091 2021-02-19 04:32:37,075 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 04:32:37,088 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.500000 2021-02-19 04:32:37,092 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.69:8091 is running 2021-02-19 04:32:37,092 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:37,207 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:37,305 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3510.100000 2021-02-19 04:32:37,305 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 109.900000 2021-02-19 04:32:37,519 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.426000118256. 2021-02-19 04:32:37,519 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:37,832 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8397.829166 2021-02-19 04:32:37,954 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.43499994278. 2021-02-19 04:32:37,959 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:37,990 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5186.115524 2021-02-19 04:32:38,002 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3099.300000 2021-02-19 04:32:38,174 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7878.991803 2021-02-19 04:32:38,198 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:38,296 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4387.049805 2021-02-19 04:32:38,421 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.461999893188. 2021-02-19 04:32:38,421 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:38,677 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.500000 2021-02-19 04:32:38,782 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:38,892 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.470999956131. 2021-02-19 04:32:38,892 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:38,908 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 109.900000 2021-02-19 04:32:38,927 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3510.100000 2021-02-19 04:32:39,349 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.457000017166. 2021-02-19 04:32:39,349 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:39,417 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8397.829166 2021-02-19 04:32:39,565 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5186.115524 2021-02-19 04:32:39,589 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3893.700000 2021-02-19 04:32:39,765 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7878.991803 2021-02-19 04:32:39,793 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.444000005722. 2021-02-19 04:32:39,795 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:39,796 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:39,905 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4387.049805 2021-02-19 04:32:40,246 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.200000 2021-02-19 04:32:40,266 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.471999883652. 2021-02-19 04:32:40,266 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:40,354 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:40,540 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1383.900000 2021-02-19 04:32:40,559 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4237.800000 2021-02-19 04:32:40,696 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.429000139236. 2021-02-19 04:32:40,696 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:41,000 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8397.829166 2021-02-19 04:32:41,144 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.447999954224. 2021-02-19 04:32:41,144 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:41,167 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5186.115524 2021-02-19 04:32:41,190 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3893.700000 2021-02-19 04:32:41,351 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7878.991803 2021-02-19 04:32:41,365 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:41,500 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4387.049805 2021-02-19 04:32:41,625 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.480999946594. 2021-02-19 04:32:41,648 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.64:8091 2021-02-19 04:32:41,648 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 04:32:41,670 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.64:8091 is running 2021-02-19 04:32:41,670 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:41,855 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.200000 2021-02-19 04:32:41,924 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:42,105 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.43499994278. 2021-02-19 04:32:42,105 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:42,137 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1383.900000 2021-02-19 04:32:42,154 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4237.800000 2021-02-19 04:32:42,565 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.459000110626. 2021-02-19 04:32:42,565 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:42,615 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7511.529166 2021-02-19 04:32:42,795 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5086.915524 2021-02-19 04:32:42,819 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4285.900000 2021-02-19 04:32:42,993 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7920.991803 2021-02-19 04:32:43,006 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:43,039 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.473000049591. 2021-02-19 04:32:43,039 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:43,142 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4257.649805 2021-02-19 04:32:43,493 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.453000068665. 2021-02-19 04:32:43,493 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:43,493 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:43,576 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:43,792 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3397.900000 2021-02-19 04:32:43,812 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4523.800000 2021-02-19 04:32:43,931 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.438999891281. 2021-02-19 04:32:43,933 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:43,959 | infra | INFO | pool-2-thread-26 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' completed 2021-02-19 04:32:43,960 | infra | INFO | pool-2-thread-26 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' started 2021-02-19 04:32:44,232 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7511.529166 2021-02-19 04:32:44,404 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.471999883652. 2021-02-19 04:32:44,404 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:44,444 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5086.915524 2021-02-19 04:32:44,463 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4285.900000 2021-02-19 04:32:44,619 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7920.991803 2021-02-19 04:32:44,641 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:44,778 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4257.649805 2021-02-19 04:32:44,861 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.457000017166. 2021-02-19 04:32:44,861 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:45,124 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:45,210 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:45,308 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.446000099182. 2021-02-19 04:32:45,309 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:45,473 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5712.600000 2021-02-19 04:32:45,496 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4462.300000 2021-02-19 04:32:45,769 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.460000038147. 2021-02-19 04:32:45,769 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:45,871 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5885.500000 2021-02-19 04:32:46,099 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4725.600000 2021-02-19 04:32:46,115 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4282.200000 2021-02-19 04:32:46,219 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.449000120163. 2021-02-19 04:32:46,240 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.68:8091 2021-02-19 04:32:46,240 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 04:32:46,253 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7770.100000 2021-02-19 04:32:46,263 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.68:8091 is running 2021-02-19 04:32:46,263 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:46,289 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:46,431 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4257.649805 2021-02-19 04:32:46,687 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.424000024796. 2021-02-19 04:32:46,687 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:46,755 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:46,826 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:47,125 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5712.600000 2021-02-19 04:32:47,151 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4462.300000 2021-02-19 04:32:47,151 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.463000059128. 2021-02-19 04:32:47,151 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:47,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5885.500000 2021-02-19 04:32:47,595 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.443000078201. 2021-02-19 04:32:47,595 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:47,750 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4725.600000 2021-02-19 04:32:47,773 | infra | INFO | pool-2-thread-23 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' completed 2021-02-19 04:32:47,773 | infra | INFO | pool-2-thread-23 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:32:47,776 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4282.200000 2021-02-19 04:32:47,920 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7770.100000 2021-02-19 04:32:47,950 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:48,046 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.451999902725. 2021-02-19 04:32:48,046 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:48,072 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4119.100000 2021-02-19 04:32:48,401 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:48,440 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:48,457 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.411000013351. 2021-02-19 04:32:48,457 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:48,805 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5712.600000 2021-02-19 04:32:48,806 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4462.300000 2021-02-19 04:32:48,864 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.406000137329. 2021-02-19 04:32:48,865 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:49,137 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5885.500000 2021-02-19 04:32:49,292 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.427000045776. 2021-02-19 04:32:49,292 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:49,428 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4725.600000 2021-02-19 04:32:49,444 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4282.200000 2021-02-19 04:32:49,582 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7770.100000 2021-02-19 04:32:49,608 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:49,746 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.453000068665. 2021-02-19 04:32:49,746 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:49,766 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4119.100000 2021-02-19 04:32:50,046 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:50,065 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:50,170 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.423000097275. 2021-02-19 04:32:50,170 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:32:50,463 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7009.500000 2021-02-19 04:32:50,470 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4410.200000 2021-02-19 04:32:50,578 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.408999919891. 2021-02-19 04:32:50,578 | test | INFO | MainThread | [Magma:abort_rebalance:927] Restarting Rebalance after killing at 40 2021-02-19 04:32:50,632 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[]_OUT=[172.23.110.65]_1613737970.58 2021-02-19 04:32:50,634 | infra | INFO | pool-1-thread-1 | [task:start_task:84] Thread 'Rebalance_task_IN=[]_OUT=[172.23.110.65]_1613737970.58' started 2021-02-19 04:32:50,648 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L932 2021-02-19 04:32:50,648 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 120 seconds. Reason: Let the rebalance begin after abort 2021-02-19 04:32:50,671 | test | DEBUG | pool-1-thread-1 | [task:start_rebalance:301] Removing node 172.23.110.65:8091 from cluster 2021-02-19 04:32:50,671 | test | DEBUG | pool-1-thread-1 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.68,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': u'ns_1@172.23.110.65', 'user': 'Administrator'} 2021-02-19 04:32:50,710 | test | DEBUG | pool-1-thread-1 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 04:32:50,717 | test | INFO | pool-1-thread-1 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+---------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 16.276619655 | Cluster node | | 172.23.110.68 | kv | 7.0.0-4498-enterprise | 7.3005069602 | Cluster node | | 172.23.110.69 | kv | 7.0.0-4498-enterprise | 10.1269721277 | Cluster node | | 172.23.110.65 | kv | 7.0.0-4498-enterprise | 10.0721940846 | --- OUT ---> | +---------------+----------+-----------------------+---------------+--------------+ 2021-02-19 04:32:50,729 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 04:32:50,729 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 04:32:50,788 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5885.500000 2021-02-19 04:32:51,099 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4725.600000 2021-02-19 04:32:51,114 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4674.200000 2021-02-19 04:32:51,239 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7770.100000 2021-02-19 04:32:51,255 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:51,440 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4119.100000 2021-02-19 04:32:51,693 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:51,716 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:52,124 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7009.500000 2021-02-19 04:32:52,153 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4410.200000 2021-02-19 04:32:52,398 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4783.900000 2021-02-19 04:32:52,703 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4855.000000 2021-02-19 04:32:52,746 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5405.600000 2021-02-19 04:32:52,855 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7422.400000 2021-02-19 04:32:52,894 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:53,062 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2739.300000 2021-02-19 04:32:53,312 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:53,325 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:53,769 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7633.800000 2021-02-19 04:32:53,796 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4412.800000 2021-02-19 04:32:54,002 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4783.900000 2021-02-19 04:32:54,336 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4855.000000 2021-02-19 04:32:54,359 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5405.600000 2021-02-19 04:32:54,454 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7422.400000 2021-02-19 04:32:54,493 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:54,676 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2739.300000 2021-02-19 04:32:54,921 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:54,937 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:55,378 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7896.700000 2021-02-19 04:32:55,404 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4442.500000 2021-02-19 04:32:55,605 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4319.200000 2021-02-19 04:32:55,769 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 40.24 % 2021-02-19 04:32:55,769 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 40.2417895096 2021-02-19 04:32:55,957 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5136.400000 2021-02-19 04:32:55,970 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6457.500000 2021-02-19 04:32:56,063 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6703.200000 2021-02-19 04:32:56,101 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:56,302 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 864.200000 2021-02-19 04:32:56,523 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:56,546 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:56,851 | infra | INFO | pool-2-thread-60 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' completed 2021-02-19 04:32:56,851 | infra | INFO | pool-2-thread-60 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:32:57,000 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7896.700000 2021-02-19 04:32:57,026 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4442.500000 2021-02-19 04:32:57,220 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4319.200000 2021-02-19 04:32:57,578 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5136.400000 2021-02-19 04:32:57,586 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6457.500000 2021-02-19 04:32:57,726 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6703.200000 2021-02-19 04:32:57,756 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:57,921 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 864.200000 2021-02-19 04:32:58,161 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:58,180 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:32:58,644 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7896.700000 2021-02-19 04:32:58,651 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4442.500000 2021-02-19 04:32:58,841 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4319.200000 2021-02-19 04:32:59,200 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5136.400000 2021-02-19 04:32:59,207 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6457.500000 2021-02-19 04:32:59,339 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6703.200000 2021-02-19 04:32:59,365 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:32:59,536 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 864.200000 2021-02-19 04:32:59,772 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:32:59,799 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:33:00,257 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7976.800000 2021-02-19 04:33:00,273 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4600.500000 2021-02-19 04:33:00,453 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4319.200000 2021-02-19 04:33:00,819 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5136.400000 2021-02-19 04:33:00,819 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 40.69 % 2021-02-19 04:33:00,819 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 40.6941276768 2021-02-19 04:33:00,836 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7029.800000 2021-02-19 04:33:00,948 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6703.200000 2021-02-19 04:33:00,971 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:01,167 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 864.200000 2021-02-19 04:33:01,375 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:01,444 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:33:01,877 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7976.800000 2021-02-19 04:33:01,901 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4600.500000 2021-02-19 04:33:02,056 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4319.200000 2021-02-19 04:33:02,440 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5335.300000 2021-02-19 04:33:02,447 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7127.000000 2021-02-19 04:33:02,607 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5160.800000 2021-02-19 04:33:02,628 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:02,786 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 152.800000 2021-02-19 04:33:02,980 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:03,053 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.400000 2021-02-19 04:33:03,490 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7898.300000 2021-02-19 04:33:03,525 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4741.700000 2021-02-19 04:33:03,676 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4090.300000 2021-02-19 04:33:04,049 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7127.000000 2021-02-19 04:33:04,076 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5335.300000 2021-02-19 04:33:04,233 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:04,279 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5160.800000 2021-02-19 04:33:04,428 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 152.800000 2021-02-19 04:33:04,584 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:04,688 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 204.200000 2021-02-19 04:33:05,155 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7717.400000 2021-02-19 04:33:05,183 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4855.200000 2021-02-19 04:33:05,289 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4090.300000 2021-02-19 04:33:05,670 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6891.600000 2021-02-19 04:33:05,694 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5442.600000 2021-02-19 04:33:05,845 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:05,864 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 41.18 % 2021-02-19 04:33:05,864 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 41.1767604617 2021-02-19 04:33:05,900 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3996.100000 2021-02-19 04:33:06,055 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:06,188 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:06,305 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 204.200000 2021-02-19 04:33:06,789 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7717.400000 2021-02-19 04:33:06,812 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4855.200000 2021-02-19 04:33:06,898 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3761.100000 2021-02-19 04:33:07,292 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6891.600000 2021-02-19 04:33:07,325 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5442.600000 2021-02-19 04:33:07,470 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:07,523 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3996.100000 2021-02-19 04:33:07,709 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:07,799 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:07,933 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 204.200000 2021-02-19 04:33:08,404 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7717.400000 2021-02-19 04:33:08,427 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4855.200000 2021-02-19 04:33:08,526 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3761.100000 2021-02-19 04:33:08,904 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6891.600000 2021-02-19 04:33:08,957 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5442.600000 2021-02-19 04:33:09,078 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:09,088 | infra | INFO | pool-2-thread-37 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 04:33:09,089 | infra | INFO | pool-2-thread-37 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:33:09,150 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3996.100000 2021-02-19 04:33:09,351 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:09,438 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:09,556 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 204.200000 2021-02-19 04:33:10,022 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7491.300000 2021-02-19 04:33:10,055 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4864.400000 2021-02-19 04:33:10,176 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3761.100000 2021-02-19 04:33:10,515 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6832.000000 2021-02-19 04:33:10,575 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5442.600000 2021-02-19 04:33:10,717 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:10,795 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3996.100000 2021-02-19 04:33:10,917 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 41.61 % 2021-02-19 04:33:10,917 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 41.6066370945 2021-02-19 04:33:10,997 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:11,081 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:11,190 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1010.100000 2021-02-19 04:33:11,660 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7491.300000 2021-02-19 04:33:11,690 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4864.400000 2021-02-19 04:33:11,792 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3761.100000 2021-02-19 04:33:12,128 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6832.000000 2021-02-19 04:33:12,223 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5442.600000 2021-02-19 04:33:12,380 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:12,460 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3768.700000 2021-02-19 04:33:12,641 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:12,717 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:12,826 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2143.500000 2021-02-19 04:33:13,289 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7354.400000 2021-02-19 04:33:13,315 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4805.100000 2021-02-19 04:33:13,408 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3835.400000 2021-02-19 04:33:13,747 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6999.900000 2021-02-19 04:33:13,854 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5299.900000 2021-02-19 04:33:14,045 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:14,131 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3768.700000 2021-02-19 04:33:14,279 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:14,342 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:14,487 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2143.500000 2021-02-19 04:33:14,926 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7216.800000 2021-02-19 04:33:14,940 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4745.500000 2021-02-19 04:33:15,036 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3835.400000 2021-02-19 04:33:15,368 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7177.200000 2021-02-19 04:33:15,454 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5299.900000 2021-02-19 04:33:15,654 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:15,747 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3598.264371 2021-02-19 04:33:15,950 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:15,956 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 42.06 % 2021-02-19 04:33:15,957 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 42.0584305995 2021-02-19 04:33:15,999 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:16,111 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3103.600000 2021-02-19 04:33:16,598 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4745.500000 2021-02-19 04:33:16,601 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7216.800000 2021-02-19 04:33:16,645 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4499.152631 2021-02-19 04:33:17,005 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7177.200000 2021-02-19 04:33:17,075 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5083.358910 2021-02-19 04:33:17,259 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:17,369 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3598.264371 2021-02-19 04:33:17,585 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:17,618 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:17,752 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3103.600000 2021-02-19 04:33:18,247 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4745.500000 2021-02-19 04:33:18,298 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7216.800000 2021-02-19 04:33:18,312 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4499.152631 2021-02-19 04:33:18,624 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7177.200000 2021-02-19 04:33:18,680 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5083.358910 2021-02-19 04:33:18,868 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:19,003 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3598.264371 2021-02-19 04:33:19,236 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:19,253 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:19,403 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3103.600000 2021-02-19 04:33:19,920 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4628.900000 2021-02-19 04:33:19,947 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4499.152631 2021-02-19 04:33:19,976 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7063.700000 2021-02-19 04:33:20,276 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7084.700000 2021-02-19 04:33:20,299 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5083.358910 2021-02-19 04:33:20,482 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:20,618 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3598.264371 2021-02-19 04:33:20,835 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:20,901 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:21,002 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 42.46 % 2021-02-19 04:33:21,003 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 42.4633742618 2021-02-19 04:33:21,066 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3413.000000 2021-02-19 04:33:21,569 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4499.152631 2021-02-19 04:33:21,582 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4628.900000 2021-02-19 04:33:21,632 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7063.700000 2021-02-19 04:33:21,917 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7084.700000 2021-02-19 04:33:21,937 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5083.358910 2021-02-19 04:33:22,115 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:22,259 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3598.264371 2021-02-19 04:33:22,428 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:22,558 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:22,743 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3366.100000 2021-02-19 04:33:23,194 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5915.452631 2021-02-19 04:33:23,279 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4553.300000 2021-02-19 04:33:23,318 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6836.300000 2021-02-19 04:33:23,543 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4811.558910 2021-02-19 04:33:23,558 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6859.300000 2021-02-19 04:33:23,716 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:23,875 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3569.964371 2021-02-19 04:33:24,029 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:24,176 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:24,375 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3366.100000 2021-02-19 04:33:24,835 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5915.452631 2021-02-19 04:33:24,903 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4516.200000 2021-02-19 04:33:24,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6660.000000 2021-02-19 04:33:25,164 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4811.558910 2021-02-19 04:33:25,183 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6737.000000 2021-02-19 04:33:25,328 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:25,492 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3569.964371 2021-02-19 04:33:25,632 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:25,799 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:25,997 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3302.600000 2021-02-19 04:33:26,053 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 42.94 % 2021-02-19 04:33:26,053 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 42.9440115613 2021-02-19 04:33:26,459 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6785.927176 2021-02-19 04:33:26,517 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4516.200000 2021-02-19 04:33:26,572 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6660.000000 2021-02-19 04:33:26,779 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4650.367064 2021-02-19 04:33:26,799 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6737.000000 2021-02-19 04:33:26,950 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:27,098 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3565.528088 2021-02-19 04:33:27,246 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:27,441 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:27,614 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3302.600000 2021-02-19 04:33:28,069 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6785.927176 2021-02-19 04:33:28,141 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4516.200000 2021-02-19 04:33:28,242 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6660.000000 2021-02-19 04:33:28,397 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4650.367064 2021-02-19 04:33:28,447 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6737.000000 2021-02-19 04:33:28,588 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:28,765 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3565.528088 2021-02-19 04:33:28,887 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:29,065 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:29,216 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3302.600000 2021-02-19 04:33:29,698 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6785.927176 2021-02-19 04:33:29,759 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4576.200000 2021-02-19 04:33:29,859 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6539.300000 2021-02-19 04:33:30,012 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4650.367064 2021-02-19 04:33:30,095 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6942.500000 2021-02-19 04:33:30,223 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:30,463 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3565.528088 2021-02-19 04:33:30,546 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:30,700 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:30,842 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3288.200000 2021-02-19 04:33:31,095 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 43.43 % 2021-02-19 04:33:31,096 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 43.434947713 2021-02-19 04:33:31,358 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6785.927176 2021-02-19 04:33:31,411 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4576.200000 2021-02-19 04:33:31,532 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6539.300000 2021-02-19 04:33:31,617 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4650.367064 2021-02-19 04:33:31,707 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6942.500000 2021-02-19 04:33:31,819 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:32,085 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3565.528088 2021-02-19 04:33:32,164 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:32,322 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:32,451 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3313.400000 2021-02-19 04:33:32,966 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6792.727176 2021-02-19 04:33:33,078 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4646.100000 2021-02-19 04:33:33,161 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6478.800000 2021-02-19 04:33:33,224 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4705.267064 2021-02-19 04:33:33,319 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7184.700000 2021-02-19 04:33:33,417 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:33,734 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3566.828088 2021-02-19 04:33:33,815 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:33,951 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:34,075 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3313.400000 2021-02-19 04:33:34,599 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6792.727176 2021-02-19 04:33:34,704 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4672.500000 2021-02-19 04:33:34,792 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6407.900000 2021-02-19 04:33:34,861 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4705.267064 2021-02-19 04:33:34,956 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7318.900000 2021-02-19 04:33:35,020 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:35,388 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3566.828088 2021-02-19 04:33:35,418 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:35,595 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:35,686 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3316.200000 2021-02-19 04:33:36,144 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 43.78 % 2021-02-19 04:33:36,144 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 43.7841820684 2021-02-19 04:33:36,223 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6889.500000 2021-02-19 04:33:36,335 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4672.500000 2021-02-19 04:33:36,444 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6407.900000 2021-02-19 04:33:36,473 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4735.300000 2021-02-19 04:33:36,584 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7318.900000 2021-02-19 04:33:36,618 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:37,026 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3576.400000 2021-02-19 04:33:37,033 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:37,210 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:37,319 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3316.200000 2021-02-19 04:33:37,825 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6889.500000 2021-02-19 04:33:37,960 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4672.500000 2021-02-19 04:33:38,055 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6407.900000 2021-02-19 04:33:38,089 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4735.300000 2021-02-19 04:33:38,223 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7318.900000 2021-02-19 04:33:38,246 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:38,647 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3576.400000 2021-02-19 04:33:38,654 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:38,844 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:38,934 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3316.200000 2021-02-19 04:33:39,436 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6889.500000 2021-02-19 04:33:39,601 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4672.500000 2021-02-19 04:33:39,696 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6421.300000 2021-02-19 04:33:39,707 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4735.300000 2021-02-19 04:33:39,842 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7165.100000 2021-02-19 04:33:39,861 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:40,260 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3576.400000 2021-02-19 04:33:40,276 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:40,476 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:40,552 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3316.500000 2021-02-19 04:33:41,062 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6889.500000 2021-02-19 04:33:41,186 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 44.19 % 2021-02-19 04:33:41,187 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 44.1865340745 2021-02-19 04:33:41,220 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4676.300000 2021-02-19 04:33:41,315 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6421.300000 2021-02-19 04:33:41,335 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4735.300000 2021-02-19 04:33:41,492 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7165.100000 2021-02-19 04:33:41,496 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:41,897 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3576.400000 2021-02-19 04:33:41,900 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:42,101 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:42,165 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3316.500000 2021-02-19 04:33:42,671 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6926.900000 2021-02-19 04:33:42,839 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4674.700000 2021-02-19 04:33:42,943 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6457.100000 2021-02-19 04:33:42,967 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4693.400000 2021-02-19 04:33:43,108 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:43,128 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6942.300000 2021-02-19 04:33:43,542 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3578.600000 2021-02-19 04:33:43,546 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:43,753 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:43,782 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3306.800000 2021-02-19 04:33:44,276 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6926.900000 2021-02-19 04:33:44,476 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4674.700000 2021-02-19 04:33:44,586 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6457.100000 2021-02-19 04:33:44,598 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4693.400000 2021-02-19 04:33:44,721 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:44,750 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6786.400000 2021-02-19 04:33:45,147 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3578.600000 2021-02-19 04:33:45,163 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:45,384 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:45,400 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3301.800000 2021-02-19 04:33:45,901 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6896.800000 2021-02-19 04:33:46,161 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4704.200000 2021-02-19 04:33:46,230 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4654.400000 2021-02-19 04:33:46,242 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 44.54 % 2021-02-19 04:33:46,243 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 44.5395361637 2021-02-19 04:33:46,276 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6504.900000 2021-02-19 04:33:46,345 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:46,394 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6786.400000 2021-02-19 04:33:46,792 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:46,795 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3547.600000 2021-02-19 04:33:47,019 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:47,023 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3301.800000 2021-02-19 04:33:47,523 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6896.800000 2021-02-19 04:33:47,806 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4704.200000 2021-02-19 04:33:47,858 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4654.400000 2021-02-19 04:33:47,927 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6504.900000 2021-02-19 04:33:47,960 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:48,028 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6786.400000 2021-02-19 04:33:48,404 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:48,446 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3547.600000 2021-02-19 04:33:48,670 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:48,671 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3301.800000 2021-02-19 04:33:49,130 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6896.800000 2021-02-19 04:33:49,437 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4704.200000 2021-02-19 04:33:49,483 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4654.400000 2021-02-19 04:33:49,561 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6504.900000 2021-02-19 04:33:49,595 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:49,664 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6786.400000 2021-02-19 04:33:50,002 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:50,053 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3547.600000 2021-02-19 04:33:50,296 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3301.300000 2021-02-19 04:33:50,319 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:50,755 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6896.800000 2021-02-19 04:33:51,062 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4683.500000 2021-02-19 04:33:51,105 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4654.400000 2021-02-19 04:33:51,187 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6494.700000 2021-02-19 04:33:51,200 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:51,289 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 44.90 % 2021-02-19 04:33:51,289 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 44.8988976427 2021-02-19 04:33:51,296 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6689.600000 2021-02-19 04:33:51,625 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:51,684 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3547.600000 2021-02-19 04:33:51,760 | infra | INFO | pool-2-thread-30 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' completed 2021-02-19 04:33:51,762 | infra | INFO | pool-2-thread-30 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope4_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:33:51,924 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3301.300000 2021-02-19 04:33:51,950 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:52,359 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6762.300000 2021-02-19 04:33:52,704 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4679.600000 2021-02-19 04:33:52,733 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4672.900000 2021-02-19 04:33:52,839 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6486.800000 2021-02-19 04:33:52,868 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:52,928 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6717.700000 2021-02-19 04:33:53,236 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:53,305 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3470.800000 2021-02-19 04:33:53,545 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3318.100000 2021-02-19 04:33:53,576 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:53,980 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6762.300000 2021-02-19 04:33:54,371 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4675.485763 2021-02-19 04:33:54,384 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4672.900000 2021-02-19 04:33:54,493 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6486.800000 2021-02-19 04:33:54,494 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:54,561 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6717.700000 2021-02-19 04:33:54,848 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:54,921 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3470.800000 2021-02-19 04:33:55,154 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3326.978584 2021-02-19 04:33:55,187 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:55,591 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6762.300000 2021-02-19 04:33:56,009 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4675.485763 2021-02-19 04:33:56,016 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4734.000000 2021-02-19 04:33:56,118 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:56,141 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6505.462727 2021-02-19 04:33:56,180 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6756.743151 2021-02-19 04:33:56,344 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 45.25 % 2021-02-19 04:33:56,344 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 45.2518997319 2021-02-19 04:33:56,448 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:56,545 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3445.900000 2021-02-19 04:33:56,765 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3326.978584 2021-02-19 04:33:56,805 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:57,209 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6429.600000 2021-02-19 04:33:57,621 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4675.485763 2021-02-19 04:33:57,677 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4734.000000 2021-02-19 04:33:57,743 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:57,763 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6505.462727 2021-02-19 04:33:57,845 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6756.743151 2021-02-19 04:33:58,066 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:58,177 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3445.900000 2021-02-19 04:33:58,401 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3326.978584 2021-02-19 04:33:58,450 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:33:58,822 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6429.600000 2021-02-19 04:33:59,242 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4675.485763 2021-02-19 04:33:59,332 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4734.000000 2021-02-19 04:33:59,348 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:33:59,382 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6610.662727 2021-02-19 04:33:59,505 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6756.743151 2021-02-19 04:33:59,677 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:33:59,792 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3445.900000 2021-02-19 04:34:00,019 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3337.478584 2021-02-19 04:34:00,091 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:00,424 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6429.600000 2021-02-19 04:34:00,890 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4773.785763 2021-02-19 04:34:00,954 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4734.000000 2021-02-19 04:34:00,966 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:01,015 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6610.662727 2021-02-19 04:34:01,138 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6804.543151 2021-02-19 04:34:01,309 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:01,391 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 45.58 % 2021-02-19 04:34:01,392 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 45.5809780283 2021-02-19 04:34:01,424 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3445.900000 2021-02-19 04:34:01,645 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3337.478584 2021-02-19 04:34:01,729 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:02,040 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6429.600000 2021-02-19 04:34:02,490 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4899.879575 2021-02-19 04:34:02,575 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4794.677307 2021-02-19 04:34:02,578 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:02,638 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6766.866696 2021-02-19 04:34:02,765 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6826.056687 2021-02-19 04:34:02,928 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:03,028 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3577.547206 2021-02-19 04:34:03,270 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3336.543105 2021-02-19 04:34:03,394 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:03,664 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5209.168120 2021-02-19 04:34:04,122 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4899.879575 2021-02-19 04:34:04,216 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:04,230 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4794.677307 2021-02-19 04:34:04,273 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6943.976663 2021-02-19 04:34:04,391 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6871.979569 2021-02-19 04:34:04,533 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:04,637 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3577.547206 2021-02-19 04:34:04,891 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3354.989626 2021-02-19 04:34:05,030 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:05,269 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5209.168120 2021-02-19 04:34:05,726 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5009.229919 2021-02-19 04:34:05,828 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:05,851 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4856.877307 2021-02-19 04:34:05,890 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6943.976663 2021-02-19 04:34:06,013 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6871.979569 2021-02-19 04:34:06,144 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:06,250 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3734.847206 2021-02-19 04:34:06,441 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 45.94 % 2021-02-19 04:34:06,441 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 45.9403395074 2021-02-19 04:34:06,506 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3354.989626 2021-02-19 04:34:06,674 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:06,898 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4007.568120 2021-02-19 04:34:07,335 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5009.229919 2021-02-19 04:34:07,451 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:07,483 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4856.877307 2021-02-19 04:34:07,526 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6943.976663 2021-02-19 04:34:07,665 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6871.979569 2021-02-19 04:34:07,759 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:07,865 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3734.847206 2021-02-19 04:34:08,125 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3354.989626 2021-02-19 04:34:08,303 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:08,500 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4007.568120 2021-02-19 04:34:08,960 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5009.229919 2021-02-19 04:34:09,053 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:09,095 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4856.877307 2021-02-19 04:34:09,147 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6943.976663 2021-02-19 04:34:09,296 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6871.979569 2021-02-19 04:34:09,361 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:09,480 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3734.847206 2021-02-19 04:34:09,744 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3388.589626 2021-02-19 04:34:09,963 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:10,128 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4007.568120 2021-02-19 04:34:10,585 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5015.429919 2021-02-19 04:34:10,674 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:10,750 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4856.877307 2021-02-19 04:34:10,805 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6984.876663 2021-02-19 04:34:10,953 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6911.079569 2021-02-19 04:34:10,973 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:11,095 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3734.847206 2021-02-19 04:34:11,365 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3388.589626 2021-02-19 04:34:11,477 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 46.26 % 2021-02-19 04:34:11,479 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 46.2625538251 2021-02-19 04:34:11,594 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:11,732 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4007.568120 2021-02-19 04:34:12,194 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5015.429919 2021-02-19 04:34:12,319 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:12,391 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4936.846684 2021-02-19 04:34:12,447 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6981.167613 2021-02-19 04:34:12,568 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6838.630763 2021-02-19 04:34:12,592 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:12,716 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3780.366450 2021-02-19 04:34:12,989 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3417.269188 2021-02-19 04:34:13,209 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:13,348 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3790.766840 2021-02-19 04:34:13,801 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4988.434197 2021-02-19 04:34:13,940 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:14,009 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4936.846684 2021-02-19 04:34:14,053 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6981.167613 2021-02-19 04:34:14,170 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6651.064729 2021-02-19 04:34:14,198 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:14,335 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3780.366450 2021-02-19 04:34:14,599 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3417.269188 2021-02-19 04:34:14,826 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:14,953 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3790.766840 2021-02-19 04:34:15,407 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4999.598089 2021-02-19 04:34:15,548 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:15,645 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4936.846684 2021-02-19 04:34:15,684 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6889.594918 2021-02-19 04:34:15,783 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6651.064729 2021-02-19 04:34:15,811 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:15,961 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3463.266450 2021-02-19 04:34:16,203 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3472.244083 2021-02-19 04:34:16,440 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:16,516 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 46.53 % 2021-02-19 04:34:16,516 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 46.5252109555 2021-02-19 04:34:16,559 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3502.766840 2021-02-19 04:34:17,026 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4999.598089 2021-02-19 04:34:17,247 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:17,309 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4615.546684 2021-02-19 04:34:17,322 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6889.594918 2021-02-19 04:34:17,427 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6651.064729 2021-02-19 04:34:17,446 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:17,605 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3463.266450 2021-02-19 04:34:17,825 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3472.244083 2021-02-19 04:34:18,062 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:18,184 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3502.766840 2021-02-19 04:34:18,647 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4999.598089 2021-02-19 04:34:18,859 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:18,947 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4615.546684 2021-02-19 04:34:19,003 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6889.594918 2021-02-19 04:34:19,059 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:19,092 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6651.064729 2021-02-19 04:34:19,232 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3463.266450 2021-02-19 04:34:19,444 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3472.244083 2021-02-19 04:34:19,724 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:19,834 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3502.766840 2021-02-19 04:34:20,289 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5160.898089 2021-02-19 04:34:20,492 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:20,601 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4615.546684 2021-02-19 04:34:20,624 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7001.894918 2021-02-19 04:34:20,711 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:20,733 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6593.764729 2021-02-19 04:34:20,855 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3463.266450 2021-02-19 04:34:21,051 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3606.444083 2021-02-19 04:34:21,352 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:21,444 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3502.766840 2021-02-19 04:34:21,559 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 46.87 % 2021-02-19 04:34:21,559 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 46.8723582437 2021-02-19 04:34:21,911 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5160.898089 2021-02-19 04:34:22,088 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:22,255 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4615.546684 2021-02-19 04:34:22,260 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7001.894918 2021-02-19 04:34:22,345 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:22,361 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6626.900000 2021-02-19 04:34:22,477 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2225.300000 2021-02-19 04:34:22,686 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3750.000000 2021-02-19 04:34:23,019 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:23,059 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3117.100000 2021-02-19 04:34:23,523 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5353.500000 2021-02-19 04:34:23,694 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:23,871 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3429.800000 2021-02-19 04:34:23,905 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7109.100000 2021-02-19 04:34:23,957 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:23,986 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6626.900000 2021-02-19 04:34:24,092 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2225.300000 2021-02-19 04:34:24,309 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3843.500000 2021-02-19 04:34:24,701 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:24,759 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3117.100000 2021-02-19 04:34:25,148 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5464.100000 2021-02-19 04:34:25,323 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:25,523 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3429.800000 2021-02-19 04:34:25,552 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7238.200000 2021-02-19 04:34:25,585 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:25,627 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6716.100000 2021-02-19 04:34:25,720 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1603.600000 2021-02-19 04:34:25,920 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3843.500000 2021-02-19 04:34:26,345 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:26,368 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3286.600000 2021-02-19 04:34:26,599 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 47.15 % 2021-02-19 04:34:26,601 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 47.1540935438 2021-02-19 04:34:26,779 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5464.100000 2021-02-19 04:34:26,944 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:27,138 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2985.500000 2021-02-19 04:34:27,177 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7238.200000 2021-02-19 04:34:27,203 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:27,259 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6716.100000 2021-02-19 04:34:27,378 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1603.600000 2021-02-19 04:34:27,529 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3843.500000 2021-02-19 04:34:28,015 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:28,026 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3286.600000 2021-02-19 04:34:28,388 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5464.100000 2021-02-19 04:34:28,555 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:28,752 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2985.500000 2021-02-19 04:34:28,857 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7238.200000 2021-02-19 04:34:28,858 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:28,917 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6716.100000 2021-02-19 04:34:29,009 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1603.600000 2021-02-19 04:34:29,144 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3843.500000 2021-02-19 04:34:29,650 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3286.600000 2021-02-19 04:34:29,674 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:29,986 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5351.100000 2021-02-19 04:34:30,147 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:30,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2985.500000 2021-02-19 04:34:30,500 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:30,513 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7229.300000 2021-02-19 04:34:30,581 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6777.700000 2021-02-19 04:34:30,612 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1603.600000 2021-02-19 04:34:30,763 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3715.000000 2021-02-19 04:34:31,269 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3286.600000 2021-02-19 04:34:31,296 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:31,608 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5351.100000 2021-02-19 04:34:31,661 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 47.35 % 2021-02-19 04:34:31,661 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 47.3495205966 2021-02-19 04:34:31,750 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:32,000 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2985.500000 2021-02-19 04:34:32,109 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:32,142 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7229.300000 2021-02-19 04:34:32,217 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6777.700000 2021-02-19 04:34:32,233 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1603.600000 2021-02-19 04:34:32,384 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3572.000000 2021-02-19 04:34:32,905 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3815.000000 2021-02-19 04:34:32,921 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:33,233 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5209.700000 2021-02-19 04:34:33,349 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:33,625 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4155.400000 2021-02-19 04:34:33,740 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:33,782 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7278.700000 2021-02-19 04:34:33,872 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7031.800000 2021-02-19 04:34:33,881 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2969.400000 2021-02-19 04:34:34,009 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3572.000000 2021-02-19 04:34:34,526 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3815.000000 2021-02-19 04:34:34,542 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:34,859 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5116.916194 2021-02-19 04:34:34,954 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:35,253 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4155.400000 2021-02-19 04:34:35,368 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:35,407 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7413.285766 2021-02-19 04:34:35,493 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7427.848860 2021-02-19 04:34:35,523 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2969.400000 2021-02-19 04:34:35,638 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3419.951220 2021-02-19 04:34:36,147 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4106.400000 2021-02-19 04:34:36,174 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:36,506 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5116.916194 2021-02-19 04:34:36,582 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:36,707 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 47.52 % 2021-02-19 04:34:36,707 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 47.5205192678 2021-02-19 04:34:36,858 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4884.500000 2021-02-19 04:34:36,999 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:37,038 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7413.285766 2021-02-19 04:34:37,112 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7427.848860 2021-02-19 04:34:37,145 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4076.500000 2021-02-19 04:34:37,273 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3419.951220 2021-02-19 04:34:37,765 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4106.400000 2021-02-19 04:34:37,802 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:38,177 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5116.916194 2021-02-19 04:34:38,207 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:38,497 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4884.500000 2021-02-19 04:34:38,622 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:38,667 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7413.285766 2021-02-19 04:34:38,739 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7427.848860 2021-02-19 04:34:38,775 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4076.500000 2021-02-19 04:34:38,891 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3419.951220 2021-02-19 04:34:39,382 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4106.400000 2021-02-19 04:34:39,428 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:39,838 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5091.216194 2021-02-19 04:34:39,855 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:40,101 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4884.500000 2021-02-19 04:34:40,243 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:40,309 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7513.185766 2021-02-19 04:34:40,382 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7911.248860 2021-02-19 04:34:40,404 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4076.500000 2021-02-19 04:34:40,519 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3394.351220 2021-02-19 04:34:40,990 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4106.400000 2021-02-19 04:34:41,063 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:41,467 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5091.216194 2021-02-19 04:34:41,473 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:41,714 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4884.500000 2021-02-19 04:34:41,752 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 47.74 % 2021-02-19 04:34:41,752 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 47.7403747022 2021-02-19 04:34:41,858 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:41,921 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7513.185766 2021-02-19 04:34:42,016 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7911.248860 2021-02-19 04:34:42,036 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4076.500000 2021-02-19 04:34:42,131 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3394.351220 2021-02-19 04:34:42,619 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4117.300000 2021-02-19 04:34:42,690 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:43,086 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:43,094 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5032.416194 2021-02-19 04:34:43,374 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4844.200000 2021-02-19 04:34:43,513 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:43,585 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7558.085766 2021-02-19 04:34:43,671 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4099.700000 2021-02-19 04:34:43,691 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8130.848860 2021-02-19 04:34:43,767 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3386.051220 2021-02-19 04:34:44,227 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4117.300000 2021-02-19 04:34:44,335 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:44,700 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:44,729 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4962.855982 2021-02-19 04:34:44,990 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4844.200000 2021-02-19 04:34:45,117 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:45,210 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7536.605642 2021-02-19 04:34:45,282 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4099.700000 2021-02-19 04:34:45,325 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8197.777911 2021-02-19 04:34:45,388 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3396.653021 2021-02-19 04:34:45,831 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4087.600000 2021-02-19 04:34:45,974 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:46,312 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:46,342 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4962.855982 2021-02-19 04:34:46,605 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4894.300000 2021-02-19 04:34:46,753 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:46,796 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 47.91 % 2021-02-19 04:34:46,798 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 47.9113733734 2021-02-19 04:34:46,848 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7536.605642 2021-02-19 04:34:46,898 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4060.500000 2021-02-19 04:34:47,009 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3396.653021 2021-02-19 04:34:47,009 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8197.777911 2021-02-19 04:34:47,447 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4087.600000 2021-02-19 04:34:47,598 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:47,924 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:47,954 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4962.855982 2021-02-19 04:34:48,209 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4894.300000 2021-02-19 04:34:48,378 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:48,503 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7536.605642 2021-02-19 04:34:48,520 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4060.500000 2021-02-19 04:34:48,638 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8197.777911 2021-02-19 04:34:48,640 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3396.653021 2021-02-19 04:34:49,055 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4087.600000 2021-02-19 04:34:49,229 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:49,540 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:49,607 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4962.855982 2021-02-19 04:34:49,828 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4894.300000 2021-02-19 04:34:49,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:50,130 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7601.505642 2021-02-19 04:34:50,148 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4060.500000 2021-02-19 04:34:50,239 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8106.677911 2021-02-19 04:34:50,273 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3386.253021 2021-02-19 04:34:50,667 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 48.11 % 2021-02-19 04:34:50,668 | test | INFO | MainThread | [Magma:abort_rebalance:933] Rebalance % = 48.1068004261 2021-02-19 04:34:50,684 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 48.11 % 2021-02-19 04:34:50,694 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4087.600000 2021-02-19 04:34:50,698 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:34:50,698 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:34:50,851 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:51,144 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:51,216 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4941.055982 2021-02-19 04:34:51,427 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4894.300000 2021-02-19 04:34:51,611 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:51,765 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4060.500000 2021-02-19 04:34:51,776 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7601.505642 2021-02-19 04:34:51,845 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 48.14 % 2021-02-19 04:34:51,845 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 48.1434429985 2021-02-19 04:34:51,880 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8106.677911 2021-02-19 04:34:51,915 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3386.253021 2021-02-19 04:34:52,303 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4091.000000 2021-02-19 04:34:52,467 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:52,739 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:52,832 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4949.155982 2021-02-19 04:34:53,028 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4920.300000 2021-02-19 04:34:53,240 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:53,395 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4053.000000 2021-02-19 04:34:53,457 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7638.205642 2021-02-19 04:34:53,598 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8081.877911 2021-02-19 04:34:53,601 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3368.353021 2021-02-19 04:34:53,934 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4091.000000 2021-02-19 04:34:54,125 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:54,336 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:54,447 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4993.600000 2021-02-19 04:34:54,628 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4920.300000 2021-02-19 04:34:54,887 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:55,046 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4053.000000 2021-02-19 04:34:55,091 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7642.300000 2021-02-19 04:34:55,214 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8077.600000 2021-02-19 04:34:55,226 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3350.800000 2021-02-19 04:34:55,558 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4091.000000 2021-02-19 04:34:55,769 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:55,940 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:56,109 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4993.600000 2021-02-19 04:34:56,196 | infra | INFO | pool-2-thread-57 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:34:56,197 | infra | INFO | pool-2-thread-57 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope2_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:34:56,262 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4888.755067 2021-02-19 04:34:56,542 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:56,714 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4069.842786 2021-02-19 04:34:56,739 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7642.300000 2021-02-19 04:34:56,841 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8077.600000 2021-02-19 04:34:56,871 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3350.800000 2021-02-19 04:34:56,907 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 48.44 % 2021-02-19 04:34:56,908 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 48.4365835777 2021-02-19 04:34:57,167 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4083.344733 2021-02-19 04:34:57,401 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:57,539 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:57,792 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4993.600000 2021-02-19 04:34:57,885 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4888.755067 2021-02-19 04:34:58,148 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:58,325 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4069.842786 2021-02-19 04:34:58,362 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7642.300000 2021-02-19 04:34:58,463 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8077.600000 2021-02-19 04:34:58,525 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3350.800000 2021-02-19 04:34:58,783 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4083.344733 2021-02-19 04:34:59,023 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:34:59,138 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:34:59,430 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5012.500000 2021-02-19 04:34:59,489 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4888.755067 2021-02-19 04:34:59,765 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:34:59,934 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4069.842786 2021-02-19 04:35:00,003 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7676.200000 2021-02-19 04:35:00,098 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8076.700000 2021-02-19 04:35:00,154 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3354.200000 2021-02-19 04:35:00,388 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4083.344733 2021-02-19 04:35:00,657 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:00,730 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 48.52 % 2021-02-19 04:35:00,742 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:00,749 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:35:00,749 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:35:01,108 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5012.500000 2021-02-19 04:35:01,132 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4888.755067 2021-02-19 04:35:01,375 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:01,561 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4069.842786 2021-02-19 04:35:01,621 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7676.200000 2021-02-19 04:35:01,744 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8076.700000 2021-02-19 04:35:01,779 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3354.200000 2021-02-19 04:35:01,957 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 48.56 % 2021-02-19 04:35:01,957 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 48.5587254857 2021-02-19 04:35:02,022 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4083.344733 2021-02-19 04:35:02,276 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:02,362 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:02,732 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5002.900000 2021-02-19 04:35:02,762 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4852.355067 2021-02-19 04:35:02,971 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:03,190 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4037.342786 2021-02-19 04:35:03,279 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7828.800000 2021-02-19 04:35:03,372 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8029.800000 2021-02-19 04:35:03,451 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3369.200000 2021-02-19 04:35:03,621 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4030.244733 2021-02-19 04:35:03,895 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:03,980 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:04,342 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4913.800000 2021-02-19 04:35:04,374 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4852.355067 2021-02-19 04:35:04,582 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:04,813 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4037.342786 2021-02-19 04:35:04,921 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8100.100000 2021-02-19 04:35:04,993 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7955.500000 2021-02-19 04:35:05,088 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3410.000000 2021-02-19 04:35:05,247 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4030.244733 2021-02-19 04:35:05,516 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:05,595 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:05,974 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4913.800000 2021-02-19 04:35:05,983 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4910.331898 2021-02-19 04:35:06,187 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:06,441 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3981.974161 2021-02-19 04:35:06,585 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8100.100000 2021-02-19 04:35:06,628 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7955.500000 2021-02-19 04:35:06,726 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3410.000000 2021-02-19 04:35:06,862 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3972.268302 2021-02-19 04:35:07,029 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 48.72 % 2021-02-19 04:35:07,029 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 48.7175099661 2021-02-19 04:35:07,148 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:07,217 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:07,582 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4913.800000 2021-02-19 04:35:07,645 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4910.331898 2021-02-19 04:35:07,828 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:08,068 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3981.974161 2021-02-19 04:35:08,232 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8100.100000 2021-02-19 04:35:08,259 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7955.500000 2021-02-19 04:35:08,344 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3410.000000 2021-02-19 04:35:08,471 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3972.268302 2021-02-19 04:35:08,757 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:08,831 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:09,194 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4913.800000 2021-02-19 04:35:09,266 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4910.331898 2021-02-19 04:35:09,437 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:09,690 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3981.974161 2021-02-19 04:35:09,861 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8381.100000 2021-02-19 04:35:09,914 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7835.300000 2021-02-19 04:35:09,987 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3492.100000 2021-02-19 04:35:10,101 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3972.268302 2021-02-19 04:35:10,394 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:10,438 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:10,765 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 48.85 % 2021-02-19 04:35:10,778 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:35:10,778 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:35:10,808 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4834.800000 2021-02-19 04:35:10,872 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4910.331898 2021-02-19 04:35:11,042 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:11,305 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3981.974161 2021-02-19 04:35:11,556 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8381.100000 2021-02-19 04:35:11,621 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7835.300000 2021-02-19 04:35:11,667 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3492.100000 2021-02-19 04:35:11,717 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3972.268302 2021-02-19 04:35:12,055 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:12,055 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:12,069 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 48.91 % 2021-02-19 04:35:12,069 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 48.9129370189 2021-02-19 04:35:12,436 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4776.700000 2021-02-19 04:35:12,499 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5052.331898 2021-02-19 04:35:12,680 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:12,924 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3979.874161 2021-02-19 04:35:13,230 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8593.200000 2021-02-19 04:35:13,250 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7788.800000 2021-02-19 04:35:13,331 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3929.068302 2021-02-19 04:35:13,345 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3549.900000 2021-02-19 04:35:13,673 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:13,687 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:14,059 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4776.700000 2021-02-19 04:35:14,121 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5052.331898 2021-02-19 04:35:14,318 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:14,539 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3979.874161 2021-02-19 04:35:14,865 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8717.100000 2021-02-19 04:35:14,895 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7783.900000 2021-02-19 04:35:14,930 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3929.068302 2021-02-19 04:35:14,994 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3581.900000 2021-02-19 04:35:15,280 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:15,315 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:15,690 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4765.000000 2021-02-19 04:35:15,746 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5093.900000 2021-02-19 04:35:15,977 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:16,148 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4013.200000 2021-02-19 04:35:16,500 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8717.100000 2021-02-19 04:35:16,546 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7783.900000 2021-02-19 04:35:16,578 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3911.000000 2021-02-19 04:35:16,650 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3581.900000 2021-02-19 04:35:16,884 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:16,924 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:17,115 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 49.07 % 2021-02-19 04:35:17,115 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 49.0717214993 2021-02-19 04:35:17,292 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4765.000000 2021-02-19 04:35:17,368 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5093.900000 2021-02-19 04:35:17,566 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:17,763 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4013.200000 2021-02-19 04:35:18,150 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8717.100000 2021-02-19 04:35:18,176 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7783.900000 2021-02-19 04:35:18,203 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3911.000000 2021-02-19 04:35:18,306 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3581.900000 2021-02-19 04:35:18,493 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:18,551 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:18,947 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4765.000000 2021-02-19 04:35:18,996 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5093.900000 2021-02-19 04:35:19,174 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:19,371 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4013.200000 2021-02-19 04:35:19,782 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8770.200000 2021-02-19 04:35:19,849 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3911.000000 2021-02-19 04:35:19,865 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7805.000000 2021-02-19 04:35:19,951 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3552.900000 2021-02-19 04:35:20,114 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:20,180 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:20,555 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4769.000000 2021-02-19 04:35:20,599 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5093.900000 2021-02-19 04:35:20,783 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:20,796 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 49.22 % 2021-02-19 04:35:20,809 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:35:20,809 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:35:20,992 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4013.200000 2021-02-19 04:35:21,404 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8770.200000 2021-02-19 04:35:21,459 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3911.000000 2021-02-19 04:35:21,493 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7805.000000 2021-02-19 04:35:21,588 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3552.900000 2021-02-19 04:35:21,727 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:21,805 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:22,163 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 49.28 % 2021-02-19 04:35:22,164 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 49.2793627429 2021-02-19 04:35:22,197 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4769.000000 2021-02-19 04:35:22,269 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5093.900000 2021-02-19 04:35:22,421 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:22,595 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4024.600000 2021-02-19 04:35:23,038 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8776.600000 2021-02-19 04:35:23,078 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3942.100000 2021-02-19 04:35:23,150 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7795.700000 2021-02-19 04:35:23,243 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3546.000000 2021-02-19 04:35:23,332 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:23,427 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:23,816 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4745.200000 2021-02-19 04:35:23,891 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5051.500000 2021-02-19 04:35:24,055 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:24,210 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4024.600000 2021-02-19 04:35:24,724 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8776.600000 2021-02-19 04:35:24,762 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3942.100000 2021-02-19 04:35:24,779 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7753.300000 2021-02-19 04:35:24,888 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3546.100000 2021-02-19 04:35:24,957 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:25,082 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:25,437 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4731.500000 2021-02-19 04:35:25,494 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5051.500000 2021-02-19 04:35:25,661 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:25,815 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3990.700000 2021-02-19 04:35:26,348 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8764.800000 2021-02-19 04:35:26,368 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3956.600000 2021-02-19 04:35:26,420 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7753.300000 2021-02-19 04:35:26,543 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3546.100000 2021-02-19 04:35:26,559 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:26,709 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:27,079 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4731.500000 2021-02-19 04:35:27,119 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5094.900000 2021-02-19 04:35:27,201 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 49.44 % 2021-02-19 04:35:27,201 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 49.4381472232 2021-02-19 04:35:27,266 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:27,411 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3990.700000 2021-02-19 04:35:27,986 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3956.600000 2021-02-19 04:35:28,007 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8764.800000 2021-02-19 04:35:28,092 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7753.300000 2021-02-19 04:35:28,165 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:28,190 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3546.100000 2021-02-19 04:35:28,344 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:28,688 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4731.500000 2021-02-19 04:35:28,727 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5094.900000 2021-02-19 04:35:28,888 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:29,023 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3990.700000 2021-02-19 04:35:29,621 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3956.600000 2021-02-19 04:35:29,671 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8764.800000 2021-02-19 04:35:29,742 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7753.300000 2021-02-19 04:35:29,812 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:29,835 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3583.600000 2021-02-19 04:35:29,980 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:30,323 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4669.400000 2021-02-19 04:35:30,335 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5094.900000 2021-02-19 04:35:30,493 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:30,674 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3990.700000 2021-02-19 04:35:30,823 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 49.58 % 2021-02-19 04:35:30,841 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:35:30,842 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:35:31,240 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3956.600000 2021-02-19 04:35:31,309 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8714.900000 2021-02-19 04:35:31,375 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7770.600000 2021-02-19 04:35:31,437 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:31,492 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3583.600000 2021-02-19 04:35:31,611 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:31,950 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4669.400000 2021-02-19 04:35:31,966 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5094.900000 2021-02-19 04:35:32,101 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:32,249 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 49.72 % 2021-02-19 04:35:32,250 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 49.7190736116 2021-02-19 04:35:32,292 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3982.000000 2021-02-19 04:35:32,855 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3988.600000 2021-02-19 04:35:32,944 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8691.900000 2021-02-19 04:35:33,026 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7778.800000 2021-02-19 04:35:33,069 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:33,135 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3596.100000 2021-02-19 04:35:33,267 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:33,588 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4641.600000 2021-02-19 04:35:33,604 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5176.000000 2021-02-19 04:35:33,710 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:33,907 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3982.000000 2021-02-19 04:35:34,467 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3988.600000 2021-02-19 04:35:34,558 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8691.900000 2021-02-19 04:35:34,637 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7778.800000 2021-02-19 04:35:34,674 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:34,763 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3596.100000 2021-02-19 04:35:34,891 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:35,216 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5176.000000 2021-02-19 04:35:35,220 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4626.100000 2021-02-19 04:35:35,326 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:35,513 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3982.000000 2021-02-19 04:35:36,075 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4015.000000 2021-02-19 04:35:36,233 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8689.100000 2021-02-19 04:35:36,309 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7799.900000 2021-02-19 04:35:36,325 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:36,415 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3596.700000 2021-02-19 04:35:36,515 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:36,835 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5153.200000 2021-02-19 04:35:36,844 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4626.100000 2021-02-19 04:35:36,936 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:37,117 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3987.700000 2021-02-19 04:35:37,302 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 49.80 % 2021-02-19 04:35:37,302 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 49.8045729472 2021-02-19 04:35:37,701 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4015.000000 2021-02-19 04:35:37,846 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8689.100000 2021-02-19 04:35:37,964 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:37,999 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7799.900000 2021-02-19 04:35:38,092 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3596.700000 2021-02-19 04:35:38,134 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:38,459 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5153.200000 2021-02-19 04:35:38,477 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4626.100000 2021-02-19 04:35:38,559 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:38,744 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3987.700000 2021-02-19 04:35:39,315 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4015.000000 2021-02-19 04:35:39,476 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8718.900000 2021-02-19 04:35:39,562 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:39,625 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7799.900000 2021-02-19 04:35:39,721 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3596.700000 2021-02-19 04:35:39,775 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:40,109 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5153.200000 2021-02-19 04:35:40,128 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4697.100000 2021-02-19 04:35:40,194 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:40,367 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3987.700000 2021-02-19 04:35:40,854 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.00 % 2021-02-19 04:35:40,865 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:35:40,865 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:35:40,934 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4015.000000 2021-02-19 04:35:41,131 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8718.900000 2021-02-19 04:35:41,167 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:41,280 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7644.900000 2021-02-19 04:35:41,392 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3571.300000 2021-02-19 04:35:41,415 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:41,739 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5153.200000 2021-02-19 04:35:41,763 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4697.100000 2021-02-19 04:35:41,802 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:41,967 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3987.700000 2021-02-19 04:35:42,354 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.00 % 2021-02-19 04:35:42,354 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 50.0 2021-02-19 04:35:42,532 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3990.800000 2021-02-19 04:35:42,799 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8758.800000 2021-02-19 04:35:42,802 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:42,927 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7437.600000 2021-02-19 04:35:43,046 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3562.200000 2021-02-19 04:35:43,068 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:43,362 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5045.100000 2021-02-19 04:35:43,395 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4793.100000 2021-02-19 04:35:43,427 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:43,578 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4010.700000 2021-02-19 04:35:44,151 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3990.800000 2021-02-19 04:35:44,424 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:44,440 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8802.200000 2021-02-19 04:35:44,601 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7437.600000 2021-02-19 04:35:44,694 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:44,701 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3562.200000 2021-02-19 04:35:45,013 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5045.100000 2021-02-19 04:35:45,039 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4892.000000 2021-02-19 04:35:45,069 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:45,187 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4010.700000 2021-02-19 04:35:45,766 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4016.600000 2021-02-19 04:35:46,043 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:46,069 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8802.200000 2021-02-19 04:35:46,230 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7297.900000 2021-02-19 04:35:46,345 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:46,351 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3567.900000 2021-02-19 04:35:46,651 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4992.000000 2021-02-19 04:35:46,690 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4892.000000 2021-02-19 04:35:46,697 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:46,799 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4116.600000 2021-02-19 04:35:47,375 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4016.600000 2021-02-19 04:35:47,407 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.00 % 2021-02-19 04:35:47,407 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 50.0 2021-02-19 04:35:47,684 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:47,714 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8802.200000 2021-02-19 04:35:47,865 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7297.900000 2021-02-19 04:35:47,984 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3567.900000 2021-02-19 04:35:48,000 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:48,279 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4992.000000 2021-02-19 04:35:48,328 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:48,338 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4892.000000 2021-02-19 04:35:48,413 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4116.600000 2021-02-19 04:35:48,983 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4016.600000 2021-02-19 04:35:49,319 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:49,364 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8802.200000 2021-02-19 04:35:49,490 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7461.700000 2021-02-19 04:35:49,627 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3567.900000 2021-02-19 04:35:49,648 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:49,898 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4992.000000 2021-02-19 04:35:49,957 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:49,993 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4931.900000 2021-02-19 04:35:50,029 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4116.600000 2021-02-19 04:35:50,595 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4016.600000 2021-02-19 04:35:50,878 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.00 % 2021-02-19 04:35:50,891 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:35:50,891 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:35:50,924 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:50,974 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8777.200000 2021-02-19 04:35:51,154 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7461.700000 2021-02-19 04:35:51,315 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3545.600000 2021-02-19 04:35:51,322 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:51,520 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4992.000000 2021-02-19 04:35:51,565 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:51,634 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4931.900000 2021-02-19 04:35:51,638 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4116.600000 2021-02-19 04:35:51,973 | infra | INFO | pool-2-thread-39 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:35:51,973 | infra | INFO | pool-2-thread-39 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:35:52,214 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4016.600000 2021-02-19 04:35:52,454 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.00 % 2021-02-19 04:35:52,454 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 50.0 2021-02-19 04:35:52,519 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:52,596 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8719.800000 2021-02-19 04:35:52,772 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7764.400000 2021-02-19 04:35:52,941 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3505.300000 2021-02-19 04:35:52,963 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:53,151 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4993.200000 2021-02-19 04:35:53,207 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:53,250 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4148.400000 2021-02-19 04:35:53,289 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4915.000000 2021-02-19 04:35:53,834 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4044.400000 2021-02-19 04:35:54,118 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:54,259 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8606.900000 2021-02-19 04:35:54,418 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7924.000000 2021-02-19 04:35:54,565 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3505.300000 2021-02-19 04:35:54,601 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:54,750 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4993.200000 2021-02-19 04:35:54,831 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:54,907 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4148.400000 2021-02-19 04:35:54,941 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4821.900000 2021-02-19 04:35:55,441 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3959.700000 2021-02-19 04:35:55,711 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:55,878 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8606.900000 2021-02-19 04:35:56,032 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7924.000000 2021-02-19 04:35:56,194 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3436.200000 2021-02-19 04:35:56,255 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:56,400 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4950.600000 2021-02-19 04:35:56,437 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:56,565 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3952.700000 2021-02-19 04:35:56,572 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4821.900000 2021-02-19 04:35:57,038 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3959.700000 2021-02-19 04:35:57,316 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:57,506 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8606.900000 2021-02-19 04:35:57,509 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.42 % 2021-02-19 04:35:57,509 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 50.4210686772 2021-02-19 04:35:57,651 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7924.000000 2021-02-19 04:35:57,887 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3436.200000 2021-02-19 04:35:57,944 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:58,003 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4950.600000 2021-02-19 04:35:58,035 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:58,197 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4821.900000 2021-02-19 04:35:58,197 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3952.700000 2021-02-19 04:35:58,637 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3959.700000 2021-02-19 04:35:58,905 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:35:59,151 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8606.900000 2021-02-19 04:35:59,288 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7924.000000 2021-02-19 04:35:59,529 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3471.300000 2021-02-19 04:35:59,576 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:35:59,608 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4950.600000 2021-02-19 04:35:59,648 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:35:59,835 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3952.700000 2021-02-19 04:35:59,848 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4811.800000 2021-02-19 04:36:00,243 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3959.700000 2021-02-19 04:36:00,525 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:00,755 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8460.000000 2021-02-19 04:36:00,904 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.74 % 2021-02-19 04:36:00,911 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7825.800000 2021-02-19 04:36:00,918 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:36:00,918 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:36:01,161 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3471.300000 2021-02-19 04:36:01,206 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:01,220 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4950.600000 2021-02-19 04:36:01,272 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:01,469 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4811.800000 2021-02-19 04:36:01,470 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3952.700000 2021-02-19 04:36:01,842 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3959.700000 2021-02-19 04:36:02,121 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:02,371 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8272.900000 2021-02-19 04:36:02,536 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7663.900000 2021-02-19 04:36:02,552 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 50.87 % 2021-02-19 04:36:02,552 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 50.8709697137 2021-02-19 04:36:02,792 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3557.100000 2021-02-19 04:36:02,844 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5023.000000 2021-02-19 04:36:02,858 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:02,872 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:03,086 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4881.800000 2021-02-19 04:36:03,138 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3075.600000 2021-02-19 04:36:03,467 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3874.200000 2021-02-19 04:36:03,736 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:03,990 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8272.900000 2021-02-19 04:36:04,164 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7663.900000 2021-02-19 04:36:04,404 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3718.200000 2021-02-19 04:36:04,480 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5023.000000 2021-02-19 04:36:04,489 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:04,516 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:04,719 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4881.800000 2021-02-19 04:36:04,770 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3075.600000 2021-02-19 04:36:05,073 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3874.200000 2021-02-19 04:36:05,332 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:05,619 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8112.300000 2021-02-19 04:36:05,809 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7595.400000 2021-02-19 04:36:06,026 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3718.200000 2021-02-19 04:36:06,127 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:06,135 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5242.500000 2021-02-19 04:36:06,171 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:06,325 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5079.500000 2021-02-19 04:36:06,384 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2218.800000 2021-02-19 04:36:06,677 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3867.900000 2021-02-19 04:36:06,933 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:07,257 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8112.300000 2021-02-19 04:36:07,446 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7595.400000 2021-02-19 04:36:07,595 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 51.36 % 2021-02-19 04:36:07,595 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 51.3570087338 2021-02-19 04:36:07,683 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3718.200000 2021-02-19 04:36:07,759 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5242.500000 2021-02-19 04:36:07,796 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:07,812 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:07,967 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5079.500000 2021-02-19 04:36:08,005 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2218.800000 2021-02-19 04:36:08,278 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3867.900000 2021-02-19 04:36:08,529 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:08,862 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8112.300000 2021-02-19 04:36:09,051 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7595.400000 2021-02-19 04:36:09,342 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3718.200000 2021-02-19 04:36:09,380 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5242.500000 2021-02-19 04:36:09,421 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:09,499 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:09,602 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5079.500000 2021-02-19 04:36:09,627 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2218.800000 2021-02-19 04:36:09,871 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3867.900000 2021-02-19 04:36:10,174 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:10,483 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8073.987844 2021-02-19 04:36:10,694 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7659.725542 2021-02-19 04:36:10,930 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 51.65 % 2021-02-19 04:36:10,941 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:36:10,941 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:36:10,963 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3805.415065 2021-02-19 04:36:10,996 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5242.500000 2021-02-19 04:36:11,039 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:11,115 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:11,227 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5223.367540 2021-02-19 04:36:11,250 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2310.472498 2021-02-19 04:36:11,467 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3867.900000 2021-02-19 04:36:11,801 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:12,098 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8073.987844 2021-02-19 04:36:12,315 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7690.825542 2021-02-19 04:36:12,632 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3859.115065 2021-02-19 04:36:12,640 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5407.000000 2021-02-19 04:36:12,657 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 51.79 % 2021-02-19 04:36:12,657 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 51.7922355786 2021-02-19 04:36:12,667 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:12,766 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:12,848 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2018.172498 2021-02-19 04:36:12,880 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5263.367540 2021-02-19 04:36:13,089 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3820.300000 2021-02-19 04:36:13,411 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:13,709 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8116.587844 2021-02-19 04:36:13,930 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7690.825542 2021-02-19 04:36:14,263 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3867.856077 2021-02-19 04:36:14,278 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:14,302 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5407.000000 2021-02-19 04:36:14,391 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:14,453 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2057.558321 2021-02-19 04:36:14,532 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5239.920649 2021-02-19 04:36:14,720 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3820.300000 2021-02-19 04:36:15,019 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:15,305 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8181.241173 2021-02-19 04:36:15,563 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7706.014225 2021-02-19 04:36:15,892 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:15,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3867.856077 2021-02-19 04:36:15,982 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5469.600000 2021-02-19 04:36:16,026 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:16,105 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1789.058321 2021-02-19 04:36:16,154 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5239.920649 2021-02-19 04:36:16,329 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3779.700000 2021-02-19 04:36:16,627 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:16,934 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8181.241173 2021-02-19 04:36:17,197 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7706.014225 2021-02-19 04:36:17,515 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:17,536 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3867.856077 2021-02-19 04:36:17,605 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5469.600000 2021-02-19 04:36:17,670 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:17,700 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 52.22 % 2021-02-19 04:36:17,700 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 52.2206098798 2021-02-19 04:36:17,743 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1789.058321 2021-02-19 04:36:17,849 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5239.920649 2021-02-19 04:36:17,927 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3779.700000 2021-02-19 04:36:18,223 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:18,549 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8181.241173 2021-02-19 04:36:18,802 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7706.014225 2021-02-19 04:36:19,141 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:19,171 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3867.856077 2021-02-19 04:36:19,213 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5469.600000 2021-02-19 04:36:19,283 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:19,361 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1789.058321 2021-02-19 04:36:19,480 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5194.653109 2021-02-19 04:36:19,539 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3779.700000 2021-02-19 04:36:19,826 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:20,171 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8195.553329 2021-02-19 04:36:20,431 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7717.788682 2021-02-19 04:36:20,759 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:20,792 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3845.241012 2021-02-19 04:36:20,828 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5469.600000 2021-02-19 04:36:20,908 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:20,956 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 52.52 % 2021-02-19 04:36:20,969 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:36:20,969 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:36:20,994 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1814.785823 2021-02-19 04:36:21,119 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5194.653109 2021-02-19 04:36:21,148 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3779.700000 2021-02-19 04:36:21,427 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:21,792 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8195.553329 2021-02-19 04:36:22,053 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7717.788682 2021-02-19 04:36:22,378 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:22,446 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5365.574185 2021-02-19 04:36:22,447 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3806.290842 2021-02-19 04:36:22,566 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:22,617 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1529.165907 2021-02-19 04:36:22,753 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5219.102100 2021-02-19 04:36:22,763 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 52.66 % 2021-02-19 04:36:22,763 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 52.6641515266 2021-02-19 04:36:22,769 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3868.005579 2021-02-19 04:36:23,029 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:23,427 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8196.904919 2021-02-19 04:36:23,684 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7731.672326 2021-02-19 04:36:23,993 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:24,063 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5365.574185 2021-02-19 04:36:24,088 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3806.290842 2021-02-19 04:36:24,207 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:24,244 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1566.201668 2021-02-19 04:36:24,372 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5216.395339 2021-02-19 04:36:24,394 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3868.005579 2021-02-19 04:36:24,480 | infra | INFO | pool-2-thread-59 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' completed 2021-02-19 04:36:24,482 | infra | INFO | pool-2-thread-59 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:36:24,625 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:25,052 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8178.394558 2021-02-19 04:36:25,303 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7728.394305 2021-02-19 04:36:25,588 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:25,671 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5365.574185 2021-02-19 04:36:25,710 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3751.497860 2021-02-19 04:36:25,887 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1450.601668 2021-02-19 04:36:25,891 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:26,013 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3921.205579 2021-02-19 04:36:26,032 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5216.395339 2021-02-19 04:36:26,217 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:26,690 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8178.394558 2021-02-19 04:36:26,921 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7728.394305 2021-02-19 04:36:27,237 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:27,282 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5251.074185 2021-02-19 04:36:27,341 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3751.497860 2021-02-19 04:36:27,528 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:27,542 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1450.601668 2021-02-19 04:36:27,628 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3921.205579 2021-02-19 04:36:27,661 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5216.395339 2021-02-19 04:36:27,819 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 53.13 % 2021-02-19 04:36:27,819 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 53.128222166 2021-02-19 04:36:27,822 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:27,923 | infra | INFO | pool-2-thread-42 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.4' completed 2021-02-19 04:36:27,924 | infra | INFO | pool-2-thread-42 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:36:28,323 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8178.394558 2021-02-19 04:36:28,551 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7728.394305 2021-02-19 04:36:28,848 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:28,904 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5251.074185 2021-02-19 04:36:28,960 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3751.497860 2021-02-19 04:36:29,165 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1450.601668 2021-02-19 04:36:29,226 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:29,259 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3921.205579 2021-02-19 04:36:29,293 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5216.395339 2021-02-19 04:36:29,457 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:29,941 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8118.993188 2021-02-19 04:36:29,967 | infra | INFO | pool-2-thread-53 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.37' completed 2021-02-19 04:36:29,967 | infra | INFO | pool-2-thread-53 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:36:30,197 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7655.750502 2021-02-19 04:36:30,457 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:30,505 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5251.074185 2021-02-19 04:36:30,582 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3732.770391 2021-02-19 04:36:30,786 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1448.436239 2021-02-19 04:36:30,842 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:30,871 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3921.205579 2021-02-19 04:36:30,914 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5211.912875 2021-02-19 04:36:30,983 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 53.40 % 2021-02-19 04:36:30,997 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:36:30,997 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:36:31,069 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:36:31,562 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8118.993188 2021-02-19 04:36:31,812 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7655.750502 2021-02-19 04:36:32,069 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:32,111 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5251.074185 2021-02-19 04:36:32,207 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3732.770391 2021-02-19 04:36:32,414 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1058.798143 2021-02-19 04:36:32,464 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:32,490 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3759.462072 2021-02-19 04:36:32,546 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5128.798271 2021-02-19 04:36:32,671 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 502.500500 2021-02-19 04:36:32,858 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 53.58 % 2021-02-19 04:36:32,858 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 53.5781117674 2021-02-19 04:36:33,183 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7915.749360 2021-02-19 04:36:33,453 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7579.567979 2021-02-19 04:36:33,696 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:33,727 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5191.513903 2021-02-19 04:36:33,848 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3748.273832 2021-02-19 04:36:34,036 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1058.798143 2021-02-19 04:36:34,092 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:34,109 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3759.462072 2021-02-19 04:36:34,181 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5051.951922 2021-02-19 04:36:34,276 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 502.500500 2021-02-19 04:36:34,802 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7915.749360 2021-02-19 04:36:35,095 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7570.757317 2021-02-19 04:36:35,319 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:35,357 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5191.513903 2021-02-19 04:36:35,482 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3734.825802 2021-02-19 04:36:35,651 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 968.276559 2021-02-19 04:36:35,729 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3759.462072 2021-02-19 04:36:35,743 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:35,825 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5051.951922 2021-02-19 04:36:35,898 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1576.200500 2021-02-19 04:36:36,437 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7709.806391 2021-02-19 04:36:36,724 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7570.757317 2021-02-19 04:36:36,926 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:36,960 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5087.513903 2021-02-19 04:36:37,125 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3734.825802 2021-02-19 04:36:37,276 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 403.676559 2021-02-19 04:36:37,358 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3603.262072 2021-02-19 04:36:37,374 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:37,453 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5051.951922 2021-02-19 04:36:37,506 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1576.200500 2021-02-19 04:36:37,901 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 54.02 % 2021-02-19 04:36:37,901 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 54.0245550603 2021-02-19 04:36:38,059 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7709.806391 2021-02-19 04:36:38,335 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7570.757317 2021-02-19 04:36:38,552 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:38,575 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5087.513903 2021-02-19 04:36:38,775 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3734.825802 2021-02-19 04:36:38,901 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 403.676559 2021-02-19 04:36:38,964 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3603.262072 2021-02-19 04:36:39,006 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:39,101 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5051.951922 2021-02-19 04:36:39,125 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1576.200500 2021-02-19 04:36:39,668 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7709.806391 2021-02-19 04:36:39,946 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7586.701120 2021-02-19 04:36:40,184 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:40,207 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5087.513903 2021-02-19 04:36:40,391 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3684.253271 2021-02-19 04:36:40,507 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 288.441988 2021-02-19 04:36:40,585 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3603.262072 2021-02-19 04:36:40,642 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:40,733 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4892.234387 2021-02-19 04:36:40,753 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1576.200500 2021-02-19 04:36:41,007 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 54.23 % 2021-02-19 04:36:41,019 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:36:41,019 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:36:41,296 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7462.807762 2021-02-19 04:36:41,559 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7586.701120 2021-02-19 04:36:41,786 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:41,826 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5087.513903 2021-02-19 04:36:42,052 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3684.253271 2021-02-19 04:36:42,128 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 288.441988 2021-02-19 04:36:42,209 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3603.262072 2021-02-19 04:36:42,289 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:42,381 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3077.400000 2021-02-19 04:36:42,403 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4791.900000 2021-02-19 04:36:42,931 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7351.600000 2021-02-19 04:36:42,947 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 54.39 % 2021-02-19 04:36:42,948 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 54.3888251061 2021-02-19 04:36:43,180 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7652.000000 2021-02-19 04:36:43,394 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:43,433 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5013.500000 2021-02-19 04:36:43,703 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3628.000000 2021-02-19 04:36:43,765 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 78.500000 2021-02-19 04:36:43,921 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3599.800000 2021-02-19 04:36:43,980 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:44,016 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3077.400000 2021-02-19 04:36:44,048 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4791.900000 2021-02-19 04:36:44,552 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7230.900000 2021-02-19 04:36:44,795 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7652.000000 2021-02-19 04:36:45,009 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:45,053 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5013.500000 2021-02-19 04:36:45,334 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3621.000000 2021-02-19 04:36:45,384 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 61.100000 2021-02-19 04:36:45,548 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3617.265488 2021-02-19 04:36:45,641 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:45,668 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3077.400000 2021-02-19 04:36:45,673 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4708.600000 2021-02-19 04:36:46,167 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7230.900000 2021-02-19 04:36:46,411 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7653.600000 2021-02-19 04:36:46,625 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:46,686 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5029.752047 2021-02-19 04:36:46,954 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3621.000000 2021-02-19 04:36:47,016 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:36:47,167 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3617.265488 2021-02-19 04:36:47,270 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:47,292 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3981.431176 2021-02-19 04:36:47,313 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4708.600000 2021-02-19 04:36:47,786 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7230.900000 2021-02-19 04:36:47,992 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 54.75 % 2021-02-19 04:36:47,993 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 54.754545975 2021-02-19 04:36:48,052 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7653.600000 2021-02-19 04:36:48,239 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:48,296 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5029.752047 2021-02-19 04:36:48,595 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3621.000000 2021-02-19 04:36:48,647 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:36:48,786 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3617.265488 2021-02-19 04:36:48,914 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:48,917 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3981.431176 2021-02-19 04:36:48,947 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4708.600000 2021-02-19 04:36:49,400 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7185.500000 2021-02-19 04:36:49,674 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7653.600000 2021-02-19 04:36:49,851 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:49,914 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5029.752047 2021-02-19 04:36:50,223 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3648.700000 2021-02-19 04:36:50,328 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:36:50,430 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3617.265488 2021-02-19 04:36:50,517 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3981.431176 2021-02-19 04:36:50,543 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:50,572 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4751.600000 2021-02-19 04:36:51,015 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7185.500000 2021-02-19 04:36:51,032 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 54.93 % 2021-02-19 04:36:51,046 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:36:51,046 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:36:51,289 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7675.600000 2021-02-19 04:36:51,460 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:51,513 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5029.752047 2021-02-19 04:36:51,845 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3648.700000 2021-02-19 04:36:52,013 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:36:52,051 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3617.265488 2021-02-19 04:36:52,118 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3981.431176 2021-02-19 04:36:52,183 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:52,207 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4751.600000 2021-02-19 04:36:52,665 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7173.500000 2021-02-19 04:36:52,898 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7661.500000 2021-02-19 04:36:53,059 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 55.07 % 2021-02-19 04:36:53,061 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 55.0655552797 2021-02-19 04:36:53,066 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:53,141 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5123.352047 2021-02-19 04:36:53,464 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3660.400000 2021-02-19 04:36:53,696 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3690.265488 2021-02-19 04:36:53,707 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:36:53,730 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3994.531176 2021-02-19 04:36:53,803 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:53,826 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4808.200000 2021-02-19 04:36:54,286 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7245.200000 2021-02-19 04:36:54,525 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7662.100000 2021-02-19 04:36:54,671 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:54,776 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5123.352047 2021-02-19 04:36:55,082 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3647.500000 2021-02-19 04:36:55,316 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3690.265488 2021-02-19 04:36:55,355 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3994.531176 2021-02-19 04:36:55,378 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:36:55,427 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:55,456 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4856.800000 2021-02-19 04:36:55,914 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7245.200000 2021-02-19 04:36:56,134 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7662.100000 2021-02-19 04:36:56,265 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:56,381 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5150.385800 2021-02-19 04:36:56,710 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3647.500000 2021-02-19 04:36:56,971 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3804.894993 2021-02-19 04:36:56,982 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4071.977248 2021-02-19 04:36:57,039 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:36:57,094 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:57,151 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4856.800000 2021-02-19 04:36:57,523 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7245.200000 2021-02-19 04:36:57,750 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7662.100000 2021-02-19 04:36:57,865 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:57,993 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5150.385800 2021-02-19 04:36:58,108 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 55.45 % 2021-02-19 04:36:58,108 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 55.4498497293 2021-02-19 04:36:58,335 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3647.500000 2021-02-19 04:36:58,592 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3804.894993 2021-02-19 04:36:58,601 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4071.977248 2021-02-19 04:36:58,720 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:36:58,756 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:36:58,795 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4856.800000 2021-02-19 04:36:59,180 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7245.200000 2021-02-19 04:36:59,375 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7662.100000 2021-02-19 04:36:59,460 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:36:59,601 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5150.385800 2021-02-19 04:36:59,973 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3632.800000 2021-02-19 04:37:00,223 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3804.894993 2021-02-19 04:37:00,243 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4071.977248 2021-02-19 04:37:00,413 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:00,423 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:00,463 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4899.000000 2021-02-19 04:37:00,801 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7421.500000 2021-02-19 04:37:00,994 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7697.900000 2021-02-19 04:37:01,059 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:01,061 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 55.65 % 2021-02-19 04:37:01,075 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:37:01,075 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:37:01,220 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5150.385800 2021-02-19 04:37:01,586 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3632.800000 2021-02-19 04:37:01,864 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3804.894993 2021-02-19 04:37:01,881 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4071.977248 2021-02-19 04:37:02,038 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:02,101 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:02,127 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4899.000000 2021-02-19 04:37:02,414 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7546.300000 2021-02-19 04:37:02,627 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7783.600000 2021-02-19 04:37:02,671 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:02,842 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5090.785800 2021-02-19 04:37:03,161 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 55.83 % 2021-02-19 04:37:03,161 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 55.8336395899 2021-02-19 04:37:03,203 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3614.200000 2021-02-19 04:37:03,486 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3840.694993 2021-02-19 04:37:03,492 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4102.277248 2021-02-19 04:37:03,650 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:03,799 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:03,812 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4924.500000 2021-02-19 04:37:04,035 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7546.300000 2021-02-19 04:37:04,259 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7869.600000 2021-02-19 04:37:04,279 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:04,450 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5090.785800 2021-02-19 04:37:04,845 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3614.200000 2021-02-19 04:37:05,099 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3840.694993 2021-02-19 04:37:05,117 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4102.277248 2021-02-19 04:37:05,279 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:05,434 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:05,450 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4934.400000 2021-02-19 04:37:05,605 | infra | INFO | pool-2-thread-34 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 04:37:05,605 | infra | INFO | pool-2-thread-34 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:37:05,686 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7606.800000 2021-02-19 04:37:05,871 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7869.600000 2021-02-19 04:37:05,892 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:06,059 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5080.100000 2021-02-19 04:37:06,473 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3613.100000 2021-02-19 04:37:06,710 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3797.400000 2021-02-19 04:37:06,717 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4084.900000 2021-02-19 04:37:06,897 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:07,066 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:07,086 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4934.400000 2021-02-19 04:37:07,315 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7606.800000 2021-02-19 04:37:07,484 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7869.600000 2021-02-19 04:37:07,513 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:07,703 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5080.100000 2021-02-19 04:37:08,086 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3613.100000 2021-02-19 04:37:08,210 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 56.13 % 2021-02-19 04:37:08,210 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 56.1265799029 2021-02-19 04:37:08,326 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3797.400000 2021-02-19 04:37:08,332 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4084.900000 2021-02-19 04:37:08,528 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:08,704 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:08,713 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4934.400000 2021-02-19 04:37:08,960 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7606.800000 2021-02-19 04:37:09,105 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7869.600000 2021-02-19 04:37:09,137 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:09,322 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5080.100000 2021-02-19 04:37:09,688 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3613.100000 2021-02-19 04:37:09,934 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3797.400000 2021-02-19 04:37:09,961 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4084.900000 2021-02-19 04:37:10,144 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:10,345 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:10,365 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4884.700000 2021-02-19 04:37:10,605 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7536.000000 2021-02-19 04:37:10,726 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7752.200000 2021-02-19 04:37:10,773 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:10,934 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5080.100000 2021-02-19 04:37:11,089 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 56.31 % 2021-02-19 04:37:11,105 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:37:11,105 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:37:11,313 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3586.900000 2021-02-19 04:37:11,555 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3797.400000 2021-02-19 04:37:11,568 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4084.900000 2021-02-19 04:37:11,762 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:11,993 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:12,016 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4884.700000 2021-02-19 04:37:12,233 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7536.000000 2021-02-19 04:37:12,358 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7502.400000 2021-02-19 04:37:12,398 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:12,546 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5075.200000 2021-02-19 04:37:12,927 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3562.100000 2021-02-19 04:37:13,177 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3786.700000 2021-02-19 04:37:13,190 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4102.100000 2021-02-19 04:37:13,249 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 56.44 % 2021-02-19 04:37:13,250 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 56.4370846187 2021-02-19 04:37:13,384 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:13,634 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:13,647 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4850.000000 2021-02-19 04:37:13,865 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7506.300000 2021-02-19 04:37:14,013 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7502.400000 2021-02-19 04:37:14,026 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:14,144 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5075.200000 2021-02-19 04:37:14,535 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3520.500000 2021-02-19 04:37:14,812 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3786.700000 2021-02-19 04:37:14,828 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4102.100000 2021-02-19 04:37:14,993 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:15,279 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:15,289 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4849.400000 2021-02-19 04:37:15,490 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7505.800000 2021-02-19 04:37:15,628 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7185.000000 2021-02-19 04:37:15,638 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:15,746 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5075.200000 2021-02-19 04:37:16,154 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3520.500000 2021-02-19 04:37:16,433 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3853.800000 2021-02-19 04:37:16,447 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4138.800000 2021-02-19 04:37:16,611 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:16,917 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:16,920 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4849.400000 2021-02-19 04:37:17,132 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7505.800000 2021-02-19 04:37:17,249 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:17,270 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7185.000000 2021-02-19 04:37:17,364 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4992.500000 2021-02-19 04:37:17,789 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3520.500000 2021-02-19 04:37:18,065 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3853.800000 2021-02-19 04:37:18,065 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4138.800000 2021-02-19 04:37:18,216 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:18,286 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 56.75 % 2021-02-19 04:37:18,288 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 56.7539487244 2021-02-19 04:37:18,584 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:18,641 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4849.400000 2021-02-19 04:37:18,757 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7505.800000 2021-02-19 04:37:18,848 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:18,881 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7185.000000 2021-02-19 04:37:18,967 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4992.500000 2021-02-19 04:37:19,420 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3523.000000 2021-02-19 04:37:19,681 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3853.800000 2021-02-19 04:37:19,687 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4138.800000 2021-02-19 04:37:19,838 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:20,230 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:20,282 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4860.700000 2021-02-19 04:37:20,405 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7550.100000 2021-02-19 04:37:20,496 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:20,539 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6963.400000 2021-02-19 04:37:20,578 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4992.500000 2021-02-19 04:37:21,049 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3523.000000 2021-02-19 04:37:21,122 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 56.93 % 2021-02-19 04:37:21,135 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:37:21,135 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:37:21,305 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4138.800000 2021-02-19 04:37:21,332 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3853.800000 2021-02-19 04:37:21,440 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:21,914 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:21,976 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4860.700000 2021-02-19 04:37:22,075 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7550.100000 2021-02-19 04:37:22,107 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:22,165 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6963.400000 2021-02-19 04:37:22,197 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4992.500000 2021-02-19 04:37:22,673 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3561.000000 2021-02-19 04:37:22,903 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4129.900000 2021-02-19 04:37:22,940 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3845.100000 2021-02-19 04:37:23,038 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:23,328 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 57.06 % 2021-02-19 04:37:23,328 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 57.0585986393 2021-02-19 04:37:23,559 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:23,631 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4866.200000 2021-02-19 04:37:23,703 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:23,724 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7565.400000 2021-02-19 04:37:23,812 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4901.500000 2021-02-19 04:37:23,841 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6827.100000 2021-02-19 04:37:24,299 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3630.100000 2021-02-19 04:37:24,509 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4129.900000 2021-02-19 04:37:24,549 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3845.100000 2021-02-19 04:37:24,648 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:25,197 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:25,256 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4843.400000 2021-02-19 04:37:25,311 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:25,348 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7543.200000 2021-02-19 04:37:25,426 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4901.500000 2021-02-19 04:37:25,454 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6773.400000 2021-02-19 04:37:25,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3630.100000 2021-02-19 04:37:26,115 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4096.500000 2021-02-19 04:37:26,154 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3783.600000 2021-02-19 04:37:26,253 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:26,835 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:26,900 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4843.400000 2021-02-19 04:37:26,927 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:26,971 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7543.200000 2021-02-19 04:37:27,036 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4849.200000 2021-02-19 04:37:27,082 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6773.400000 2021-02-19 04:37:27,523 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3630.100000 2021-02-19 04:37:27,726 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4096.500000 2021-02-19 04:37:27,763 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3783.600000 2021-02-19 04:37:27,855 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:28,374 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 57.36 % 2021-02-19 04:37:28,374 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 57.3578983422 2021-02-19 04:37:28,480 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:28,532 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4843.400000 2021-02-19 04:37:28,546 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:28,618 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7543.200000 2021-02-19 04:37:28,658 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4849.200000 2021-02-19 04:37:28,723 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6773.400000 2021-02-19 04:37:29,144 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3630.100000 2021-02-19 04:37:29,332 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4096.500000 2021-02-19 04:37:29,390 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3783.600000 2021-02-19 04:37:29,480 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:30,127 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:30,178 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:30,203 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4865.300000 2021-02-19 04:37:30,267 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7587.400000 2021-02-19 04:37:30,286 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4849.200000 2021-02-19 04:37:30,341 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6726.600000 2021-02-19 04:37:30,756 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3635.000000 2021-02-19 04:37:30,937 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4096.500000 2021-02-19 04:37:31,010 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3783.600000 2021-02-19 04:37:31,091 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:31,148 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 57.45 % 2021-02-19 04:37:31,161 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:37:31,161 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:37:31,769 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:31,798 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:31,829 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4865.300000 2021-02-19 04:37:31,917 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7587.400000 2021-02-19 04:37:31,927 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4849.200000 2021-02-19 04:37:31,986 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6726.600000 2021-02-19 04:37:32,380 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3586.200000 2021-02-19 04:37:32,562 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4142.800000 2021-02-19 04:37:32,628 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3907.400000 2021-02-19 04:37:32,713 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:33,378 | infra | INFO | pool-2-thread-37 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:37:33,380 | infra | INFO | pool-2-thread-37 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:37:33,421 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 57.52 % 2021-02-19 04:37:33,421 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 57.5205192678 2021-02-19 04:37:33,430 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:33,431 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:33,469 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4855.100000 2021-02-19 04:37:33,569 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7671.700000 2021-02-19 04:37:33,582 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4757.100000 2021-02-19 04:37:33,622 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6704.900000 2021-02-19 04:37:33,996 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3586.200000 2021-02-19 04:37:34,174 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4142.800000 2021-02-19 04:37:34,240 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3907.400000 2021-02-19 04:37:34,341 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:35,042 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:35,107 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:35,135 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4881.400000 2021-02-19 04:37:35,200 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7876.600000 2021-02-19 04:37:35,219 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4757.100000 2021-02-19 04:37:35,246 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6727.900000 2021-02-19 04:37:35,612 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3500.500000 2021-02-19 04:37:35,782 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4142.800000 2021-02-19 04:37:35,851 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3907.400000 2021-02-19 04:37:35,953 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:36,663 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:36,780 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:36,829 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4881.400000 2021-02-19 04:37:36,868 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4745.257745 2021-02-19 04:37:36,869 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7876.600000 2021-02-19 04:37:36,898 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6727.900000 2021-02-19 04:37:37,214 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3500.500000 2021-02-19 04:37:37,411 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4220.728583 2021-02-19 04:37:37,479 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4079.264501 2021-02-19 04:37:37,565 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:38,319 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:38,464 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4881.400000 2021-02-19 04:37:38,496 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:38,497 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 57.70 % 2021-02-19 04:37:38,499 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 57.7037321298 2021-02-19 04:37:38,502 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4745.257745 2021-02-19 04:37:38,530 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7876.600000 2021-02-19 04:37:38,542 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6727.900000 2021-02-19 04:37:38,823 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3500.500000 2021-02-19 04:37:39,032 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4220.728583 2021-02-19 04:37:39,088 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4079.264501 2021-02-19 04:37:39,177 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:39,944 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:40,111 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4840.000000 2021-02-19 04:37:40,163 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4745.257745 2021-02-19 04:37:40,203 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8083.700000 2021-02-19 04:37:40,207 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6976.500000 2021-02-19 04:37:40,210 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:40,450 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3464.600000 2021-02-19 04:37:40,648 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4220.728583 2021-02-19 04:37:40,710 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4079.264501 2021-02-19 04:37:40,803 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:41,174 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 57.85 % 2021-02-19 04:37:41,187 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:37:41,187 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:37:41,562 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:37:41,769 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4840.000000 2021-02-19 04:37:41,836 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6976.500000 2021-02-19 04:37:41,845 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4745.257745 2021-02-19 04:37:41,858 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:41,891 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8083.700000 2021-02-19 04:37:42,082 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3464.600000 2021-02-19 04:37:42,283 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4220.728583 2021-02-19 04:37:42,332 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2680.264501 2021-02-19 04:37:42,417 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:43,167 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1418.700000 2021-02-19 04:37:43,448 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4799.600000 2021-02-19 04:37:43,471 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4907.857745 2021-02-19 04:37:43,500 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7200.100000 2021-02-19 04:37:43,520 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:43,551 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 57.98 % 2021-02-19 04:37:43,551 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 57.9846585181 2021-02-19 04:37:43,562 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8258.700000 2021-02-19 04:37:43,703 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3437.700000 2021-02-19 04:37:43,892 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4169.028583 2021-02-19 04:37:43,947 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2680.264501 2021-02-19 04:37:44,035 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:44,770 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1418.700000 2021-02-19 04:37:45,094 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4729.000000 2021-02-19 04:37:45,111 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4907.857745 2021-02-19 04:37:45,165 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7348.200000 2021-02-19 04:37:45,233 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8345.900000 2021-02-19 04:37:45,244 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:45,351 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3430.500000 2021-02-19 04:37:45,500 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4102.031219 2021-02-19 04:37:45,572 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 656.921493 2021-02-19 04:37:45,661 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:46,377 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3416.498679 2021-02-19 04:37:46,724 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4729.000000 2021-02-19 04:37:46,788 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4986.789614 2021-02-19 04:37:46,801 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7348.200000 2021-02-19 04:37:46,861 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8345.900000 2021-02-19 04:37:46,957 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:46,977 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3430.500000 2021-02-19 04:37:47,115 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4102.031219 2021-02-19 04:37:47,188 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 656.921493 2021-02-19 04:37:47,266 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:47,982 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3416.498679 2021-02-19 04:37:48,352 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4729.000000 2021-02-19 04:37:48,415 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4986.789614 2021-02-19 04:37:48,433 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7348.200000 2021-02-19 04:37:48,500 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8345.900000 2021-02-19 04:37:48,601 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:48,605 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 58.23 % 2021-02-19 04:37:48,605 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 58.2289423341 2021-02-19 04:37:48,617 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3430.500000 2021-02-19 04:37:48,724 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4102.031219 2021-02-19 04:37:48,793 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 656.921493 2021-02-19 04:37:48,864 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:49,572 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3416.498679 2021-02-19 04:37:49,983 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4684.300000 2021-02-19 04:37:50,028 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4986.789614 2021-02-19 04:37:50,059 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7268.600000 2021-02-19 04:37:50,124 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8368.400000 2021-02-19 04:37:50,244 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:50,256 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3407.200000 2021-02-19 04:37:50,328 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4102.031219 2021-02-19 04:37:50,398 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 656.921493 2021-02-19 04:37:50,486 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:50,832 | infra | INFO | pool-2-thread-26 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' completed 2021-02-19 04:37:50,832 | infra | INFO | pool-2-thread-26 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:37:51,188 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3416.498679 2021-02-19 04:37:51,226 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 58.36 % 2021-02-19 04:37:51,240 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:37:51,240 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:37:51,621 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4684.300000 2021-02-19 04:37:51,657 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4986.789614 2021-02-19 04:37:51,694 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7268.600000 2021-02-19 04:37:51,776 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8368.400000 2021-02-19 04:37:51,895 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:51,905 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3407.200000 2021-02-19 04:37:51,973 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4102.031219 2021-02-19 04:37:52,006 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 656.921493 2021-02-19 04:37:52,125 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:52,805 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4045.098679 2021-02-19 04:37:53,243 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4685.600000 2021-02-19 04:37:53,276 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5001.089614 2021-02-19 04:37:53,323 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7254.400000 2021-02-19 04:37:53,434 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8428.400000 2021-02-19 04:37:53,545 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:53,555 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3392.500000 2021-02-19 04:37:53,601 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4120.931219 2021-02-19 04:37:53,628 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 35.821493 2021-02-19 04:37:53,648 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 58.44 % 2021-02-19 04:37:53,648 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 58.4365835777 2021-02-19 04:37:53,734 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:54,424 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4045.098679 2021-02-19 04:37:54,895 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4685.600000 2021-02-19 04:37:54,904 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5001.089614 2021-02-19 04:37:54,944 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7353.800000 2021-02-19 04:37:55,075 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8419.700000 2021-02-19 04:37:55,193 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3373.000000 2021-02-19 04:37:55,234 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4120.931219 2021-02-19 04:37:55,256 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:55,270 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 35.821493 2021-02-19 04:37:55,351 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:56,053 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4071.300000 2021-02-19 04:37:56,533 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5008.100000 2021-02-19 04:37:56,551 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4697.800000 2021-02-19 04:37:56,575 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7353.800000 2021-02-19 04:37:56,736 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8419.700000 2021-02-19 04:37:56,832 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3373.000000 2021-02-19 04:37:56,878 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:37:56,921 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:56,933 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4102.600000 2021-02-19 04:37:56,969 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:57,658 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4071.300000 2021-02-19 04:37:58,142 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5008.100000 2021-02-19 04:37:58,186 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4697.800000 2021-02-19 04:37:58,210 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7353.800000 2021-02-19 04:37:58,375 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8419.700000 2021-02-19 04:37:58,482 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3373.000000 2021-02-19 04:37:58,516 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:37:58,572 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4102.600000 2021-02-19 04:37:58,575 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:37:58,608 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:37:58,698 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 58.66 % 2021-02-19 04:37:58,698 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 58.6564390121 2021-02-19 04:37:59,255 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4071.300000 2021-02-19 04:37:59,757 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5008.100000 2021-02-19 04:37:59,812 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4697.800000 2021-02-19 04:37:59,875 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7353.800000 2021-02-19 04:38:00,009 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8334.500000 2021-02-19 04:38:00,119 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3385.900000 2021-02-19 04:38:00,138 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:00,223 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4102.600000 2021-02-19 04:38:00,253 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:00,259 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:00,845 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4071.300000 2021-02-19 04:38:01,253 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 58.78 % 2021-02-19 04:38:01,266 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:38:01,266 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:38:01,367 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5008.100000 2021-02-19 04:38:01,453 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4732.100000 2021-02-19 04:38:01,507 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7683.500000 2021-02-19 04:38:01,651 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8334.500000 2021-02-19 04:38:01,746 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3385.900000 2021-02-19 04:38:01,759 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:01,851 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4102.600000 2021-02-19 04:38:01,946 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:01,971 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:02,448 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3998.700000 2021-02-19 04:38:02,970 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5044.300000 2021-02-19 04:38:03,095 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4719.900000 2021-02-19 04:38:03,140 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8036.800000 2021-02-19 04:38:03,279 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8136.400000 2021-02-19 04:38:03,377 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3418.100000 2021-02-19 04:38:03,415 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:03,484 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3977.800000 2021-02-19 04:38:03,572 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:03,614 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:03,740 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 58.90 % 2021-02-19 04:38:03,740 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 58.9007228281 2021-02-19 04:38:04,042 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3998.700000 2021-02-19 04:38:04,568 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5044.300000 2021-02-19 04:38:04,723 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4719.900000 2021-02-19 04:38:04,822 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8036.800000 2021-02-19 04:38:04,960 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8136.400000 2021-02-19 04:38:05,012 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3462.700000 2021-02-19 04:38:05,030 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:05,118 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3977.800000 2021-02-19 04:38:05,204 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:05,256 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:05,641 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3998.700000 2021-02-19 04:38:06,171 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5170.537687 2021-02-19 04:38:06,351 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4684.100000 2021-02-19 04:38:06,437 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8299.300000 2021-02-19 04:38:06,576 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8011.300000 2021-02-19 04:38:06,650 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:06,667 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3462.700000 2021-02-19 04:38:06,766 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3872.999541 2021-02-19 04:38:06,819 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:06,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:07,101 | infra | INFO | pool-2-thread-60 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:38:07,101 | infra | INFO | pool-2-thread-60 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:38:07,239 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3942.145576 2021-02-19 04:38:07,789 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5170.537687 2021-02-19 04:38:08,020 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4684.100000 2021-02-19 04:38:08,108 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8299.300000 2021-02-19 04:38:08,210 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8011.300000 2021-02-19 04:38:08,308 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:08,316 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3462.700000 2021-02-19 04:38:08,421 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3872.999541 2021-02-19 04:38:08,453 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:08,536 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:08,786 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 59.21 % 2021-02-19 04:38:08,786 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 59.2060775981 2021-02-19 04:38:08,844 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3942.145576 2021-02-19 04:38:09,418 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5170.537687 2021-02-19 04:38:09,651 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4684.100000 2021-02-19 04:38:09,757 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8299.300000 2021-02-19 04:38:09,838 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8011.300000 2021-02-19 04:38:09,947 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:09,976 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3473.700000 2021-02-19 04:38:10,029 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3872.999541 2021-02-19 04:38:10,084 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:10,151 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:10,437 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3942.145576 2021-02-19 04:38:11,023 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5170.537687 2021-02-19 04:38:11,283 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 59.25 % 2021-02-19 04:38:11,285 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4650.100000 2021-02-19 04:38:11,296 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:38:11,296 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:38:11,395 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8437.900000 2021-02-19 04:38:11,453 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7985.100000 2021-02-19 04:38:11,584 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:11,651 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3473.700000 2021-02-19 04:38:11,658 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3872.999541 2021-02-19 04:38:11,711 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:11,799 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:12,055 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3942.145576 2021-02-19 04:38:12,641 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5228.237687 2021-02-19 04:38:12,948 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4660.900000 2021-02-19 04:38:13,025 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8503.100000 2021-02-19 04:38:13,114 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8093.300000 2021-02-19 04:38:13,209 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:13,305 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3933.999541 2021-02-19 04:38:13,313 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3468.800000 2021-02-19 04:38:13,354 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:13,440 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:13,655 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3939.245576 2021-02-19 04:38:13,828 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 59.34 % 2021-02-19 04:38:13,828 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 59.3404336968 2021-02-19 04:38:14,259 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5228.237687 2021-02-19 04:38:14,566 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4683.600000 2021-02-19 04:38:14,651 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8540.500000 2021-02-19 04:38:14,732 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8093.300000 2021-02-19 04:38:14,831 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:14,933 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3933.999541 2021-02-19 04:38:14,950 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3452.700000 2021-02-19 04:38:15,032 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:15,096 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:15,262 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3939.245576 2021-02-19 04:38:15,871 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5228.237687 2021-02-19 04:38:16,210 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4683.600000 2021-02-19 04:38:16,270 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8540.500000 2021-02-19 04:38:16,352 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8206.300000 2021-02-19 04:38:16,470 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:16,551 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4035.342339 2021-02-19 04:38:16,586 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3452.700000 2021-02-19 04:38:16,680 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:16,721 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:16,880 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3924.934388 2021-02-19 04:38:17,486 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5218.048047 2021-02-19 04:38:17,861 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4683.600000 2021-02-19 04:38:17,888 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8540.500000 2021-02-19 04:38:17,973 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8206.300000 2021-02-19 04:38:18,075 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:18,158 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4035.342339 2021-02-19 04:38:18,236 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3452.700000 2021-02-19 04:38:18,331 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:18,364 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:18,492 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3924.934388 2021-02-19 04:38:18,890 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 59.63 % 2021-02-19 04:38:18,891 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 59.633574276 2021-02-19 04:38:19,092 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5218.048047 2021-02-19 04:38:19,490 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4708.600000 2021-02-19 04:38:19,510 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8467.900000 2021-02-19 04:38:19,640 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8325.100000 2021-02-19 04:38:19,701 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:19,769 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4035.342339 2021-02-19 04:38:19,880 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3452.700000 2021-02-19 04:38:19,957 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:20,013 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:20,137 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3924.934388 2021-02-19 04:38:20,733 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5218.048047 2021-02-19 04:38:21,124 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4708.600000 2021-02-19 04:38:21,131 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8467.900000 2021-02-19 04:38:21,276 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8325.100000 2021-02-19 04:38:21,318 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 59.74 % 2021-02-19 04:38:21,322 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:21,332 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:38:21,332 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:38:21,391 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4035.342339 2021-02-19 04:38:21,503 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3469.200000 2021-02-19 04:38:21,578 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:21,644 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:21,763 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3924.934388 2021-02-19 04:38:22,342 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5205.348047 2021-02-19 04:38:22,766 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8372.000000 2021-02-19 04:38:22,780 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4717.900000 2021-02-19 04:38:22,907 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8387.400000 2021-02-19 04:38:22,934 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:23,009 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4002.942339 2021-02-19 04:38:23,114 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3491.100000 2021-02-19 04:38:23,191 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:23,296 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:23,381 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3889.634388 2021-02-19 04:38:23,934 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 59.82 % 2021-02-19 04:38:23,934 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 59.816787138 2021-02-19 04:38:23,954 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5205.348047 2021-02-19 04:38:24,414 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4750.203098 2021-02-19 04:38:24,428 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8267.436282 2021-02-19 04:38:24,530 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8401.108646 2021-02-19 04:38:24,571 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:24,631 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4002.942339 2021-02-19 04:38:24,750 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3491.100000 2021-02-19 04:38:24,815 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:24,921 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:24,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3889.634388 2021-02-19 04:38:25,561 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5189.000000 2021-02-19 04:38:26,059 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4750.203098 2021-02-19 04:38:26,062 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8267.436282 2021-02-19 04:38:26,171 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8401.108646 2021-02-19 04:38:26,197 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:26,260 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3911.300000 2021-02-19 04:38:26,368 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3505.018391 2021-02-19 04:38:26,460 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:26,552 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:26,609 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3882.100000 2021-02-19 04:38:27,191 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5189.000000 2021-02-19 04:38:27,701 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8267.436282 2021-02-19 04:38:27,717 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4750.203098 2021-02-19 04:38:27,811 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8401.108646 2021-02-19 04:38:27,826 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:27,871 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3911.300000 2021-02-19 04:38:27,990 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3505.018391 2021-02-19 04:38:28,117 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:28,204 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:28,247 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3882.100000 2021-02-19 04:38:28,799 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5189.000000 2021-02-19 04:38:28,984 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 60.00 % 2021-02-19 04:38:28,986 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 60.0 2021-02-19 04:38:29,341 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8267.436282 2021-02-19 04:38:29,371 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4750.203098 2021-02-19 04:38:29,453 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:29,470 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8399.408646 2021-02-19 04:38:29,492 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3911.300000 2021-02-19 04:38:29,624 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3506.818391 2021-02-19 04:38:29,763 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:29,842 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:29,881 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3882.100000 2021-02-19 04:38:30,405 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5189.000000 2021-02-19 04:38:30,980 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8219.436282 2021-02-19 04:38:31,022 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4760.303098 2021-02-19 04:38:31,076 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:31,118 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3911.300000 2021-02-19 04:38:31,124 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8399.408646 2021-02-19 04:38:31,257 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3506.818391 2021-02-19 04:38:31,349 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 60.00 % 2021-02-19 04:38:31,362 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:38:31,362 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:38:31,382 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:31,463 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:31,499 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3882.100000 2021-02-19 04:38:32,010 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5189.000000 2021-02-19 04:38:32,625 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8161.736282 2021-02-19 04:38:32,661 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4755.503098 2021-02-19 04:38:32,700 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:32,753 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3941.200000 2021-02-19 04:38:32,790 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8381.508646 2021-02-19 04:38:32,915 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3490.818391 2021-02-19 04:38:33,040 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:33,114 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:33,135 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3931.200000 2021-02-19 04:38:33,612 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5222.700000 2021-02-19 04:38:34,032 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 60.00 % 2021-02-19 04:38:34,032 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 60.0 2021-02-19 04:38:34,267 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8161.863782 2021-02-19 04:38:34,321 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4721.279790 2021-02-19 04:38:34,342 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:34,378 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3941.200000 2021-02-19 04:38:34,428 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8403.702451 2021-02-19 04:38:34,592 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3471.371886 2021-02-19 04:38:34,697 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:34,746 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:34,770 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3931.200000 2021-02-19 04:38:35,213 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5222.700000 2021-02-19 04:38:35,892 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8161.863782 2021-02-19 04:38:35,996 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4721.279790 2021-02-19 04:38:36,000 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:36,019 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4043.000000 2021-02-19 04:38:36,078 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8403.702451 2021-02-19 04:38:36,217 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3471.371886 2021-02-19 04:38:36,323 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:36,382 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:36,394 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3988.200000 2021-02-19 04:38:36,828 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5269.400000 2021-02-19 04:38:37,520 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8161.863782 2021-02-19 04:38:37,618 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:37,653 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4721.279790 2021-02-19 04:38:37,657 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4043.000000 2021-02-19 04:38:37,710 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8403.702451 2021-02-19 04:38:37,861 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3471.371886 2021-02-19 04:38:37,959 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:38,026 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:38,042 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3988.200000 2021-02-19 04:38:38,437 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5269.400000 2021-02-19 04:38:39,079 | test | DEBUG | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 60.05 % 2021-02-19 04:38:39,081 | test | INFO | pool-1-thread-1 | [task:check:330] Rebalance - status: running, progress: 60.0483521743 2021-02-19 04:38:39,163 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8161.863782 2021-02-19 04:38:39,233 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:39,290 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4043.000000 2021-02-19 04:38:39,358 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4721.279790 2021-02-19 04:38:39,368 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8403.702451 2021-02-19 04:38:39,536 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3442.571886 2021-02-19 04:38:39,601 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:39,664 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:39,668 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3988.200000 2021-02-19 04:38:40,075 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5269.400000 2021-02-19 04:38:40,792 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8109.163782 2021-02-19 04:38:40,865 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:40,908 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4043.000000 2021-02-19 04:38:41,017 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4652.579790 2021-02-19 04:38:41,019 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8367.602451 2021-02-19 04:38:41,196 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3442.571886 2021-02-19 04:38:41,226 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:41,325 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3988.200000 2021-02-19 04:38:41,359 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:41,362 | test | INFO | MainThread | [rest_client:rebalance_reached:108] Rebalance reached >60.0% in 230.694000006 seconds 2021-02-19 04:38:41,381 | test | DEBUG | MainThread | [rest_client:diag_eval:1363] /diag/eval status on 172.23.110.64:8091: 1 content: true command: ns_orchestrator:needs_rebalance() 2021-02-19 04:38:41,381 | test | INFO | MainThread | [Magma:abort_rebalance:912] Abort rebalance 2021-02-19 04:38:41,683 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5269.400000 2021-02-19 04:38:41,828 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L914 2021-02-19 04:38:41,828 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 60 seconds. Reason: Sleep after error introduction 2021-02-19 04:38:42,407 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8055.763782 2021-02-19 04:38:42,466 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:42,503 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4033.300000 2021-02-19 04:38:42,634 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4580.779790 2021-02-19 04:38:42,647 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8257.802451 2021-02-19 04:38:42,801 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3398.271886 2021-02-19 04:38:42,825 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:42,960 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3972.500000 2021-02-19 04:38:42,984 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:43,273 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5153.800000 2021-02-19 04:38:44,000 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8055.763782 2021-02-19 04:38:44,112 | test | ERROR | pool-1-thread-1 | [rest_client:_rebalance_status_and_progress:1494] {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 04:38:44,141 | test | INFO | pool-1-thread-1 | [rest_client:print_UI_logs:2599] Latest logs from UI on 172.23.110.69: 2021-02-19 04:38:44,141 | test | ERROR | pool-1-thread-1 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_orchestrator', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613738322553L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:38:42.553Z', u'text': u'Rebalance exited with reason {mover_crashed,\n {unexpected_exit,\n {\'EXIT\',<0.3977.64>,\n {{wait_seqno_persisted_failed,\n "GleamBookUsers6",669,39915,\n [{\'ns_1@172.23.110.64\',\n {\'EXIT\',\n {{{badmatch,{error,closed}},\n [{mc_client_binary,cmd_vocal_recv,5,\n [{file,"src/mc_client_binary.erl"},\n {line,158}]},\n {mc_client_binary,select_bucket,2,\n [{file,"src/mc_client_binary.erl"},\n {line,350}]},\n {ns_memcached_sockets_pool,\n take_socket,2,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,46}]},\n {ns_memcached_sockets_pool,\n \'-executing_on_socket/3-fun-0-\',3,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,88}]},\n {async,\'-async_init/4-fun-1-\',3,\n [{file,"src/async.erl"},\n {line,197}]}]},\n {gen_server,call,\n [{\'janitor_agent-GleamBookUsers6\',\n \'ns_1@172.23.110.64\'},\n {if_rebalance,<0.2119.64>,\n {wait_seqno_persisted,669,39915}},\n infinity]}}}}]},\n [{ns_single_vbucket_mover,\n \'-wait_seqno_persisted_many/5-fun-2-\',5,\n [{file,"src/ns_single_vbucket_mover.erl"},\n {line,488}]},\n {proc_lib,init_p,3,\n [{file,"proc_lib.erl"},{line,234}]}]}}}}.\nRebalance Operation Id = eabcf5e4601240d64a0f846c3b2a79c6'} 2021-02-19 04:38:44,141 | test | ERROR | pool-1-thread-1 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_log', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613738322518L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:38:42.518Z', u'text': u"Service 'memcached' exited with status 137. Restarting. Messages:\nWARNING: Logging before InitGoogleLogging() is written to STDERR\nW0219 04:31:43.694746 47666 HazptrDomain.h:671] Using the default inline executor for asynchronous reclamation may be susceptible to deadlock if the current thread happens to hold a resource needed by the deleter of a reclaimable object"} 2021-02-19 04:38:44,141 | test | ERROR | pool-1-thread-1 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613738322516L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:38:42.516Z', u'text': u'Worker <0.4516.64> (for action {move,{669,\n [\'ns_1@172.23.110.65\',\n \'ns_1@172.23.110.64\'],\n [\'ns_1@172.23.110.68\',\n \'ns_1@172.23.110.64\'],\n []}}) exited with reason {unexpected_exit,\n {\'EXIT\',\n <0.3977.64>,\n {{wait_seqno_persisted_failed,\n "GleamBookUsers6",\n 669,39915,\n [{\'ns_1@172.23.110.64\',\n {\'EXIT\',\n {{{badmatch,\n {error,\n closed}},\n [{mc_client_binary,\n cmd_vocal_recv,\n 5,\n [{file,\n "src/mc_client_binary.erl"},\n {line,\n 158}]},\n {mc_client_binary,\n select_bucket,\n 2,\n [{file,\n "src/mc_client_binary.erl"},\n {line,\n 350}]},\n {ns_memcached_sockets_pool,\n take_socket,\n 2,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,\n 46}]},\n {ns_memcached_sockets_pool,\n \'-executing_on_socket/3-fun-0-\',\n 3,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,\n 88}]},\n {async,\n \'-async_init/4-fun-1-\',\n 3,\n [{file,\n "src/async.erl"},\n {line,\n 197}]}]},\n {gen_server,\n call,\n [{\'janitor_agent-GleamBookUsers6\',\n \'ns_1@172.23.110.64\'},\n {if_rebalance,\n <0.2119.64>,\n {wait_seqno_persisted,\n 669,\n 39915}},\n infinity]}}}}]},\n [{ns_single_vbucket_mover,\n \'-wait_seqno_persisted_many/5-fun-2-\',\n 5,\n [{file,\n "src/ns_single_vbucket_mover.erl"},\n {line,\n 488}]},\n {proc_lib,\n init_p,3,\n [{file,\n "proc_lib.erl"},\n {line,\n 234}]}]}}}'} 2021-02-19 04:38:44,141 | test | ERROR | pool-1-thread-1 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613738322515L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:38:42.515Z', u'text': u"Control connection to memcached on 'ns_1@172.23.110.64' disconnected. Check logs for details."} 2021-02-19 04:38:44,141 | test | ERROR | pool-1-thread-1 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613738316601L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:38:36.601Z', u'text': u'Bucket "GleamBookUsers6" rebalance does not seem to be swap rebalance'} 2021-02-19 04:38:44,141 | test | ERROR | pool-1-thread-1 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613738316144L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:38:36.144Z', u'text': u'Bucket "GleamBookUsers6" loaded on node \'ns_1@172.23.110.69\' in 0 seconds.'} 2021-02-19 04:38:44,141 | test | ERROR | pool-1-thread-1 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.65', u'tstamp': 1613738315962L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:38:35.962Z', u'text': u'Shutting down bucket "GleamBookUsers5" on \'ns_1@172.23.110.65\' for deletion'} 2021-02-19 04:38:44,142 | test | ERROR | pool-1-thread-1 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_rebalancer', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613738315444L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:38:35.444Z', u'text': u'Started rebalancing bucket GleamBookUsers6'} 2021-02-19 04:38:44,142 | test | ERROR | pool-1-thread-1 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.68', u'tstamp': 1613738315345L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:38:35.345Z', u'text': u'Bucket "GleamBookUsers6" loaded on node \'ns_1@172.23.110.68\' in 0 seconds.'} 2021-02-19 04:38:44,142 | test | ERROR | pool-1-thread-1 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613738151262L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:35:51.262Z', u'text': u'Bucket "GleamBookUsers5" rebalance does not seem to be swap rebalance'} 2021-02-19 04:38:44,142 | test | ERROR | pool-1-thread-1 | [task:call:242] Rebalance Failed: {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 04:38:44,292 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4402.300000 2021-02-19 04:38:44,342 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4033.300000 2021-02-19 04:38:44,361 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:44,424 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7880.200000 2021-02-19 04:38:44,424 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3285.600000 2021-02-19 04:38:44,497 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:44,568 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3972.500000 2021-02-19 04:38:44,628 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:44,946 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5153.800000 2021-02-19 04:38:45,611 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7715.700000 2021-02-19 04:38:45,884 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4402.300000 2021-02-19 04:38:45,927 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3677.900000 2021-02-19 04:38:46,049 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7880.200000 2021-02-19 04:38:46,068 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:46,107 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3285.600000 2021-02-19 04:38:46,131 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:46,180 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3640.600000 2021-02-19 04:38:46,269 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:46,535 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4665.300000 2021-02-19 04:38:47,207 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7715.700000 2021-02-19 04:38:47,479 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4402.300000 2021-02-19 04:38:47,507 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3677.900000 2021-02-19 04:38:47,683 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:47,691 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7880.200000 2021-02-19 04:38:47,733 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3285.600000 2021-02-19 04:38:47,759 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:47,775 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3640.600000 2021-02-19 04:38:47,868 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:48,125 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4665.300000 2021-02-19 04:38:48,809 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7715.700000 2021-02-19 04:38:49,081 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4402.300000 2021-02-19 04:38:49,101 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3677.900000 2021-02-19 04:38:49,302 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:49,308 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7880.200000 2021-02-19 04:38:49,385 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3285.600000 2021-02-19 04:38:49,395 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3640.600000 2021-02-19 04:38:49,404 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:49,496 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:49,747 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4665.300000 2021-02-19 04:38:50,410 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6106.000000 2021-02-19 04:38:50,677 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3519.900000 2021-02-19 04:38:50,709 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3677.900000 2021-02-19 04:38:50,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6183.000000 2021-02-19 04:38:50,969 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:51,003 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3640.600000 2021-02-19 04:38:51,016 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:51,071 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2607.200000 2021-02-19 04:38:51,114 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:51,326 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4665.300000 2021-02-19 04:38:51,999 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6106.000000 2021-02-19 04:38:52,279 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2013.400000 2021-02-19 04:38:52,296 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1685.000000 2021-02-19 04:38:52,617 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:52,618 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3493.000000 2021-02-19 04:38:52,632 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:52,632 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1670.700000 2021-02-19 04:38:52,694 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1492.300000 2021-02-19 04:38:52,723 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:52,924 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2147.600000 2021-02-19 04:38:53,612 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3450.400000 2021-02-19 04:38:53,888 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1685.000000 2021-02-19 04:38:53,897 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2013.400000 2021-02-19 04:38:54,217 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:54,263 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1670.700000 2021-02-19 04:38:54,270 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:54,280 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1065.700000 2021-02-19 04:38:54,375 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 461.200000 2021-02-19 04:38:54,385 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:54,515 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2147.600000 2021-02-19 04:38:55,203 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1062.900000 2021-02-19 04:38:55,470 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:38:55,497 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 632.300000 2021-02-19 04:38:55,808 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:55,875 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:55,894 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1065.700000 2021-02-19 04:38:55,920 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1670.700000 2021-02-19 04:38:56,003 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:56,033 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 461.200000 2021-02-19 04:38:56,115 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:38:56,789 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1062.900000 2021-02-19 04:38:57,055 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:38:57,092 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 632.300000 2021-02-19 04:38:57,398 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:57,500 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:57,532 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:38:57,540 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1065.700000 2021-02-19 04:38:57,645 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:57,658 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 461.200000 2021-02-19 04:38:57,703 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:38:58,385 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1062.900000 2021-02-19 04:38:58,642 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:38:58,707 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 632.300000 2021-02-19 04:38:58,982 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:38:59,101 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:38:59,206 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1065.700000 2021-02-19 04:38:59,209 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:38:59,276 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:38:59,299 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:38:59,328 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 461.200000 2021-02-19 04:39:00,002 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.900000 2021-02-19 04:39:00,229 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:00,315 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 139.700000 2021-02-19 04:39:00,562 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:00,691 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:00,802 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:00,842 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:39:00,892 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:00,921 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:00,948 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:01,618 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.900000 2021-02-19 04:39:01,803 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:01,924 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 139.700000 2021-02-19 04:39:02,141 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:02,299 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:02,378 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:02,474 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:39:02,515 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:02,571 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:02,588 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:03,223 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 528.700000 2021-02-19 04:39:03,392 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:03,558 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1098.800000 2021-02-19 04:39:03,727 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:03,911 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:03,954 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:04,121 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:39:04,145 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:04,246 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:04,265 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:04,829 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 528.700000 2021-02-19 04:39:05,022 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:05,180 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2726.000000 2021-02-19 04:39:05,303 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:05,513 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:05,569 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:05,739 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:05,753 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:39:05,867 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:05,891 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:06,437 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1517.500000 2021-02-19 04:39:06,592 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:06,852 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2726.000000 2021-02-19 04:39:06,927 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:07,130 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:07,150 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:07,328 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:07,381 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:39:07,493 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:07,513 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:08,053 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1517.500000 2021-02-19 04:39:08,153 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:08,461 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2726.000000 2021-02-19 04:39:08,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:08,716 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:08,732 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:08,905 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:08,984 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:39:09,128 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:09,144 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:09,645 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4333.300000 2021-02-19 04:39:09,713 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:10,078 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5486.300000 2021-02-19 04:39:10,088 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:10,279 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:10,328 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:10,470 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:10,595 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:39:10,743 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:10,765 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:11,273 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4333.300000 2021-02-19 04:39:11,282 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:11,657 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:11,680 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5486.300000 2021-02-19 04:39:11,859 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:11,934 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:12,038 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:12,214 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:39:12,369 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:12,394 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:12,841 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4.800000 2021-02-19 04:39:12,872 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6905.600000 2021-02-19 04:39:13,226 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:13,283 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 7446.600000 2021-02-19 04:39:13,433 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:13,536 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:13,601 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:13,826 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:39:14,016 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:14,045 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:14,398 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4.800000 2021-02-19 04:39:14,460 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9353.300000 2021-02-19 04:39:14,798 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:14,894 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 7446.600000 2021-02-19 04:39:14,997 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:15,125 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:15,174 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:15,426 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:39:15,624 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:15,654 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:15,967 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5.900000 2021-02-19 04:39:16,052 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9353.300000 2021-02-19 04:39:16,364 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:16,493 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 8686.000000 2021-02-19 04:39:16,556 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:16,710 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:16,744 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:17,020 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:39:17,285 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:17,296 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:17,542 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5.900000 2021-02-19 04:39:17,655 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9353.300000 2021-02-19 04:39:17,927 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:18,096 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 8686.000000 2021-02-19 04:39:18,125 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:18,315 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:18,325 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:18,621 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:39:18,881 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:18,894 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:19,107 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5.900000 2021-02-19 04:39:19,252 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9353.300000 2021-02-19 04:39:19,502 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:19,697 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:19,714 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 8686.000000 2021-02-19 04:39:19,875 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:19,923 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:20,217 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:39:20,484 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:20,499 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:20,670 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5.900000 2021-02-19 04:39:20,865 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9839.700000 2021-02-19 04:39:21,072 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:21,279 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:21,318 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 8682.400000 2021-02-19 04:39:21,444 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:21,536 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:21,826 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:39:22,128 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:22,145 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:22,247 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5.700000 2021-02-19 04:39:22,302 | infra | INFO | pool-2-thread-50 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.41' completed 2021-02-19 04:39:22,302 | infra | INFO | pool-2-thread-50 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:39:22,473 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 10050.700000 2021-02-19 04:39:22,637 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:22,894 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:22,914 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 8628.800000 2021-02-19 04:39:23,052 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5.800000 2021-02-19 04:39:23,128 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:23,438 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:39:23,744 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:23,757 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:23,812 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5.700000 2021-02-19 04:39:24,081 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 10050.700000 2021-02-19 04:39:24,213 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:24,467 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:24,515 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 8453.900000 2021-02-19 04:39:24,618 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5.800000 2021-02-19 04:39:24,721 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:25,042 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 210.300000 2021-02-19 04:39:25,377 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:25,400 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.100000 2021-02-19 04:39:25,411 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5.700000 2021-02-19 04:39:25,686 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9748.900000 2021-02-19 04:39:25,789 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:39:26,035 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:26,121 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 8453.900000 2021-02-19 04:39:26,201 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 7.800000 2021-02-19 04:39:26,313 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:26,648 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 210.300000 2021-02-19 04:39:26,979 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4.600000 2021-02-19 04:39:26,989 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:27,009 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.100000 2021-02-19 04:39:27,296 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9748.900000 2021-02-19 04:39:27,395 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.600000 2021-02-19 04:39:27,611 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:27,739 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 8453.900000 2021-02-19 04:39:27,773 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 7.800000 2021-02-19 04:39:27,923 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:28,243 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 210.300000 2021-02-19 04:39:28,552 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4.600000 2021-02-19 04:39:28,594 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:28,619 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.100000 2021-02-19 04:39:28,901 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9748.900000 2021-02-19 04:39:28,989 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.600000 2021-02-19 04:39:29,196 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:29,351 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 8453.900000 2021-02-19 04:39:29,365 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 7.800000 2021-02-19 04:39:29,517 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:29,882 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 210.300000 2021-02-19 04:39:30,125 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4.600000 2021-02-19 04:39:30,236 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.800000 2021-02-19 04:39:30,249 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:30,519 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9281.000000 2021-02-19 04:39:30,589 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1.800000 2021-02-19 04:39:30,769 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:39:30,944 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 7.800000 2021-02-19 04:39:30,963 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 7531.600000 2021-02-19 04:39:31,127 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:31,489 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1720.300000 2021-02-19 04:39:31,704 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4.600000 2021-02-19 04:39:31,849 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:31,875 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.800000 2021-02-19 04:39:32,180 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9281.000000 2021-02-19 04:39:32,180 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1.800000 2021-02-19 04:39:32,336 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1114.577085 2021-02-19 04:39:32,509 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2.299940 2021-02-19 04:39:32,569 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6367.359688 2021-02-19 04:39:32,724 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:33,096 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4022.639532 2021-02-19 04:39:33,292 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:33,463 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:33,510 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 10.898180 2021-02-19 04:39:33,813 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1158.168726 2021-02-19 04:39:33,834 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8767.040572 2021-02-19 04:39:33,914 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1114.577085 2021-02-19 04:39:34,092 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2.299940 2021-02-19 04:39:34,177 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5288.059688 2021-02-19 04:39:34,319 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:34,700 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6498.739532 2021-02-19 04:39:34,859 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:35,066 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:35,117 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 9.798180 2021-02-19 04:39:35,404 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1195.868726 2021-02-19 04:39:35,441 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8404.340572 2021-02-19 04:39:35,486 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2889.677085 2021-02-19 04:39:35,648 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.299940 2021-02-19 04:39:35,779 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5288.059688 2021-02-19 04:39:35,910 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:36,286 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6498.739532 2021-02-19 04:39:36,431 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:36,663 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:36,733 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 9.798180 2021-02-19 04:39:37,059 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2862.368726 2021-02-19 04:39:37,069 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2889.677085 2021-02-19 04:39:37,105 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8404.340572 2021-02-19 04:39:37,213 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.299940 2021-02-19 04:39:37,420 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5288.059688 2021-02-19 04:39:37,507 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:37,900 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6498.739532 2021-02-19 04:39:37,999 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:38,069 | infra | INFO | pool-2-thread-24 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 04:39:38,069 | infra | INFO | pool-2-thread-24 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:39:38,263 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:38,342 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 9.798180 2021-02-19 04:39:38,663 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2889.677085 2021-02-19 04:39:38,723 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2862.368726 2021-02-19 04:39:38,753 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8404.340572 2021-02-19 04:39:38,792 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.299940 2021-02-19 04:39:39,019 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5288.059688 2021-02-19 04:39:39,105 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:39,523 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7711.439532 2021-02-19 04:39:39,581 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:39,882 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:39,943 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 9.798180 2021-02-19 04:39:40,226 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2889.677085 2021-02-19 04:39:40,364 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2865.968726 2021-02-19 04:39:40,375 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.299940 2021-02-19 04:39:40,381 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8433.140572 2021-02-19 04:39:40,625 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5058.259688 2021-02-19 04:39:40,703 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:41,122 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7711.439532 2021-02-19 04:39:41,145 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:41,499 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:41,535 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 9.098180 2021-02-19 04:39:41,792 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2889.677085 2021-02-19 04:39:41,846 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.69:8091 2021-02-19 04:39:41,846 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 04:39:41,869 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.69:8091 is running 2021-02-19 04:39:41,871 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:41,960 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.299940 2021-02-19 04:39:42,009 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2865.968726 2021-02-19 04:39:42,019 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8433.140572 2021-02-19 04:39:42,236 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5058.259688 2021-02-19 04:39:42,313 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:42,322 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.451999902725. 2021-02-19 04:39:42,322 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:42,727 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:42,740 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8023.022785 2021-02-19 04:39:42,756 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.434000015259. 2021-02-19 04:39:42,756 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:43,121 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:43,144 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:43,200 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.444000005722. 2021-02-19 04:39:43,200 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:43,358 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4472.939568 2021-02-19 04:39:43,543 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:43,640 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8501.473095 2021-02-19 04:39:43,642 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.441999912262. 2021-02-19 04:39:43,642 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:43,653 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3650.288138 2021-02-19 04:39:43,868 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5090.246709 2021-02-19 04:39:43,937 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:44,081 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.43700003624. 2021-02-19 04:39:44,081 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:44,296 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:44,344 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7952.522785 2021-02-19 04:39:44,555 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.474999904633. 2021-02-19 04:39:44,556 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:44,743 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:44,779 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:44,927 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4472.939568 2021-02-19 04:39:44,992 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.435000181198. 2021-02-19 04:39:44,993 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:45,134 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:45,230 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3665.388138 2021-02-19 04:39:45,250 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8564.273095 2021-02-19 04:39:45,444 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.451999902725. 2021-02-19 04:39:45,444 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:45,480 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5199.346709 2021-02-19 04:39:45,548 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:45,871 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:45,884 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.44000005722. 2021-02-19 04:39:45,884 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:45,947 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7952.522785 2021-02-19 04:39:46,321 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.43700003624. 2021-02-19 04:39:46,346 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.64:8091 2021-02-19 04:39:46,346 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 04:39:46,364 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:46,365 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.64:8091 is running 2021-02-19 04:39:46,367 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:46,407 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:46,496 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5860.139568 2021-02-19 04:39:46,723 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:46,825 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.458999872208. 2021-02-19 04:39:46,826 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:46,834 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3882.388138 2021-02-19 04:39:46,877 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8564.273095 2021-02-19 04:39:47,098 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5199.346709 2021-02-19 04:39:47,165 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:47,299 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.473000049591. 2021-02-19 04:39:47,301 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:47,447 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:47,558 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7952.522785 2021-02-19 04:39:47,746 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.444999933243. 2021-02-19 04:39:47,746 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:48,035 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:48,082 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:48,104 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5860.139568 2021-02-19 04:39:48,210 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.464999914169. 2021-02-19 04:39:48,210 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:48,295 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:48,417 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3882.388138 2021-02-19 04:39:48,480 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8564.273095 2021-02-19 04:39:48,645 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.43499994278. 2021-02-19 04:39:48,645 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:48,720 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5199.346709 2021-02-19 04:39:48,766 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:49,019 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:49,073 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.427999973297. 2021-02-19 04:39:49,073 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:49,164 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7952.522785 2021-02-19 04:39:49,513 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.44000005722. 2021-02-19 04:39:49,513 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:49,647 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:49,684 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5860.139568 2021-02-19 04:39:49,696 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:49,862 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:49,961 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.447999954224. 2021-02-19 04:39:49,961 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:49,997 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3880.388138 2021-02-19 04:39:50,095 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8427.873095 2021-02-19 04:39:50,339 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5227.246709 2021-02-19 04:39:50,391 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:50,437 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.476000070572. 2021-02-19 04:39:50,437 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:50,605 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:50,753 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7816.722785 2021-02-19 04:39:50,875 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.43799996376. 2021-02-19 04:39:50,894 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.68:8091 2021-02-19 04:39:50,894 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 04:39:50,911 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.68:8091 is running 2021-02-19 04:39:50,913 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:51,280 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:51,299 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5860.139568 2021-02-19 04:39:51,323 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:51,348 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.4359998703. 2021-02-19 04:39:51,348 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:51,441 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:39:51,615 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3880.388138 2021-02-19 04:39:51,743 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8427.873095 2021-02-19 04:39:51,792 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.444000005722. 2021-02-19 04:39:51,792 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:51,996 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5227.246709 2021-02-19 04:39:52,042 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:52,193 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:52,219 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.426000118256. 2021-02-19 04:39:52,219 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:52,388 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7824.600000 2021-02-19 04:39:52,664 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.444999933243. 2021-02-19 04:39:52,664 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:52,898 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:52,936 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7297.400000 2021-02-19 04:39:52,957 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:53,061 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:39:53,099 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.43499994278. 2021-02-19 04:39:53,099 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:53,236 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3943.200000 2021-02-19 04:39:53,375 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8327.600000 2021-02-19 04:39:53,553 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.453000068665. 2021-02-19 04:39:53,553 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:53,614 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5217.500000 2021-02-19 04:39:53,644 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:53,819 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:53,989 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7824.600000 2021-02-19 04:39:53,993 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.438000202179. 2021-02-19 04:39:53,993 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:54,427 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.434000015259. 2021-02-19 04:39:54,427 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:54,515 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:54,588 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7297.400000 2021-02-19 04:39:54,605 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:54,697 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:39:54,868 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.44000005722. 2021-02-19 04:39:54,868 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:39:54,915 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3943.200000 2021-02-19 04:39:55,026 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8327.600000 2021-02-19 04:39:55,259 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5253.900000 2021-02-19 04:39:55,269 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:55,303 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.4359998703. 2021-02-19 04:39:55,303 | test | INFO | MainThread | [Magma:abort_rebalance:927] Restarting Rebalance after killing at 60 2021-02-19 04:39:55,348 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[]_OUT=[172.23.110.65]_1613738395.3 2021-02-19 04:39:55,348 | infra | INFO | pool-1-thread-3 | [task:start_task:84] Thread 'Rebalance_task_IN=[]_OUT=[172.23.110.65]_1613738395.3' started 2021-02-19 04:39:55,367 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L932 2021-02-19 04:39:55,368 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 120 seconds. Reason: Let the rebalance begin after abort 2021-02-19 04:39:55,391 | test | DEBUG | pool-1-thread-3 | [task:start_rebalance:301] Removing node 172.23.110.65:8091 from cluster 2021-02-19 04:39:55,391 | test | DEBUG | pool-1-thread-3 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.68,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': u'ns_1@172.23.110.65', 'user': 'Administrator'} 2021-02-19 04:39:55,430 | test | DEBUG | pool-1-thread-3 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 04:39:55,430 | test | INFO | pool-1-thread-3 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+---------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 16.4387801035 | Cluster node | | 172.23.110.68 | kv | 7.0.0-4498-enterprise | 11.704202624 | Cluster node | | 172.23.110.69 | kv | 7.0.0-4498-enterprise | 11.8355388584 | Cluster node | | 172.23.110.65 | kv | 7.0.0-4498-enterprise | 9.84842128814 | --- OUT ---> | +---------------+----------+-----------------------+---------------+--------------+ 2021-02-19 04:39:55,444 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 04:39:55,444 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 04:39:55,457 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:55,584 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7811.200000 2021-02-19 04:39:56,144 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:56,220 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8299.000000 2021-02-19 04:39:56,234 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:56,348 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.000000 2021-02-19 04:39:56,575 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3985.700000 2021-02-19 04:39:56,671 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8245.700000 2021-02-19 04:39:56,898 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5253.900000 2021-02-19 04:39:56,901 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:57,137 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:57,193 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7811.200000 2021-02-19 04:39:57,755 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:57,849 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:57,874 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8299.000000 2021-02-19 04:39:58,006 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.000000 2021-02-19 04:39:58,207 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3985.700000 2021-02-19 04:39:58,283 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8245.700000 2021-02-19 04:39:58,516 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:39:58,533 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5253.900000 2021-02-19 04:39:58,780 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:39:58,802 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7811.200000 2021-02-19 04:39:59,404 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:39:59,513 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8299.000000 2021-02-19 04:39:59,529 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:39:59,655 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.000000 2021-02-19 04:39:59,845 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3985.700000 2021-02-19 04:39:59,905 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8245.700000 2021-02-19 04:40:00,155 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:00,174 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5220.200000 2021-02-19 04:40:00,408 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7842.600000 2021-02-19 04:40:00,427 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:00,483 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 60.11 % 2021-02-19 04:40:00,483 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 60.1106738446 2021-02-19 04:40:01,036 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:01,137 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:01,174 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8299.000000 2021-02-19 04:40:01,313 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.000000 2021-02-19 04:40:01,549 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3988.200000 2021-02-19 04:40:01,575 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8310.400000 2021-02-19 04:40:01,786 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:01,805 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5220.200000 2021-02-19 04:40:02,042 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7842.600000 2021-02-19 04:40:02,084 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:02,638 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:02,750 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:02,789 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8391.900000 2021-02-19 04:40:02,915 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:40:03,209 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3559.600000 2021-02-19 04:40:03,270 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8334.900000 2021-02-19 04:40:03,457 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5229.800000 2021-02-19 04:40:03,463 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:03,653 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7800.000000 2021-02-19 04:40:03,683 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:04,286 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:04,391 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8391.900000 2021-02-19 04:40:04,405 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:04,530 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:40:04,815 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3559.600000 2021-02-19 04:40:04,884 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8334.900000 2021-02-19 04:40:05,084 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:05,092 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5185.900000 2021-02-19 04:40:05,273 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7694.100000 2021-02-19 04:40:05,305 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:05,519 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 60.38 % 2021-02-19 04:40:05,519 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 60.3765874156 2021-02-19 04:40:05,885 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:06,003 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8391.900000 2021-02-19 04:40:06,022 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:06,158 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:40:06,440 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2677.000000 2021-02-19 04:40:06,500 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8383.300000 2021-02-19 04:40:06,713 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5185.900000 2021-02-19 04:40:06,726 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:06,910 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7694.100000 2021-02-19 04:40:06,921 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:07,480 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:07,634 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:07,651 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8493.700000 2021-02-19 04:40:07,795 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:40:08,049 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2677.000000 2021-02-19 04:40:08,108 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8383.300000 2021-02-19 04:40:08,351 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:08,362 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5185.900000 2021-02-19 04:40:08,520 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7694.100000 2021-02-19 04:40:08,526 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:09,092 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:09,260 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:09,279 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8493.700000 2021-02-19 04:40:09,403 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:40:09,658 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2673.600000 2021-02-19 04:40:09,710 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8420.200000 2021-02-19 04:40:09,967 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:09,987 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5185.900000 2021-02-19 04:40:10,128 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7518.600000 2021-02-19 04:40:10,144 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:10,555 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 60.67 % 2021-02-19 04:40:10,555 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 60.6737516369 2021-02-19 04:40:10,698 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:10,894 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8493.700000 2021-02-19 04:40:10,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:11,022 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:40:11,293 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2673.600000 2021-02-19 04:40:11,332 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8420.200000 2021-02-19 04:40:11,565 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:11,614 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5202.100000 2021-02-19 04:40:11,740 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7518.600000 2021-02-19 04:40:11,749 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:12,292 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:12,499 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8572.500000 2021-02-19 04:40:12,519 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:12,654 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:40:12,923 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1340.300000 2021-02-19 04:40:12,951 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8436.200000 2021-02-19 04:40:13,168 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:13,244 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5258.500000 2021-02-19 04:40:13,359 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:13,377 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7481.000000 2021-02-19 04:40:13,895 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:14,127 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:14,141 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8572.500000 2021-02-19 04:40:14,298 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:40:14,539 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1323.500000 2021-02-19 04:40:14,572 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8412.900000 2021-02-19 04:40:14,778 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:14,868 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5258.500000 2021-02-19 04:40:14,969 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:14,996 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7481.000000 2021-02-19 04:40:15,493 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:15,591 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 60.89 % 2021-02-19 04:40:15,591 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 60.8893390278 2021-02-19 04:40:15,739 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:15,767 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8616.800000 2021-02-19 04:40:15,911 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:40:16,170 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 497.000000 2021-02-19 04:40:16,187 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8412.900000 2021-02-19 04:40:16,382 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:16,483 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5331.700000 2021-02-19 04:40:16,563 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.400000 2021-02-19 04:40:16,609 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7598.700000 2021-02-19 04:40:17,134 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:17,371 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:17,391 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8616.800000 2021-02-19 04:40:17,523 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.400000 2021-02-19 04:40:17,796 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 497.000000 2021-02-19 04:40:17,821 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8412.900000 2021-02-19 04:40:18,056 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:18,151 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5331.700000 2021-02-19 04:40:18,161 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.400000 2021-02-19 04:40:18,221 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7598.700000 2021-02-19 04:40:18,734 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:18,990 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:19,016 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8616.800000 2021-02-19 04:40:19,134 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.400000 2021-02-19 04:40:19,463 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 502.300000 2021-02-19 04:40:19,476 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8256.500000 2021-02-19 04:40:19,707 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:19,790 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5349.400000 2021-02-19 04:40:19,803 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.400000 2021-02-19 04:40:19,851 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7598.700000 2021-02-19 04:40:20,361 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:20,621 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.700000 2021-02-19 04:40:20,630 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 61.21 % 2021-02-19 04:40:20,630 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 61.2078845759 2021-02-19 04:40:20,637 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8616.800000 2021-02-19 04:40:20,755 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.400000 2021-02-19 04:40:21,095 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8256.500000 2021-02-19 04:40:21,128 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 502.300000 2021-02-19 04:40:21,335 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:21,420 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.400000 2021-02-19 04:40:21,428 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5349.400000 2021-02-19 04:40:21,477 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7927.900000 2021-02-19 04:40:21,970 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:22,259 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.700000 2021-02-19 04:40:22,272 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8616.800000 2021-02-19 04:40:22,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.700000 2021-02-19 04:40:22,734 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8133.300000 2021-02-19 04:40:22,776 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 603.000000 2021-02-19 04:40:22,999 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:23,035 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.400000 2021-02-19 04:40:23,059 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5365.900000 2021-02-19 04:40:23,148 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8207.700000 2021-02-19 04:40:23,575 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:23,891 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.100000 2021-02-19 04:40:23,904 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8607.900000 2021-02-19 04:40:23,989 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.700000 2021-02-19 04:40:24,344 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8019.200000 2021-02-19 04:40:24,398 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 625.400000 2021-02-19 04:40:24,651 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:24,664 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.400000 2021-02-19 04:40:24,676 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5374.100000 2021-02-19 04:40:24,773 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8400.200000 2021-02-19 04:40:25,187 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:25,506 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.600000 2021-02-19 04:40:25,519 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8611.300000 2021-02-19 04:40:25,619 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:40:25,665 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 61.45 % 2021-02-19 04:40:25,667 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 61.4471590904 2021-02-19 04:40:25,967 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8019.200000 2021-02-19 04:40:26,023 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 625.400000 2021-02-19 04:40:26,275 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:26,306 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:26,359 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5374.100000 2021-02-19 04:40:26,405 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8400.200000 2021-02-19 04:40:26,780 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:27,125 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.600000 2021-02-19 04:40:27,138 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8611.300000 2021-02-19 04:40:27,233 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:40:27,586 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8019.200000 2021-02-19 04:40:27,641 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 753.800000 2021-02-19 04:40:27,878 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:27,956 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:28,015 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5374.100000 2021-02-19 04:40:28,043 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8400.200000 2021-02-19 04:40:28,378 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:28,749 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.600000 2021-02-19 04:40:28,769 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8611.300000 2021-02-19 04:40:28,844 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:40:29,198 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8019.200000 2021-02-19 04:40:29,272 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 753.800000 2021-02-19 04:40:29,492 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:29,566 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:29,642 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5395.500000 2021-02-19 04:40:29,676 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8480.600000 2021-02-19 04:40:29,976 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:30,385 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8611.300000 2021-02-19 04:40:30,398 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.900000 2021-02-19 04:40:30,443 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:40:30,721 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 61.73 % 2021-02-19 04:40:30,721 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 61.7296444933 2021-02-19 04:40:30,809 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8016.100000 2021-02-19 04:40:30,884 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 772.000000 2021-02-19 04:40:31,127 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:31,226 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:31,265 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5395.500000 2021-02-19 04:40:31,319 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8480.600000 2021-02-19 04:40:31,579 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:31,996 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8611.300000 2021-02-19 04:40:32,017 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.900000 2021-02-19 04:40:32,053 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:40:32,421 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7942.100000 2021-02-19 04:40:32,516 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 816.300000 2021-02-19 04:40:32,730 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:32,862 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:32,937 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5389.400000 2021-02-19 04:40:33,002 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8537.400000 2021-02-19 04:40:33,184 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:33,641 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.500000 2021-02-19 04:40:33,657 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8730.900000 2021-02-19 04:40:33,697 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:40:34,038 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7942.100000 2021-02-19 04:40:34,173 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 816.300000 2021-02-19 04:40:34,390 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:34,561 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:34,581 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5384.200000 2021-02-19 04:40:34,641 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8626.200000 2021-02-19 04:40:34,792 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:35,288 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8730.900000 2021-02-19 04:40:35,296 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:35,309 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:40:35,651 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7877.800000 2021-02-19 04:40:35,756 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 61.98 % 2021-02-19 04:40:35,756 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 61.9792552426 2021-02-19 04:40:35,799 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 827.000000 2021-02-19 04:40:36,013 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:36,256 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:36,282 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5384.200000 2021-02-19 04:40:36,299 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8626.200000 2021-02-19 04:40:36,404 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:36,908 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8858.500000 2021-02-19 04:40:36,927 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:36,933 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:40:37,266 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7877.800000 2021-02-19 04:40:37,423 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 793.200000 2021-02-19 04:40:37,612 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:37,858 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:37,911 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8626.200000 2021-02-19 04:40:37,969 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5384.200000 2021-02-19 04:40:38,048 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:38,516 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8858.500000 2021-02-19 04:40:38,538 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:38,552 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:40:38,888 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7877.800000 2021-02-19 04:40:39,036 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 793.200000 2021-02-19 04:40:39,220 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:39,470 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:39,530 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8651.000000 2021-02-19 04:40:39,595 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5331.300000 2021-02-19 04:40:39,661 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:40,134 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8858.500000 2021-02-19 04:40:40,155 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:40:40,174 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:40,526 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7848.100000 2021-02-19 04:40:40,658 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 793.900000 2021-02-19 04:40:40,789 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 62.11 % 2021-02-19 04:40:40,789 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 62.1088067158 2021-02-19 04:40:40,826 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:41,089 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:41,148 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8651.000000 2021-02-19 04:40:41,211 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5331.300000 2021-02-19 04:40:41,273 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:41,763 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8858.500000 2021-02-19 04:40:41,775 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:40:41,799 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:42,177 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7848.100000 2021-02-19 04:40:42,322 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 732.000000 2021-02-19 04:40:42,427 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.300000 2021-02-19 04:40:42,700 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:42,769 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8670.500000 2021-02-19 04:40:42,829 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5302.800000 2021-02-19 04:40:42,880 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:43,378 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8966.200000 2021-02-19 04:40:43,394 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.400000 2021-02-19 04:40:43,414 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.100000 2021-02-19 04:40:43,813 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7971.800000 2021-02-19 04:40:43,964 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 732.000000 2021-02-19 04:40:44,052 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.300000 2021-02-19 04:40:44,306 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:44,387 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8647.939656 2021-02-19 04:40:44,450 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5263.573929 2021-02-19 04:40:44,500 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:44,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8966.200000 2021-02-19 04:40:44,999 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.400000 2021-02-19 04:40:45,029 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.100000 2021-02-19 04:40:45,440 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8091.408870 2021-02-19 04:40:45,581 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 603.301124 2021-02-19 04:40:45,654 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.300000 2021-02-19 04:40:45,831 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 62.46 % 2021-02-19 04:40:45,831 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 62.4629641741 2021-02-19 04:40:45,928 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:46,010 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8647.939656 2021-02-19 04:40:46,085 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5263.573929 2021-02-19 04:40:46,118 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:46,605 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9089.323052 2021-02-19 04:40:46,618 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.899401 2021-02-19 04:40:46,634 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.100000 2021-02-19 04:40:47,092 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8091.408870 2021-02-19 04:40:47,240 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 603.301124 2021-02-19 04:40:47,252 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.300000 2021-02-19 04:40:47,526 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:47,637 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8647.939656 2021-02-19 04:40:47,750 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5263.573929 2021-02-19 04:40:47,770 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:48,226 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.899401 2021-02-19 04:40:48,249 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9089.323052 2021-02-19 04:40:48,263 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.100000 2021-02-19 04:40:48,716 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8091.408870 2021-02-19 04:40:48,861 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 603.301124 2021-02-19 04:40:48,874 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.300000 2021-02-19 04:40:49,118 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:49,267 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8647.939656 2021-02-19 04:40:49,407 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5263.573929 2021-02-19 04:40:49,423 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:49,835 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.899401 2021-02-19 04:40:49,881 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9089.323052 2021-02-19 04:40:49,904 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.100000 2021-02-19 04:40:50,323 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8189.508870 2021-02-19 04:40:50,512 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 594.801124 2021-02-19 04:40:50,526 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.300000 2021-02-19 04:40:50,734 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:50,867 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 62.76 % 2021-02-19 04:40:50,867 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 62.7649552164 2021-02-19 04:40:50,901 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8657.839656 2021-02-19 04:40:51,033 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5239.373929 2021-02-19 04:40:51,042 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:51,466 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.899401 2021-02-19 04:40:51,494 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9089.323052 2021-02-19 04:40:51,507 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.100000 2021-02-19 04:40:51,931 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8189.508870 2021-02-19 04:40:52,121 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.300000 2021-02-19 04:40:52,141 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 594.801124 2021-02-19 04:40:52,336 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:52,526 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8634.139656 2021-02-19 04:40:52,667 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5117.873929 2021-02-19 04:40:52,677 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:53,072 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.499401 2021-02-19 04:40:53,108 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9131.923052 2021-02-19 04:40:53,119 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:53,555 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8235.608870 2021-02-19 04:40:53,733 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:53,770 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 404.201124 2021-02-19 04:40:53,950 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:54,138 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8634.139656 2021-02-19 04:40:54,292 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4988.083302 2021-02-19 04:40:54,298 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:54,678 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.499401 2021-02-19 04:40:54,719 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9131.923052 2021-02-19 04:40:54,740 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:55,170 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8291.953108 2021-02-19 04:40:55,358 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:55,401 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 391.978439 2021-02-19 04:40:55,568 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:55,766 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8662.691751 2021-02-19 04:40:55,917 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 63.27 % 2021-02-19 04:40:55,917 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 63.2712029124 2021-02-19 04:40:55,921 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4988.083302 2021-02-19 04:40:55,924 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:56,306 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:40:56,335 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9201.560513 2021-02-19 04:40:56,358 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:56,776 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8291.953108 2021-02-19 04:40:56,967 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:57,048 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 301.777189 2021-02-19 04:40:57,183 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:57,378 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8662.691751 2021-02-19 04:40:57,540 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4988.083302 2021-02-19 04:40:57,548 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:57,931 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:40:57,940 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9201.560513 2021-02-19 04:40:57,957 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:58,381 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8291.953108 2021-02-19 04:40:58,582 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:40:58,667 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 301.777189 2021-02-19 04:40:58,790 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:40:59,000 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8662.691751 2021-02-19 04:40:59,157 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4988.083302 2021-02-19 04:40:59,167 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:40:59,552 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:40:59,569 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9201.560513 2021-02-19 04:40:59,575 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:40:59,990 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8291.953108 2021-02-19 04:41:00,197 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:41:00,292 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 332.577189 2021-02-19 04:41:00,411 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:41:00,615 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8738.291751 2021-02-19 04:41:00,789 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4979.483302 2021-02-19 04:41:00,799 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:00,951 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 63.79 % 2021-02-19 04:41:00,951 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 63.789205908 2021-02-19 04:41:01,161 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:01,180 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9201.560513 2021-02-19 04:41:01,187 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:01,598 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8266.853108 2021-02-19 04:41:01,801 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:41:01,927 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 332.577189 2021-02-19 04:41:02,012 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:41:02,260 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8738.291751 2021-02-19 04:41:02,415 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5116.483302 2021-02-19 04:41:02,437 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:02,773 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:02,799 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:02,819 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9150.960513 2021-02-19 04:41:03,236 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8073.453108 2021-02-19 04:41:03,407 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:41:03,566 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 786.877189 2021-02-19 04:41:03,624 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:41:03,642 | infra | INFO | pool-2-thread-39 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope4_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:41:03,642 | infra | INFO | pool-2-thread-39 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:41:03,888 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8859.491751 2021-02-19 04:41:04,035 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5116.483302 2021-02-19 04:41:04,059 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:04,413 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:04,423 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:04,451 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9150.960513 2021-02-19 04:41:04,846 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8073.453108 2021-02-19 04:41:05,023 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:41:05,207 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1015.945254 2021-02-19 04:41:05,242 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:41:05,510 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8953.900000 2021-02-19 04:41:05,665 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5316.800000 2021-02-19 04:41:05,677 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:05,993 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 64.52 % 2021-02-19 04:41:05,993 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 64.5152872415 2021-02-19 04:41:06,033 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:06,046 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:06,078 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9150.960513 2021-02-19 04:41:06,454 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7834.000000 2021-02-19 04:41:06,694 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:41:06,839 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1520.800000 2021-02-19 04:41:06,865 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:41:07,125 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8953.900000 2021-02-19 04:41:07,288 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5316.800000 2021-02-19 04:41:07,296 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:07,637 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:07,658 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:07,690 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8919.000000 2021-02-19 04:41:08,102 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7834.000000 2021-02-19 04:41:08,312 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:41:08,482 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1520.800000 2021-02-19 04:41:08,496 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:41:08,756 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8953.900000 2021-02-19 04:41:08,917 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5316.800000 2021-02-19 04:41:08,924 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:09,255 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:09,279 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:09,312 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8919.000000 2021-02-19 04:41:09,707 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7516.800000 2021-02-19 04:41:09,924 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:41:10,130 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1698.500000 2021-02-19 04:41:10,150 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 654.200000 2021-02-19 04:41:10,381 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8374.500000 2021-02-19 04:41:10,549 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5404.500000 2021-02-19 04:41:10,594 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:10,871 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:10,888 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:10,926 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8919.000000 2021-02-19 04:41:11,032 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 64.98 % 2021-02-19 04:41:11,032 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 64.9772394158 2021-02-19 04:41:11,312 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7516.800000 2021-02-19 04:41:11,536 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:41:11,749 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1698.500000 2021-02-19 04:41:11,766 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 654.200000 2021-02-19 04:41:12,005 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 8374.500000 2021-02-19 04:41:12,190 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5404.500000 2021-02-19 04:41:12,232 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:12,492 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.100000 2021-02-19 04:41:12,509 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:41:12,542 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8794.000000 2021-02-19 04:41:12,927 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7351.300000 2021-02-19 04:41:13,140 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:41:13,359 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1967.400000 2021-02-19 04:41:13,382 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1741.200000 2021-02-19 04:41:13,631 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 7391.500000 2021-02-19 04:41:13,809 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5368.200000 2021-02-19 04:41:13,857 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:14,105 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.100000 2021-02-19 04:41:14,119 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:41:14,171 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8794.000000 2021-02-19 04:41:14,539 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7075.800000 2021-02-19 04:41:14,746 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:41:14,979 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1967.400000 2021-02-19 04:41:14,990 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1741.200000 2021-02-19 04:41:15,244 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6125.200000 2021-02-19 04:41:15,437 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5314.600000 2021-02-19 04:41:15,470 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:15,714 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.900000 2021-02-19 04:41:15,726 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.799251 2021-02-19 04:41:15,779 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8668.785122 2021-02-19 04:41:16,075 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 65.56 % 2021-02-19 04:41:16,075 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 65.5626073348 2021-02-19 04:41:16,150 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7075.800000 2021-02-19 04:41:16,348 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.499251 2021-02-19 04:41:16,598 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2097.936795 2021-02-19 04:41:16,605 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3178.500000 2021-02-19 04:41:16,862 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6125.200000 2021-02-19 04:41:17,059 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5314.600000 2021-02-19 04:41:17,078 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:17,346 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.900000 2021-02-19 04:41:17,359 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.799251 2021-02-19 04:41:17,397 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8668.785122 2021-02-19 04:41:17,767 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7075.800000 2021-02-19 04:41:17,963 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.499251 2021-02-19 04:41:18,233 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3178.500000 2021-02-19 04:41:18,256 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2097.936795 2021-02-19 04:41:18,532 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6125.200000 2021-02-19 04:41:18,694 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:18,720 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5314.600000 2021-02-19 04:41:19,003 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.900000 2021-02-19 04:41:19,020 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.799251 2021-02-19 04:41:19,032 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8668.785122 2021-02-19 04:41:19,398 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6914.700000 2021-02-19 04:41:19,568 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.499251 2021-02-19 04:41:19,852 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3178.500000 2021-02-19 04:41:19,880 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2097.936795 2021-02-19 04:41:20,161 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5344.100000 2021-02-19 04:41:20,309 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:20,355 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5306.500000 2021-02-19 04:41:20,622 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.500000 2021-02-19 04:41:20,642 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.799251 2021-02-19 04:41:20,648 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8668.785122 2021-02-19 04:41:20,999 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6914.700000 2021-02-19 04:41:21,111 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 66.01 % 2021-02-19 04:41:21,111 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 66.0063263209 2021-02-19 04:41:21,183 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.499251 2021-02-19 04:41:21,489 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4070.700000 2021-02-19 04:41:21,510 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2156.336795 2021-02-19 04:41:21,776 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5344.100000 2021-02-19 04:41:21,948 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:22,015 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5306.500000 2021-02-19 04:41:22,250 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.500000 2021-02-19 04:41:22,270 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.799251 2021-02-19 04:41:22,278 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8668.785122 2021-02-19 04:41:22,617 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6709.200000 2021-02-19 04:41:22,786 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.899251 2021-02-19 04:41:23,109 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4558.700000 2021-02-19 04:41:23,128 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1989.036795 2021-02-19 04:41:23,384 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4955.400000 2021-02-19 04:41:23,559 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:23,637 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5352.100000 2021-02-19 04:41:23,891 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.499251 2021-02-19 04:41:23,913 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.500000 2021-02-19 04:41:23,924 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8660.485122 2021-02-19 04:41:24,230 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6768.500000 2021-02-19 04:41:24,401 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.899251 2021-02-19 04:41:24,723 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4690.900000 2021-02-19 04:41:24,750 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2135.236795 2021-02-19 04:41:24,997 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4955.400000 2021-02-19 04:41:25,168 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:25,252 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5321.600000 2021-02-19 04:41:25,503 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:25,526 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.700000 2021-02-19 04:41:25,536 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8930.519930 2021-02-19 04:41:25,845 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6768.500000 2021-02-19 04:41:25,993 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.899251 2021-02-19 04:41:26,147 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 66.27 % 2021-02-19 04:41:26,147 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 66.2703198143 2021-02-19 04:41:26,352 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4690.900000 2021-02-19 04:41:26,395 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2071.868152 2021-02-19 04:41:26,625 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4824.900000 2021-02-19 04:41:26,799 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:26,875 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5321.600000 2021-02-19 04:41:27,119 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:27,144 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.700000 2021-02-19 04:41:27,161 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8930.519930 2021-02-19 04:41:27,446 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6768.500000 2021-02-19 04:41:27,607 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.400000 2021-02-19 04:41:27,970 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4690.900000 2021-02-19 04:41:28,026 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2071.868152 2021-02-19 04:41:28,250 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4824.900000 2021-02-19 04:41:28,418 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:28,515 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5321.600000 2021-02-19 04:41:28,733 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:28,773 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.700000 2021-02-19 04:41:28,786 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8930.519930 2021-02-19 04:41:29,053 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6768.500000 2021-02-19 04:41:29,201 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.400000 2021-02-19 04:41:29,588 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4779.400000 2021-02-19 04:41:29,647 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2305.268152 2021-02-19 04:41:29,858 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4824.900000 2021-02-19 04:41:30,028 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:30,127 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5196.800000 2021-02-19 04:41:30,367 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:30,410 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.100000 2021-02-19 04:41:30,421 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8930.519930 2021-02-19 04:41:30,663 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6846.500000 2021-02-19 04:41:30,802 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.400000 2021-02-19 04:41:31,187 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 66.55 % 2021-02-19 04:41:31,187 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 66.5471261766 2021-02-19 04:41:31,211 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4779.400000 2021-02-19 04:41:31,276 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2305.268152 2021-02-19 04:41:31,477 | infra | INFO | pool-2-thread-59 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope1_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:41:31,477 | infra | INFO | pool-2-thread-59 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:41:31,492 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4838.900000 2021-02-19 04:41:31,674 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:31,756 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5196.800000 2021-02-19 04:41:31,979 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:32,022 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.100000 2021-02-19 04:41:32,040 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8930.519930 2021-02-19 04:41:32,273 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6940.100000 2021-02-19 04:41:32,401 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.100000 2021-02-19 04:41:32,836 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4854.900000 2021-02-19 04:41:32,898 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2534.668152 2021-02-19 04:41:33,107 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4824.300000 2021-02-19 04:41:33,286 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:33,398 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5079.200000 2021-02-19 04:41:33,594 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:33,664 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:33,680 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9030.519930 2021-02-19 04:41:33,892 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6940.100000 2021-02-19 04:41:34,009 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.100000 2021-02-19 04:41:34,453 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4938.300000 2021-02-19 04:41:34,536 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2747.168152 2021-02-19 04:41:34,717 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4813.200000 2021-02-19 04:41:34,928 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:35,056 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5079.200000 2021-02-19 04:41:35,237 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:35,292 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 9030.519930 2021-02-19 04:41:35,311 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:35,519 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6833.500000 2021-02-19 04:41:35,621 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 344.800000 2021-02-19 04:41:36,061 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4938.300000 2021-02-19 04:41:36,170 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2863.100000 2021-02-19 04:41:36,230 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 66.79 % 2021-02-19 04:41:36,232 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 66.7929508986 2021-02-19 04:41:36,329 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4813.200000 2021-02-19 04:41:36,565 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:36,711 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4995.200000 2021-02-19 04:41:36,842 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:36,905 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8915.900000 2021-02-19 04:41:36,931 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:37,153 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6833.500000 2021-02-19 04:41:37,230 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 344.800000 2021-02-19 04:41:37,680 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4938.300000 2021-02-19 04:41:37,789 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2863.100000 2021-02-19 04:41:37,931 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4813.200000 2021-02-19 04:41:38,194 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:38,344 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4995.200000 2021-02-19 04:41:38,457 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:38,538 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8915.900000 2021-02-19 04:41:38,561 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:38,785 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6833.500000 2021-02-19 04:41:38,848 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 344.800000 2021-02-19 04:41:39,298 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4938.300000 2021-02-19 04:41:39,413 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3158.600000 2021-02-19 04:41:39,556 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4754.000000 2021-02-19 04:41:39,795 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:39,957 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4995.200000 2021-02-19 04:41:40,056 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:40,187 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8915.900000 2021-02-19 04:41:40,237 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:40,424 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6318.200000 2021-02-19 04:41:40,459 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 344.800000 2021-02-19 04:41:40,891 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4725.500000 2021-02-19 04:41:41,042 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3158.600000 2021-02-19 04:41:41,171 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4754.000000 2021-02-19 04:41:41,275 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 67.03 % 2021-02-19 04:41:41,276 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 67.0328090336 2021-02-19 04:41:41,418 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:41,576 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4937.200000 2021-02-19 04:41:41,663 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:41,798 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8915.900000 2021-02-19 04:41:41,865 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:42,036 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6318.200000 2021-02-19 04:41:42,061 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 344.800000 2021-02-19 04:41:42,506 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4186.400000 2021-02-19 04:41:42,690 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3822.500000 2021-02-19 04:41:42,786 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4702.600000 2021-02-19 04:41:43,032 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:43,194 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4826.900000 2021-02-19 04:41:43,279 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:41:43,414 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8687.300000 2021-02-19 04:41:43,523 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:43,671 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5617.700000 2021-02-19 04:41:43,673 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2343.000000 2021-02-19 04:41:44,115 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4186.400000 2021-02-19 04:41:44,348 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4333.800000 2021-02-19 04:41:44,408 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4664.600000 2021-02-19 04:41:44,655 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:44,802 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4746.800000 2021-02-19 04:41:44,918 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:41:45,025 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8687.300000 2021-02-19 04:41:45,141 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:45,295 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2343.000000 2021-02-19 04:41:45,349 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4920.400000 2021-02-19 04:41:45,739 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3493.400000 2021-02-19 04:41:45,987 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4333.800000 2021-02-19 04:41:46,016 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4664.600000 2021-02-19 04:41:46,259 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:46,322 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 67.27 % 2021-02-19 04:41:46,323 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 67.2657227141 2021-02-19 04:41:46,421 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4746.800000 2021-02-19 04:41:46,549 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.799251 2021-02-19 04:41:46,641 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8512.014928 2021-02-19 04:41:46,760 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:46,890 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4309.932551 2021-02-19 04:41:46,980 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4920.400000 2021-02-19 04:41:47,345 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3493.400000 2021-02-19 04:41:47,608 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4661.466450 2021-02-19 04:41:47,667 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4664.600000 2021-02-19 04:41:47,865 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:48,051 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4746.800000 2021-02-19 04:41:48,161 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.799251 2021-02-19 04:41:48,240 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8512.014928 2021-02-19 04:41:48,378 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:48,497 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4309.932551 2021-02-19 04:41:48,615 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4920.400000 2021-02-19 04:41:48,944 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3493.400000 2021-02-19 04:41:49,223 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4661.466450 2021-02-19 04:41:49,282 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4664.600000 2021-02-19 04:41:49,476 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:49,664 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4724.200000 2021-02-19 04:41:49,769 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.799251 2021-02-19 04:41:49,848 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8512.014928 2021-02-19 04:41:49,982 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:50,155 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4309.932551 2021-02-19 04:41:50,279 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4621.900000 2021-02-19 04:41:50,561 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3246.300000 2021-02-19 04:41:50,845 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4846.366450 2021-02-19 04:41:50,888 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4649.100000 2021-02-19 04:41:51,082 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:51,289 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4724.200000 2021-02-19 04:41:51,371 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 67.52 % 2021-02-19 04:41:51,371 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.799251 2021-02-19 04:41:51,371 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 67.5167069931 2021-02-19 04:41:51,457 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8512.014928 2021-02-19 04:41:51,612 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:51,765 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4309.932551 2021-02-19 04:41:51,888 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4621.900000 2021-02-19 04:41:52,207 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3246.300000 2021-02-19 04:41:52,496 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4826.166450 2021-02-19 04:41:52,523 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4614.700000 2021-02-19 04:41:52,700 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:52,901 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4746.300000 2021-02-19 04:41:52,973 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.499251 2021-02-19 04:41:53,058 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8575.514928 2021-02-19 04:41:53,234 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:53,365 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4631.232551 2021-02-19 04:41:53,500 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4502.300000 2021-02-19 04:41:53,808 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3611.000000 2021-02-19 04:41:54,138 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4826.166450 2021-02-19 04:41:54,160 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4614.700000 2021-02-19 04:41:54,309 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:54,519 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4760.600000 2021-02-19 04:41:54,589 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.499251 2021-02-19 04:41:54,677 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8575.514928 2021-02-19 04:41:54,872 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:54,964 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4631.232551 2021-02-19 04:41:55,108 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4502.300000 2021-02-19 04:41:55,385 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 67.73 % 2021-02-19 04:41:55,387 | test | INFO | MainThread | [Magma:abort_rebalance:933] Rebalance % = 67.7250454678 2021-02-19 04:41:55,420 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 67.73 % 2021-02-19 04:41:55,427 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4270.200000 2021-02-19 04:41:55,434 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:41:55,434 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:41:55,772 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4642.772409 2021-02-19 04:41:55,782 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4584.400000 2021-02-19 04:41:55,904 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:56,125 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4760.600000 2021-02-19 04:41:56,206 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:56,298 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8608.935203 2021-02-19 04:41:56,410 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 67.78 % 2021-02-19 04:41:56,411 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 67.7803333037 2021-02-19 04:41:56,539 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:56,621 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4642.884927 2021-02-19 04:41:56,717 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4442.300000 2021-02-19 04:41:57,059 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4270.200000 2021-02-19 04:41:57,400 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4642.772409 2021-02-19 04:41:57,407 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4584.400000 2021-02-19 04:41:57,513 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:57,743 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4760.600000 2021-02-19 04:41:57,826 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:57,920 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8608.935203 2021-02-19 04:41:58,135 | infra | INFO | pool-2-thread-34 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:41:58,137 | infra | INFO | pool-2-thread-34 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:41:58,145 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:58,259 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4642.884927 2021-02-19 04:41:58,372 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4442.300000 2021-02-19 04:41:58,677 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4270.200000 2021-02-19 04:41:59,036 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4584.400000 2021-02-19 04:41:59,053 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4642.772409 2021-02-19 04:41:59,131 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:41:59,384 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4760.600000 2021-02-19 04:41:59,433 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:41:59,553 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8608.935203 2021-02-19 04:41:59,779 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:41:59,885 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4642.884927 2021-02-19 04:41:59,983 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4442.300000 2021-02-19 04:42:00,286 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4675.800000 2021-02-19 04:42:00,688 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4568.100000 2021-02-19 04:42:00,713 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4725.472409 2021-02-19 04:42:00,746 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:01,059 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4790.700000 2021-02-19 04:42:01,069 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:01,187 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8608.935203 2021-02-19 04:42:01,385 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:01,446 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 68.02 % 2021-02-19 04:42:01,447 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 68.0196534186 2021-02-19 04:42:01,496 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4642.884927 2021-02-19 04:42:01,614 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4383.800000 2021-02-19 04:42:01,917 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4675.800000 2021-02-19 04:42:02,306 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4569.300000 2021-02-19 04:42:02,334 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4742.672409 2021-02-19 04:42:02,371 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:02,680 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4803.400000 2021-02-19 04:42:02,721 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:02,831 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8532.735203 2021-02-19 04:42:03,026 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:03,157 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4658.084927 2021-02-19 04:42:03,275 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4337.000000 2021-02-19 04:42:03,523 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4778.400000 2021-02-19 04:42:03,934 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4569.300000 2021-02-19 04:42:03,964 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4742.672409 2021-02-19 04:42:03,990 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:04,313 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4802.300000 2021-02-19 04:42:04,336 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:04,447 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8532.735203 2021-02-19 04:42:04,637 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:04,772 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4658.084927 2021-02-19 04:42:04,897 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4337.000000 2021-02-19 04:42:05,122 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4778.400000 2021-02-19 04:42:05,453 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 68.22 % 2021-02-19 04:42:05,469 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:42:05,469 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:42:05,575 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4565.600000 2021-02-19 04:42:05,631 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:05,631 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4732.200000 2021-02-19 04:42:05,951 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4802.300000 2021-02-19 04:42:05,953 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:06,056 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8532.735203 2021-02-19 04:42:06,243 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:06,384 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4657.400000 2021-02-19 04:42:06,490 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 68.23 % 2021-02-19 04:42:06,490 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 68.2295804452 2021-02-19 04:42:06,535 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4335.000000 2021-02-19 04:42:06,736 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4714.500000 2021-02-19 04:42:07,213 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4565.600000 2021-02-19 04:42:07,256 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:07,286 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4732.200000 2021-02-19 04:42:07,582 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:42:07,591 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4802.300000 2021-02-19 04:42:07,680 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8460.600000 2021-02-19 04:42:07,848 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:08,007 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4657.400000 2021-02-19 04:42:08,190 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4335.000000 2021-02-19 04:42:08,346 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4714.500000 2021-02-19 04:42:08,864 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4565.600000 2021-02-19 04:42:08,904 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:08,933 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4732.200000 2021-02-19 04:42:09,196 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:42:09,214 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4802.300000 2021-02-19 04:42:09,296 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8460.600000 2021-02-19 04:42:09,453 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.600000 2021-02-19 04:42:09,638 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4657.400000 2021-02-19 04:42:09,858 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4354.300000 2021-02-19 04:42:10,028 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4714.500000 2021-02-19 04:42:10,507 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4561.500000 2021-02-19 04:42:10,532 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:10,595 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4887.700000 2021-02-19 04:42:10,846 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:42:10,887 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4761.600000 2021-02-19 04:42:10,933 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8460.600000 2021-02-19 04:42:11,066 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.600000 2021-02-19 04:42:11,250 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4657.400000 2021-02-19 04:42:11,484 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4354.300000 2021-02-19 04:42:11,532 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 68.56 % 2021-02-19 04:42:11,533 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 68.5550451447 2021-02-19 04:42:11,661 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4684.500000 2021-02-19 04:42:12,151 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4561.500000 2021-02-19 04:42:12,161 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:12,253 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4887.700000 2021-02-19 04:42:12,301 | infra | INFO | pool-2-thread-37 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope4_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:42:12,302 | infra | INFO | pool-2-thread-37 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:42:12,463 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.800000 2021-02-19 04:42:12,507 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4705.900000 2021-02-19 04:42:12,552 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8490.300000 2021-02-19 04:42:12,677 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.900000 2021-02-19 04:42:12,852 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4593.600000 2021-02-19 04:42:13,099 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4357.000000 2021-02-19 04:42:13,285 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4654.300000 2021-02-19 04:42:13,779 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4578.900000 2021-02-19 04:42:13,802 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:13,882 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5171.600000 2021-02-19 04:42:14,076 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.800000 2021-02-19 04:42:14,141 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4705.900000 2021-02-19 04:42:14,171 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8490.300000 2021-02-19 04:42:14,295 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.600000 2021-02-19 04:42:14,448 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4593.600000 2021-02-19 04:42:14,720 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4378.000000 2021-02-19 04:42:14,892 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4654.300000 2021-02-19 04:42:15,440 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4589.100000 2021-02-19 04:42:15,457 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:15,480 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 68.72 % 2021-02-19 04:42:15,492 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:42:15,492 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:42:15,540 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5765.200000 2021-02-19 04:42:15,717 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:42:15,763 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4663.600000 2021-02-19 04:42:15,795 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8453.400000 2021-02-19 04:42:15,908 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.600000 2021-02-19 04:42:16,053 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4593.600000 2021-02-19 04:42:16,345 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4378.000000 2021-02-19 04:42:16,510 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4645.400000 2021-02-19 04:42:16,572 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 68.82 % 2021-02-19 04:42:16,573 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 68.8183757267 2021-02-19 04:42:17,066 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4589.100000 2021-02-19 04:42:17,092 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:17,178 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5765.200000 2021-02-19 04:42:17,325 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:42:17,413 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8453.400000 2021-02-19 04:42:17,430 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4663.600000 2021-02-19 04:42:17,528 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.600000 2021-02-19 04:42:17,658 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4551.400000 2021-02-19 04:42:17,944 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4378.000000 2021-02-19 04:42:18,118 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4645.400000 2021-02-19 04:42:18,683 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4589.100000 2021-02-19 04:42:18,740 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:18,835 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5765.200000 2021-02-19 04:42:18,934 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:42:19,056 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8453.400000 2021-02-19 04:42:19,073 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4663.600000 2021-02-19 04:42:19,176 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.600000 2021-02-19 04:42:19,255 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4551.400000 2021-02-19 04:42:19,562 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4772.000000 2021-02-19 04:42:19,730 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4363.400000 2021-02-19 04:42:20,325 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4471.800000 2021-02-19 04:42:20,377 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:20,477 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6073.700000 2021-02-19 04:42:20,548 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:42:20,671 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 8453.400000 2021-02-19 04:42:20,697 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4599.100000 2021-02-19 04:42:20,811 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.000000 2021-02-19 04:42:20,862 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4551.400000 2021-02-19 04:42:21,177 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4772.000000 2021-02-19 04:42:21,358 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4363.400000 2021-02-19 04:42:21,619 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 69.07 % 2021-02-19 04:42:21,619 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 69.0687952672 2021-02-19 04:42:21,971 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4471.800000 2021-02-19 04:42:22,000 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:22,150 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6073.700000 2021-02-19 04:42:22,165 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:42:22,288 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7030.500000 2021-02-19 04:42:22,335 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4594.800000 2021-02-19 04:42:22,433 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.700000 2021-02-19 04:42:22,476 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4696.200000 2021-02-19 04:42:22,786 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5408.700000 2021-02-19 04:42:22,986 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3873.400000 2021-02-19 04:42:23,599 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4096.400000 2021-02-19 04:42:23,611 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:23,780 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6044.100000 2021-02-19 04:42:23,793 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:23,908 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7030.500000 2021-02-19 04:42:23,953 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4594.800000 2021-02-19 04:42:24,045 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.700000 2021-02-19 04:42:24,086 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4696.200000 2021-02-19 04:42:24,407 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6125.500000 2021-02-19 04:42:24,605 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3316.600000 2021-02-19 04:42:25,243 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3716.700000 2021-02-19 04:42:25,257 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:25,418 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:25,437 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5782.600000 2021-02-19 04:42:25,503 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 69.37 % 2021-02-19 04:42:25,516 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:42:25,516 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:42:25,535 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5304.100000 2021-02-19 04:42:25,579 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4593.300000 2021-02-19 04:42:25,667 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:25,684 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4841.900000 2021-02-19 04:42:26,058 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6125.500000 2021-02-19 04:42:26,265 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3316.600000 2021-02-19 04:42:26,658 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 69.38 % 2021-02-19 04:42:26,658 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 69.3813489251 2021-02-19 04:42:26,908 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:26,924 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3716.700000 2021-02-19 04:42:27,033 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:27,084 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5426.000000 2021-02-19 04:42:27,153 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5304.100000 2021-02-19 04:42:27,201 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4593.300000 2021-02-19 04:42:27,302 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4841.900000 2021-02-19 04:42:27,319 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:27,693 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6125.500000 2021-02-19 04:42:27,921 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3316.600000 2021-02-19 04:42:28,519 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:28,594 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3716.700000 2021-02-19 04:42:28,707 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:28,721 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5426.000000 2021-02-19 04:42:28,819 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5304.100000 2021-02-19 04:42:28,835 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4593.300000 2021-02-19 04:42:28,938 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:28,957 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4841.900000 2021-02-19 04:42:29,319 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6125.500000 2021-02-19 04:42:29,563 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3363.200000 2021-02-19 04:42:30,115 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:30,221 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3495.200000 2021-02-19 04:42:30,339 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:30,381 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5614.300000 2021-02-19 04:42:30,434 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5304.100000 2021-02-19 04:42:30,476 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4704.400000 2021-02-19 04:42:30,559 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:30,579 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4841.900000 2021-02-19 04:42:30,951 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6462.700000 2021-02-19 04:42:31,201 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3363.200000 2021-02-19 04:42:31,701 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 69.74 % 2021-02-19 04:42:31,701 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 69.7401665485 2021-02-19 04:42:31,730 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:31,838 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3495.200000 2021-02-19 04:42:31,960 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:32,020 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5614.300000 2021-02-19 04:42:32,042 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5304.100000 2021-02-19 04:42:32,122 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4704.400000 2021-02-19 04:42:32,197 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:32,210 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4841.900000 2021-02-19 04:42:32,566 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6613.000000 2021-02-19 04:42:32,821 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3854.100000 2021-02-19 04:42:33,357 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:33,473 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3655.800000 2021-02-19 04:42:33,579 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:42:33,657 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6034.000000 2021-02-19 04:42:33,677 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4845.200000 2021-02-19 04:42:33,803 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4757.700000 2021-02-19 04:42:33,836 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:33,862 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4821.400000 2021-02-19 04:42:34,180 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6668.200000 2021-02-19 04:42:34,421 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4481.900000 2021-02-19 04:42:34,980 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:35,107 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3655.800000 2021-02-19 04:42:35,232 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:42:35,342 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6865.800000 2021-02-19 04:42:35,355 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4845.200000 2021-02-19 04:42:35,473 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:35,486 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4776.300000 2021-02-19 04:42:35,500 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4805.500000 2021-02-19 04:42:35,532 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 69.94 % 2021-02-19 04:42:35,545 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:42:35,546 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:42:35,802 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6668.200000 2021-02-19 04:42:36,039 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4481.900000 2021-02-19 04:42:36,579 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:36,737 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3834.600000 2021-02-19 04:42:36,743 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 70.00 % 2021-02-19 04:42:36,743 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 70.0 2021-02-19 04:42:36,832 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.800000 2021-02-19 04:42:36,973 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4774.900000 2021-02-19 04:42:36,984 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6702.500000 2021-02-19 04:42:37,098 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:37,114 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4805.500000 2021-02-19 04:42:37,128 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4776.300000 2021-02-19 04:42:37,421 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6668.200000 2021-02-19 04:42:37,648 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4481.900000 2021-02-19 04:42:38,170 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:38,345 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3834.600000 2021-02-19 04:42:38,434 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.800000 2021-02-19 04:42:38,622 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4774.900000 2021-02-19 04:42:38,638 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6702.500000 2021-02-19 04:42:38,723 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4805.500000 2021-02-19 04:42:38,740 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:38,753 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4776.300000 2021-02-19 04:42:39,045 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6668.200000 2021-02-19 04:42:39,267 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4481.900000 2021-02-19 04:42:39,778 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:39,993 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3834.600000 2021-02-19 04:42:40,052 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.800000 2021-02-19 04:42:40,250 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4774.900000 2021-02-19 04:42:40,266 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7209.200000 2021-02-19 04:42:40,342 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4805.500000 2021-02-19 04:42:40,371 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:40,390 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4680.800000 2021-02-19 04:42:40,664 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6723.700000 2021-02-19 04:42:40,878 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4750.500000 2021-02-19 04:42:41,414 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:41,630 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4079.500000 2021-02-19 04:42:41,663 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.800000 2021-02-19 04:42:41,786 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 70.00 % 2021-02-19 04:42:41,786 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 70.0 2021-02-19 04:42:41,871 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4774.900000 2021-02-19 04:42:41,944 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7209.200000 2021-02-19 04:42:41,967 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4805.500000 2021-02-19 04:42:42,025 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4680.800000 2021-02-19 04:42:42,039 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:42,272 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6713.700000 2021-02-19 04:42:42,487 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4765.100000 2021-02-19 04:42:43,009 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:43,256 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4291.800000 2021-02-19 04:42:43,273 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:42:43,526 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4734.100000 2021-02-19 04:42:43,578 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7622.000000 2021-02-19 04:42:43,591 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4781.300000 2021-02-19 04:42:43,644 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4538.800000 2021-02-19 04:42:43,694 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:43,907 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6713.700000 2021-02-19 04:42:44,111 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4765.100000 2021-02-19 04:42:44,631 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:44,874 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:42:44,891 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4519.200000 2021-02-19 04:42:45,130 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4734.100000 2021-02-19 04:42:45,203 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4781.300000 2021-02-19 04:42:45,220 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7848.200000 2021-02-19 04:42:45,276 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4464.200000 2021-02-19 04:42:45,323 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:45,526 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6649.300000 2021-02-19 04:42:45,559 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 70.00 % 2021-02-19 04:42:45,571 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:42:45,571 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:42:45,720 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4689.800000 2021-02-19 04:42:46,230 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:46,500 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:46,516 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4519.200000 2021-02-19 04:42:46,744 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4672.800000 2021-02-19 04:42:46,819 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4699.700000 2021-02-19 04:42:46,834 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 70.00 % 2021-02-19 04:42:46,834 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 70.0 2021-02-19 04:42:46,842 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7552.600000 2021-02-19 04:42:46,895 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4464.200000 2021-02-19 04:42:46,953 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:47,144 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6649.300000 2021-02-19 04:42:47,316 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4689.800000 2021-02-19 04:42:47,861 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:48,115 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:48,140 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4519.200000 2021-02-19 04:42:48,351 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4672.800000 2021-02-19 04:42:48,450 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4699.700000 2021-02-19 04:42:48,513 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7552.600000 2021-02-19 04:42:48,523 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4464.200000 2021-02-19 04:42:48,598 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:48,755 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6649.300000 2021-02-19 04:42:48,934 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4689.800000 2021-02-19 04:42:49,483 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:49,716 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:49,760 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4640.900000 2021-02-19 04:42:49,967 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4672.800000 2021-02-19 04:42:50,072 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4699.700000 2021-02-19 04:42:50,161 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4464.200000 2021-02-19 04:42:50,190 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7552.600000 2021-02-19 04:42:50,266 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:50,371 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6563.100000 2021-02-19 04:42:50,578 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4653.900000 2021-02-19 04:42:51,089 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:51,319 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:51,381 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4640.900000 2021-02-19 04:42:51,578 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4672.800000 2021-02-19 04:42:51,677 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4699.700000 2021-02-19 04:42:51,790 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4422.100000 2021-02-19 04:42:51,819 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8189.100000 2021-02-19 04:42:51,872 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 70.23 % 2021-02-19 04:42:51,872 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 70.2305444232 2021-02-19 04:42:51,882 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:51,983 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6563.100000 2021-02-19 04:42:52,190 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4653.900000 2021-02-19 04:42:52,694 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:52,818 | infra | INFO | pool-2-thread-60 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:42:52,819 | infra | INFO | pool-2-thread-60 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:42:52,913 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:52,983 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4600.700000 2021-02-19 04:42:53,187 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4292.100000 2021-02-19 04:42:53,282 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4619.400000 2021-02-19 04:42:53,413 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4444.800000 2021-02-19 04:42:53,457 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8376.400000 2021-02-19 04:42:53,496 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:53,598 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6511.300000 2021-02-19 04:42:53,813 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4576.700000 2021-02-19 04:42:54,309 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:54,517 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:54,592 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4518.500000 2021-02-19 04:42:54,851 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4292.100000 2021-02-19 04:42:54,941 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4619.400000 2021-02-19 04:42:55,046 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4444.800000 2021-02-19 04:42:55,092 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8376.400000 2021-02-19 04:42:55,140 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:55,256 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6482.800000 2021-02-19 04:42:55,424 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4497.800000 2021-02-19 04:42:55,588 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 70.42 % 2021-02-19 04:42:55,601 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:42:55,601 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:42:55,917 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:56,118 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:56,239 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4518.500000 2021-02-19 04:42:56,486 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3426.100000 2021-02-19 04:42:56,553 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4650.300000 2021-02-19 04:42:56,683 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4418.100000 2021-02-19 04:42:56,733 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8571.200000 2021-02-19 04:42:56,779 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:56,882 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6482.800000 2021-02-19 04:42:56,917 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 70.58 % 2021-02-19 04:42:56,918 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 70.5768599295 2021-02-19 04:42:57,046 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4497.800000 2021-02-19 04:42:57,516 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:57,723 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:57,849 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4518.500000 2021-02-19 04:42:58,111 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3426.100000 2021-02-19 04:42:58,154 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4650.300000 2021-02-19 04:42:58,305 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4418.100000 2021-02-19 04:42:58,391 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8571.200000 2021-02-19 04:42:58,394 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:42:58,546 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6482.800000 2021-02-19 04:42:58,661 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4497.800000 2021-02-19 04:42:59,130 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:42:59,331 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:42:59,483 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3687.700000 2021-02-19 04:42:59,749 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3435.000000 2021-02-19 04:42:59,770 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4650.300000 2021-02-19 04:42:59,927 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4516.400000 2021-02-19 04:43:00,025 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:43:00,052 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8571.200000 2021-02-19 04:43:00,203 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6482.800000 2021-02-19 04:43:00,286 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4391.600000 2021-02-19 04:43:00,740 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:00,941 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:01,105 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3687.700000 2021-02-19 04:43:01,361 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3435.000000 2021-02-19 04:43:01,368 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4650.300000 2021-02-19 04:43:01,542 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4516.400000 2021-02-19 04:43:01,686 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8592.300000 2021-02-19 04:43:01,687 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:43:01,832 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6642.900000 2021-02-19 04:43:01,900 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4391.600000 2021-02-19 04:43:01,957 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 71.00 % 2021-02-19 04:43:01,957 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 71.0008531232 2021-02-19 04:43:02,345 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:02,542 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:43:02,709 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2530.900000 2021-02-19 04:43:02,986 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5521.300000 2021-02-19 04:43:03,010 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1946.300000 2021-02-19 04:43:03,164 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4695.100000 2021-02-19 04:43:03,313 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8667.200000 2021-02-19 04:43:03,322 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.400000 2021-02-19 04:43:03,515 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6833.700000 2021-02-19 04:43:03,569 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4385.800000 2021-02-19 04:43:03,950 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:04,142 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:43:04,325 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1093.200000 2021-02-19 04:43:04,595 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5521.300000 2021-02-19 04:43:04,641 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1972.900000 2021-02-19 04:43:04,795 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4941.000000 2021-02-19 04:43:04,940 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8780.100000 2021-02-19 04:43:04,950 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.900000 2021-02-19 04:43:05,138 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6833.700000 2021-02-19 04:43:05,187 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4414.800000 2021-02-19 04:43:05,563 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:05,611 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 71.23 % 2021-02-19 04:43:05,622 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:43:05,622 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:43:05,749 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.700000 2021-02-19 04:43:05,933 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1093.200000 2021-02-19 04:43:06,207 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5521.300000 2021-02-19 04:43:06,262 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 932.400000 2021-02-19 04:43:06,415 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4941.000000 2021-02-19 04:43:06,568 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8780.100000 2021-02-19 04:43:06,578 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.900000 2021-02-19 04:43:06,826 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7113.600000 2021-02-19 04:43:06,842 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4414.800000 2021-02-19 04:43:07,000 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 71.28 % 2021-02-19 04:43:07,000 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 71.2826914402 2021-02-19 04:43:07,163 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:07,346 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.700000 2021-02-19 04:43:07,545 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1093.200000 2021-02-19 04:43:07,823 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6535.400000 2021-02-19 04:43:07,875 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 932.400000 2021-02-19 04:43:08,013 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4941.000000 2021-02-19 04:43:08,184 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8780.100000 2021-02-19 04:43:08,220 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.900000 2021-02-19 04:43:08,496 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7113.600000 2021-02-19 04:43:08,512 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4414.800000 2021-02-19 04:43:08,798 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:08,944 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.700000 2021-02-19 04:43:09,180 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1093.200000 2021-02-19 04:43:09,434 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6535.400000 2021-02-19 04:43:09,486 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 939.900000 2021-02-19 04:43:09,618 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5144.400000 2021-02-19 04:43:09,805 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8853.800000 2021-02-19 04:43:09,838 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.700000 2021-02-19 04:43:10,121 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7113.600000 2021-02-19 04:43:10,144 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4414.800000 2021-02-19 04:43:10,390 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:10,543 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.700000 2021-02-19 04:43:10,815 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 375.100000 2021-02-19 04:43:11,039 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6535.400000 2021-02-19 04:43:11,088 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 939.900000 2021-02-19 04:43:11,230 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5144.400000 2021-02-19 04:43:11,428 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8853.800000 2021-02-19 04:43:11,456 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.700000 2021-02-19 04:43:11,732 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7229.400000 2021-02-19 04:43:11,762 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4444.400000 2021-02-19 04:43:11,996 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:12,036 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 71.69 % 2021-02-19 04:43:12,038 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 71.6925150311 2021-02-19 04:43:12,154 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.700000 2021-02-19 04:43:12,430 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 32.900000 2021-02-19 04:43:12,645 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6717.600000 2021-02-19 04:43:12,697 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 830.400000 2021-02-19 04:43:12,854 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5285.400000 2021-02-19 04:43:13,102 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8915.800000 2021-02-19 04:43:13,124 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.300000 2021-02-19 04:43:13,359 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7409.800000 2021-02-19 04:43:13,378 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4435.500000 2021-02-19 04:43:13,618 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:13,760 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.400000 2021-02-19 04:43:14,053 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 32.900000 2021-02-19 04:43:14,276 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6717.600000 2021-02-19 04:43:14,305 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 854.800000 2021-02-19 04:43:14,473 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5392.000000 2021-02-19 04:43:14,716 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8955.000000 2021-02-19 04:43:14,740 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.800000 2021-02-19 04:43:14,989 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7409.800000 2021-02-19 04:43:15,006 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4435.500000 2021-02-19 04:43:15,217 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:15,357 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.400000 2021-02-19 04:43:15,632 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 71.88 % 2021-02-19 04:43:15,644 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:43:15,644 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:43:15,664 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:15,888 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6672.100000 2021-02-19 04:43:15,915 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 734.500000 2021-02-19 04:43:16,096 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5392.000000 2021-02-19 04:43:16,302 | infra | INFO | pool-2-thread-42 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:43:16,303 | infra | INFO | pool-2-thread-42 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:43:16,355 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8955.000000 2021-02-19 04:43:16,365 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.800000 2021-02-19 04:43:16,598 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7553.100000 2021-02-19 04:43:16,631 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4403.400000 2021-02-19 04:43:16,855 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:16,954 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:17,078 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 72.02 % 2021-02-19 04:43:17,078 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 72.0207615456 2021-02-19 04:43:17,286 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:17,496 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6672.100000 2021-02-19 04:43:17,529 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 734.500000 2021-02-19 04:43:17,713 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5392.000000 2021-02-19 04:43:17,961 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8955.000000 2021-02-19 04:43:17,971 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.800000 2021-02-19 04:43:18,217 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7553.100000 2021-02-19 04:43:18,260 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4403.400000 2021-02-19 04:43:18,474 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:18,552 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:18,881 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:19,092 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6672.100000 2021-02-19 04:43:19,130 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 734.500000 2021-02-19 04:43:19,323 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5392.000000 2021-02-19 04:43:19,562 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8954.400000 2021-02-19 04:43:19,582 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:43:19,834 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7790.000000 2021-02-19 04:43:19,897 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4392.200000 2021-02-19 04:43:20,082 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:20,170 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:20,523 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:20,697 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6672.100000 2021-02-19 04:43:20,763 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 744.000000 2021-02-19 04:43:20,957 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5393.000000 2021-02-19 04:43:21,232 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8954.400000 2021-02-19 04:43:21,244 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:43:21,450 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7790.000000 2021-02-19 04:43:21,522 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4392.200000 2021-02-19 04:43:21,690 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:21,776 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:22,122 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 72.41 % 2021-02-19 04:43:22,122 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 72.4076190131 2021-02-19 04:43:22,132 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:22,315 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5639.200000 2021-02-19 04:43:22,371 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 662.100000 2021-02-19 04:43:22,572 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5419.300000 2021-02-19 04:43:22,884 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.800000 2021-02-19 04:43:22,897 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8999.600000 2021-02-19 04:43:23,075 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7944.800000 2021-02-19 04:43:23,130 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4409.100000 2021-02-19 04:43:23,299 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:23,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:23,753 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:23,923 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5639.200000 2021-02-19 04:43:23,982 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 662.100000 2021-02-19 04:43:24,220 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5419.300000 2021-02-19 04:43:24,500 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.400000 2021-02-19 04:43:24,530 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 9046.600000 2021-02-19 04:43:24,714 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8047.400000 2021-02-19 04:43:24,756 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4459.700000 2021-02-19 04:43:24,944 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:24,982 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:25,411 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:25,563 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3977.800000 2021-02-19 04:43:25,601 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 681.200000 2021-02-19 04:43:25,657 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 72.42 % 2021-02-19 04:43:25,671 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:43:25,671 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:43:25,848 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5456.600000 2021-02-19 04:43:26,138 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.400000 2021-02-19 04:43:26,170 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 9046.600000 2021-02-19 04:43:26,338 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8047.400000 2021-02-19 04:43:26,369 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4459.700000 2021-02-19 04:43:26,585 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:26,604 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:27,032 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:27,167 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 72.57 % 2021-02-19 04:43:27,167 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 72.568829189 2021-02-19 04:43:27,171 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3977.800000 2021-02-19 04:43:27,203 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 681.200000 2021-02-19 04:43:27,466 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5456.600000 2021-02-19 04:43:27,746 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.400000 2021-02-19 04:43:27,803 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 9046.600000 2021-02-19 04:43:27,987 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8047.400000 2021-02-19 04:43:28,003 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4459.700000 2021-02-19 04:43:28,198 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:28,214 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:28,660 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:28,809 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3977.800000 2021-02-19 04:43:28,832 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 681.200000 2021-02-19 04:43:29,076 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5456.600000 2021-02-19 04:43:29,368 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.400000 2021-02-19 04:43:29,437 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 9092.700000 2021-02-19 04:43:29,657 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4506.100000 2021-02-19 04:43:29,684 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8159.800000 2021-02-19 04:43:29,825 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:29,838 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:30,263 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:30,444 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3977.800000 2021-02-19 04:43:30,460 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 713.900000 2021-02-19 04:43:30,693 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5573.200000 2021-02-19 04:43:30,977 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 756.300000 2021-02-19 04:43:31,049 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 9092.700000 2021-02-19 04:43:31,276 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4506.100000 2021-02-19 04:43:31,296 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8159.800000 2021-02-19 04:43:31,434 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:31,446 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:31,875 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:32,085 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 713.900000 2021-02-19 04:43:32,099 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3977.800000 2021-02-19 04:43:32,207 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 72.90 % 2021-02-19 04:43:32,207 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 72.8999773497 2021-02-19 04:43:32,309 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5674.700000 2021-02-19 04:43:32,585 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1926.600000 2021-02-19 04:43:32,657 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8992.800000 2021-02-19 04:43:32,898 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4502.700000 2021-02-19 04:43:32,924 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8296.600000 2021-02-19 04:43:33,048 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.400000 2021-02-19 04:43:33,059 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:33,474 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:33,723 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 896.900000 2021-02-19 04:43:33,733 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2449.600000 2021-02-19 04:43:33,953 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5674.700000 2021-02-19 04:43:34,186 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1926.600000 2021-02-19 04:43:34,286 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8864.500000 2021-02-19 04:43:34,525 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4437.400000 2021-02-19 04:43:34,553 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8504.300000 2021-02-19 04:43:34,645 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.400000 2021-02-19 04:43:34,665 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:35,082 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:35,342 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2449.600000 2021-02-19 04:43:35,362 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 936.700000 2021-02-19 04:43:35,558 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5744.400000 2021-02-19 04:43:35,683 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 73.10 % 2021-02-19 04:43:35,696 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:43:35,696 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:43:35,811 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3422.800000 2021-02-19 04:43:35,901 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8864.500000 2021-02-19 04:43:36,165 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4437.400000 2021-02-19 04:43:36,201 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8504.300000 2021-02-19 04:43:36,247 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.000000 2021-02-19 04:43:36,318 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:36,697 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:36,937 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1470.400000 2021-02-19 04:43:36,964 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1007.700000 2021-02-19 04:43:37,171 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5744.400000 2021-02-19 04:43:37,253 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 73.23 % 2021-02-19 04:43:37,253 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 73.2345088752 2021-02-19 04:43:37,426 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3422.800000 2021-02-19 04:43:37,520 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8864.500000 2021-02-19 04:43:37,776 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4437.400000 2021-02-19 04:43:37,819 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8504.300000 2021-02-19 04:43:37,852 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.000000 2021-02-19 04:43:37,927 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:38,302 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:38,536 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1470.400000 2021-02-19 04:43:38,578 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1007.700000 2021-02-19 04:43:38,776 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5744.400000 2021-02-19 04:43:39,042 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3422.800000 2021-02-19 04:43:39,138 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8864.500000 2021-02-19 04:43:39,401 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4340.300000 2021-02-19 04:43:39,456 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8639.600000 2021-02-19 04:43:39,493 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.000000 2021-02-19 04:43:39,572 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:39,911 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:40,157 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1470.400000 2021-02-19 04:43:40,200 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1007.700000 2021-02-19 04:43:40,404 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5785.500000 2021-02-19 04:43:40,651 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4182.800000 2021-02-19 04:43:40,744 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8779.400000 2021-02-19 04:43:41,028 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4340.300000 2021-02-19 04:43:41,101 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.000000 2021-02-19 04:43:41,118 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8639.600000 2021-02-19 04:43:41,240 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:41,519 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:41,776 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1470.400000 2021-02-19 04:43:41,829 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 992.800000 2021-02-19 04:43:42,025 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5785.500000 2021-02-19 04:43:42,269 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4182.800000 2021-02-19 04:43:42,290 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 73.56 % 2021-02-19 04:43:42,290 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 73.558277033 2021-02-19 04:43:42,364 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8778.900000 2021-02-19 04:43:42,635 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4250.400000 2021-02-19 04:43:42,730 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 04:43:42,801 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8757.100000 2021-02-19 04:43:42,861 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:43,124 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:43,382 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1272.000000 2021-02-19 04:43:43,483 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 707.700000 2021-02-19 04:43:43,674 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5816.200000 2021-02-19 04:43:43,917 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4517.000000 2021-02-19 04:43:44,009 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8778.900000 2021-02-19 04:43:44,249 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4193.100000 2021-02-19 04:43:44,354 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 04:43:44,428 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8803.900000 2021-02-19 04:43:44,463 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:44,727 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:45,015 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1272.000000 2021-02-19 04:43:45,128 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 707.700000 2021-02-19 04:43:45,282 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5838.900000 2021-02-19 04:43:45,528 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4524.200000 2021-02-19 04:43:45,618 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8785.800000 2021-02-19 04:43:45,707 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 73.81 % 2021-02-19 04:43:45,720 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:43:45,720 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:43:45,880 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4193.100000 2021-02-19 04:43:45,970 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:46,051 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8803.900000 2021-02-19 04:43:46,088 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:46,348 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:46,621 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1159.300000 2021-02-19 04:43:46,773 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 419.500000 2021-02-19 04:43:46,894 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5838.900000 2021-02-19 04:43:47,134 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4524.200000 2021-02-19 04:43:47,239 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8785.800000 2021-02-19 04:43:47,334 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 73.87 % 2021-02-19 04:43:47,335 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 73.8678870232 2021-02-19 04:43:47,512 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4193.100000 2021-02-19 04:43:47,573 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:47,667 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8803.900000 2021-02-19 04:43:47,700 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:47,983 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:48,211 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1159.300000 2021-02-19 04:43:48,461 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 419.500000 2021-02-19 04:43:48,516 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5838.900000 2021-02-19 04:43:48,759 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4524.200000 2021-02-19 04:43:48,858 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8785.800000 2021-02-19 04:43:49,157 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4193.100000 2021-02-19 04:43:49,210 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:49,319 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8803.900000 2021-02-19 04:43:49,357 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:49,599 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:49,819 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1159.300000 2021-02-19 04:43:50,151 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 419.500000 2021-02-19 04:43:50,188 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5838.900000 2021-02-19 04:43:50,374 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4512.000000 2021-02-19 04:43:50,471 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8726.500000 2021-02-19 04:43:50,792 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4182.700000 2021-02-19 04:43:50,813 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:50,931 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8789.500000 2021-02-19 04:43:50,990 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:51,221 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:51,415 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1159.300000 2021-02-19 04:43:51,818 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 414.100000 2021-02-19 04:43:51,831 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5802.100000 2021-02-19 04:43:51,993 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4512.000000 2021-02-19 04:43:52,088 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8726.500000 2021-02-19 04:43:52,380 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 73.99 % 2021-02-19 04:43:52,381 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 73.9939168849 2021-02-19 04:43:52,413 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4264.700000 2021-02-19 04:43:52,420 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:52,568 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8787.300000 2021-02-19 04:43:52,632 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:52,841 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:53,030 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1118.800000 2021-02-19 04:43:53,456 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5808.600000 2021-02-19 04:43:53,506 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 406.800000 2021-02-19 04:43:53,621 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4521.600000 2021-02-19 04:43:53,711 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8728.900000 2021-02-19 04:43:54,033 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:43:54,052 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4264.700000 2021-02-19 04:43:54,246 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8787.300000 2021-02-19 04:43:54,312 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:54,473 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:54,618 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1118.800000 2021-02-19 04:43:55,081 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5808.600000 2021-02-19 04:43:55,141 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 406.800000 2021-02-19 04:43:55,239 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4526.400000 2021-02-19 04:43:55,338 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8741.700000 2021-02-19 04:43:55,644 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:43:55,676 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4371.800000 2021-02-19 04:43:55,733 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 74.27 % 2021-02-19 04:43:55,746 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:43:55,747 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:43:55,875 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8789.100000 2021-02-19 04:43:55,927 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:56,108 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:56,233 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1118.800000 2021-02-19 04:43:56,696 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5832.600000 2021-02-19 04:43:56,766 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 436.700000 2021-02-19 04:43:56,851 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4526.400000 2021-02-19 04:43:56,954 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8741.700000 2021-02-19 04:43:57,253 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:43:57,306 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4371.800000 2021-02-19 04:43:57,424 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 74.40 % 2021-02-19 04:43:57,424 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 74.4042450647 2021-02-19 04:43:57,483 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8789.100000 2021-02-19 04:43:57,523 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:57,710 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:57,832 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1065.400000 2021-02-19 04:43:58,358 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5832.600000 2021-02-19 04:43:58,395 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 436.700000 2021-02-19 04:43:58,484 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4526.400000 2021-02-19 04:43:58,572 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8741.700000 2021-02-19 04:43:58,904 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:43:58,924 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4371.800000 2021-02-19 04:43:59,104 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8789.100000 2021-02-19 04:43:59,135 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:43:59,339 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:43:59,451 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1065.400000 2021-02-19 04:43:59,993 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5875.000000 2021-02-19 04:44:00,012 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 436.700000 2021-02-19 04:44:00,095 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4526.400000 2021-02-19 04:44:00,188 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8741.700000 2021-02-19 04:44:00,503 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:44:00,530 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4442.100000 2021-02-19 04:44:00,710 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8853.100000 2021-02-19 04:44:00,733 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:00,948 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:01,049 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1065.400000 2021-02-19 04:44:01,631 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 434.800000 2021-02-19 04:44:01,647 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5875.000000 2021-02-19 04:44:01,733 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4547.200000 2021-02-19 04:44:01,819 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8821.900000 2021-02-19 04:44:02,095 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:44:02,177 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4442.100000 2021-02-19 04:44:02,342 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8865.700000 2021-02-19 04:44:02,374 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:02,473 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 74.85 % 2021-02-19 04:44:02,473 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 74.8507112279 2021-02-19 04:44:02,584 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:02,665 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1042.500000 2021-02-19 04:44:03,273 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 430.100000 2021-02-19 04:44:03,295 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5857.700000 2021-02-19 04:44:03,371 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4568.400000 2021-02-19 04:44:03,464 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8824.000000 2021-02-19 04:44:03,711 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:44:03,809 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4360.800000 2021-02-19 04:44:03,976 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8865.700000 2021-02-19 04:44:04,016 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:04,203 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:04,267 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1042.500000 2021-02-19 04:44:04,913 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 452.100000 2021-02-19 04:44:04,927 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5804.200000 2021-02-19 04:44:05,009 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4589.600000 2021-02-19 04:44:05,089 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8824.000000 2021-02-19 04:44:05,298 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.300000 2021-02-19 04:44:05,414 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4210.500000 2021-02-19 04:44:05,660 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8878.400000 2021-02-19 04:44:05,698 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:05,760 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 75.03 % 2021-02-19 04:44:05,775 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:44:05,775 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:44:05,823 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:05,859 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1057.900000 2021-02-19 04:44:06,561 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5804.200000 2021-02-19 04:44:06,572 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 435.900000 2021-02-19 04:44:06,631 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4589.600000 2021-02-19 04:44:06,740 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8812.600000 2021-02-19 04:44:06,888 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:07,048 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4210.500000 2021-02-19 04:44:07,312 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8878.400000 2021-02-19 04:44:07,338 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:07,447 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:07,473 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1057.900000 2021-02-19 04:44:07,515 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 75.16 % 2021-02-19 04:44:07,516 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 75.1564847728 2021-02-19 04:44:08,190 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5804.200000 2021-02-19 04:44:08,242 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 435.900000 2021-02-19 04:44:08,299 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4589.600000 2021-02-19 04:44:08,382 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8812.600000 2021-02-19 04:44:08,505 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:08,673 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4210.500000 2021-02-19 04:44:08,930 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8878.400000 2021-02-19 04:44:08,953 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:09,046 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:09,075 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1057.900000 2021-02-19 04:44:09,818 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5796.300000 2021-02-19 04:44:09,871 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 441.700000 2021-02-19 04:44:09,931 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4580.500000 2021-02-19 04:44:09,990 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8838.900000 2021-02-19 04:44:10,105 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:10,289 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4126.400000 2021-02-19 04:44:10,540 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8871.100000 2021-02-19 04:44:10,572 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:10,660 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:10,677 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1057.900000 2021-02-19 04:44:11,451 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5796.300000 2021-02-19 04:44:11,530 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 441.700000 2021-02-19 04:44:11,581 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4580.500000 2021-02-19 04:44:11,608 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8838.900000 2021-02-19 04:44:11,710 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:11,901 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4126.400000 2021-02-19 04:44:12,232 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8871.100000 2021-02-19 04:44:12,259 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:12,295 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1071.100000 2021-02-19 04:44:12,312 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:12,559 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 75.36 % 2021-02-19 04:44:12,559 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 75.363484105 2021-02-19 04:44:13,089 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5816.300000 2021-02-19 04:44:13,198 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 371.000000 2021-02-19 04:44:13,232 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4551.700000 2021-02-19 04:44:13,266 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8864.900000 2021-02-19 04:44:13,318 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:13,506 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4138.500000 2021-02-19 04:44:13,851 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8875.800000 2021-02-19 04:44:13,898 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1071.100000 2021-02-19 04:44:13,910 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:13,957 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:14,704 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5889.100000 2021-02-19 04:44:14,859 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 320.400000 2021-02-19 04:44:14,878 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4533.800000 2021-02-19 04:44:14,918 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8898.600000 2021-02-19 04:44:14,944 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:15,119 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4138.500000 2021-02-19 04:44:15,489 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8881.400000 2021-02-19 04:44:15,503 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1058.600000 2021-02-19 04:44:15,573 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:15,617 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:15,789 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 75.56 % 2021-02-19 04:44:15,802 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:44:15,802 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:44:16,316 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5889.100000 2021-02-19 04:44:16,492 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 236.900000 2021-02-19 04:44:16,516 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4533.800000 2021-02-19 04:44:16,538 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8898.600000 2021-02-19 04:44:16,553 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:16,749 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4217.900000 2021-02-19 04:44:17,122 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1058.600000 2021-02-19 04:44:17,151 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8881.400000 2021-02-19 04:44:17,223 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:17,266 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:17,601 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 75.58 % 2021-02-19 04:44:17,602 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 75.5778405697 2021-02-19 04:44:17,937 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5889.100000 2021-02-19 04:44:18,150 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4533.800000 2021-02-19 04:44:18,177 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8898.600000 2021-02-19 04:44:18,203 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 236.900000 2021-02-19 04:44:18,221 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:18,374 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4217.900000 2021-02-19 04:44:18,739 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1058.600000 2021-02-19 04:44:18,772 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8881.400000 2021-02-19 04:44:18,858 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:18,884 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:19,578 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5895.500000 2021-02-19 04:44:19,783 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4532.300000 2021-02-19 04:44:19,805 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8859.700000 2021-02-19 04:44:19,858 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 215.400000 2021-02-19 04:44:19,872 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:19,994 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4237.400000 2021-02-19 04:44:20,338 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1058.600000 2021-02-19 04:44:20,387 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8855.500000 2021-02-19 04:44:20,503 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:20,519 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:21,186 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5895.500000 2021-02-19 04:44:21,404 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4532.300000 2021-02-19 04:44:21,430 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8859.700000 2021-02-19 04:44:21,503 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 215.400000 2021-02-19 04:44:21,519 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:21,651 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4237.400000 2021-02-19 04:44:21,936 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1058.600000 2021-02-19 04:44:21,996 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8855.500000 2021-02-19 04:44:22,118 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:22,135 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:22,642 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 75.82 % 2021-02-19 04:44:22,642 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 75.8206506923 2021-02-19 04:44:22,859 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5872.500000 2021-02-19 04:44:23,048 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4537.700000 2021-02-19 04:44:23,114 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8843.500000 2021-02-19 04:44:23,138 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:23,170 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 182.300000 2021-02-19 04:44:23,283 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4268.800000 2021-02-19 04:44:23,536 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1044.000000 2021-02-19 04:44:23,615 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8829.900000 2021-02-19 04:44:23,756 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:23,763 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:24,493 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5810.700000 2021-02-19 04:44:24,691 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4505.100000 2021-02-19 04:44:24,743 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8849.000000 2021-02-19 04:44:24,755 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:24,819 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 244.200000 2021-02-19 04:44:24,907 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4315.300000 2021-02-19 04:44:25,141 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1044.000000 2021-02-19 04:44:25,273 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8816.100000 2021-02-19 04:44:25,378 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:25,428 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:25,812 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 75.91 % 2021-02-19 04:44:25,825 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:44:25,825 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:44:26,125 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5810.700000 2021-02-19 04:44:26,328 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4505.100000 2021-02-19 04:44:26,367 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 04:44:26,391 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8849.000000 2021-02-19 04:44:26,486 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 300.300000 2021-02-19 04:44:26,542 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4315.300000 2021-02-19 04:44:26,760 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1056.700000 2021-02-19 04:44:26,930 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8816.100000 2021-02-19 04:44:27,002 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:27,049 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:27,683 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 75.96 % 2021-02-19 04:44:27,683 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 75.9574439217 2021-02-19 04:44:27,734 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5810.700000 2021-02-19 04:44:28,022 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 04:44:28,042 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4505.100000 2021-02-19 04:44:28,071 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8849.000000 2021-02-19 04:44:28,144 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 300.300000 2021-02-19 04:44:28,183 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4315.300000 2021-02-19 04:44:28,374 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1056.700000 2021-02-19 04:44:28,568 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8816.100000 2021-02-19 04:44:28,634 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:28,686 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:29,341 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5810.700000 2021-02-19 04:44:29,631 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 04:44:29,671 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4501.000000 2021-02-19 04:44:29,749 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8867.200000 2021-02-19 04:44:29,819 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 348.400000 2021-02-19 04:44:29,865 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4461.100000 2021-02-19 04:44:30,006 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1056.700000 2021-02-19 04:44:30,219 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8816.100000 2021-02-19 04:44:30,278 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:30,301 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:30,961 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5788.300000 2021-02-19 04:44:31,282 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 04:44:31,299 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4501.000000 2021-02-19 04:44:31,417 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8867.200000 2021-02-19 04:44:31,450 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 348.400000 2021-02-19 04:44:31,486 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4461.100000 2021-02-19 04:44:31,654 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1056.700000 2021-02-19 04:44:31,839 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8808.800000 2021-02-19 04:44:31,897 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:31,911 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:32,573 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5785.700000 2021-02-19 04:44:32,724 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 76.12 % 2021-02-19 04:44:32,724 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 76.1186655327 2021-02-19 04:44:32,894 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 04:44:32,924 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4494.600000 2021-02-19 04:44:33,049 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8896.000000 2021-02-19 04:44:33,086 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 459.500000 2021-02-19 04:44:33,117 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4583.700000 2021-02-19 04:44:33,257 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1071.100000 2021-02-19 04:44:33,440 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8809.800000 2021-02-19 04:44:33,503 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:33,516 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:34,174 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5785.700000 2021-02-19 04:44:34,519 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 04:44:34,555 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4547.500000 2021-02-19 04:44:34,693 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8906.500000 2021-02-19 04:44:34,740 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 419.500000 2021-02-19 04:44:34,766 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4690.800000 2021-02-19 04:44:34,868 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1071.100000 2021-02-19 04:44:35,068 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8809.800000 2021-02-19 04:44:35,131 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:35,154 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:35,822 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5784.500000 2021-02-19 04:44:35,839 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 76.26 % 2021-02-19 04:44:35,851 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:44:35,852 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:44:36,121 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 04:44:36,190 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4547.500000 2021-02-19 04:44:36,318 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8906.500000 2021-02-19 04:44:36,404 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 369.600000 2021-02-19 04:44:36,421 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4690.800000 2021-02-19 04:44:36,486 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1065.400000 2021-02-19 04:44:36,680 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8795.600000 2021-02-19 04:44:36,746 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:36,785 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:37,421 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5784.500000 2021-02-19 04:44:37,760 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 76.28 % 2021-02-19 04:44:37,760 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 76.2798871438 2021-02-19 04:44:37,769 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:37,809 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4547.500000 2021-02-19 04:44:37,953 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8906.500000 2021-02-19 04:44:38,055 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 369.600000 2021-02-19 04:44:38,068 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4690.800000 2021-02-19 04:44:38,101 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1065.400000 2021-02-19 04:44:38,308 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8795.600000 2021-02-19 04:44:38,392 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:38,407 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:39,029 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5784.500000 2021-02-19 04:44:39,359 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:39,448 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4517.100000 2021-02-19 04:44:39,611 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8908.600000 2021-02-19 04:44:39,710 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 336.600000 2021-02-19 04:44:39,717 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1065.400000 2021-02-19 04:44:39,739 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4727.900000 2021-02-19 04:44:39,930 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8829.000000 2021-02-19 04:44:40,013 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:40,019 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:40,641 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5814.500000 2021-02-19 04:44:40,969 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:41,068 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4517.100000 2021-02-19 04:44:41,223 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8908.600000 2021-02-19 04:44:41,335 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1065.400000 2021-02-19 04:44:41,342 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 336.600000 2021-02-19 04:44:41,384 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4727.900000 2021-02-19 04:44:41,578 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8829.000000 2021-02-19 04:44:41,644 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:41,677 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:42,255 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5814.500000 2021-02-19 04:44:42,559 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:42,707 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4501.100000 2021-02-19 04:44:42,799 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 76.46 % 2021-02-19 04:44:42,801 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 76.4635817244 2021-02-19 04:44:42,848 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8894.100000 2021-02-19 04:44:42,936 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1095.600000 2021-02-19 04:44:42,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 237.000000 2021-02-19 04:44:43,019 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4762.700000 2021-02-19 04:44:43,207 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8844.800000 2021-02-19 04:44:43,288 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:43,318 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:43,867 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5813.300000 2021-02-19 04:44:44,157 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:44,355 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4460.600000 2021-02-19 04:44:44,467 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8877.900000 2021-02-19 04:44:44,529 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1095.600000 2021-02-19 04:44:44,617 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 236.000000 2021-02-19 04:44:44,648 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4757.400000 2021-02-19 04:44:44,832 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8860.000000 2021-02-19 04:44:44,905 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:44,948 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:45,029 | infra | INFO | pool-2-thread-50 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:44:45,029 | infra | INFO | pool-2-thread-50 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:44:45,493 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5827.800000 2021-02-19 04:44:45,779 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:44:45,868 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 76.49 % 2021-02-19 04:44:45,881 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:44:45,881 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:44:45,990 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4460.600000 2021-02-19 04:44:46,108 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8877.900000 2021-02-19 04:44:46,141 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1095.600000 2021-02-19 04:44:46,290 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 236.000000 2021-02-19 04:44:46,312 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4757.400000 2021-02-19 04:44:46,479 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8860.000000 2021-02-19 04:44:46,559 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:46,591 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:47,134 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5827.800000 2021-02-19 04:44:47,384 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:44:47,608 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4460.600000 2021-02-19 04:44:47,717 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8877.900000 2021-02-19 04:44:47,743 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1125.600000 2021-02-19 04:44:47,851 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 76.54 % 2021-02-19 04:44:47,851 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 76.5393039998 2021-02-19 04:44:47,924 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 227.500000 2021-02-19 04:44:47,957 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4757.400000 2021-02-19 04:44:48,119 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8860.000000 2021-02-19 04:44:48,176 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:48,197 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:44:48,786 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5827.800000 2021-02-19 04:44:48,970 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:44:49,234 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4460.600000 2021-02-19 04:44:49,351 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1125.600000 2021-02-19 04:44:49,359 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8877.900000 2021-02-19 04:44:49,552 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 232.600000 2021-02-19 04:44:49,634 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4701.200000 2021-02-19 04:44:49,788 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:49,812 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8821.200000 2021-02-19 04:44:49,845 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 390.800000 2021-02-19 04:44:50,226 | infra | INFO | pool-2-thread-39 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope2_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:44:50,226 | infra | INFO | pool-2-thread-39 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:44:50,413 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5784.000000 2021-02-19 04:44:50,573 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:44:50,851 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4515.500000 2021-02-19 04:44:50,957 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1125.600000 2021-02-19 04:44:50,990 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8499.300000 2021-02-19 04:44:51,186 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 232.600000 2021-02-19 04:44:51,250 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4701.200000 2021-02-19 04:44:51,418 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:51,448 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8821.200000 2021-02-19 04:44:51,486 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 390.800000 2021-02-19 04:44:52,045 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5784.000000 2021-02-19 04:44:52,167 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:44:52,457 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4549.800000 2021-02-19 04:44:52,556 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1078.500000 2021-02-19 04:44:52,612 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7760.000000 2021-02-19 04:44:52,838 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 243.900000 2021-02-19 04:44:52,878 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4612.500000 2021-02-19 04:44:52,913 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 76.77 % 2021-02-19 04:44:52,913 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 76.7659891075 2021-02-19 04:44:53,036 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:53,078 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8813.100000 2021-02-19 04:44:53,119 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1228.900000 2021-02-19 04:44:53,657 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5777.000000 2021-02-19 04:44:53,766 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:44:54,115 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4549.800000 2021-02-19 04:44:54,176 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1078.500000 2021-02-19 04:44:54,256 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7760.000000 2021-02-19 04:44:54,470 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 278.500000 2021-02-19 04:44:54,506 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4206.900000 2021-02-19 04:44:54,681 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:54,717 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8829.000000 2021-02-19 04:44:54,759 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2414.400000 2021-02-19 04:44:55,256 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5795.800000 2021-02-19 04:44:55,384 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:44:55,740 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4591.400000 2021-02-19 04:44:55,786 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1030.300000 2021-02-19 04:44:55,882 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6745.300000 2021-02-19 04:44:55,897 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 76.90 % 2021-02-19 04:44:55,911 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:44:55,911 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:44:56,098 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 278.500000 2021-02-19 04:44:56,132 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4206.900000 2021-02-19 04:44:56,308 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:56,344 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8829.000000 2021-02-19 04:44:56,382 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2414.400000 2021-02-19 04:44:56,865 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5795.800000 2021-02-19 04:44:56,980 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:57,401 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4591.400000 2021-02-19 04:44:57,408 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1030.300000 2021-02-19 04:44:57,513 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6745.300000 2021-02-19 04:44:57,730 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 299.800000 2021-02-19 04:44:57,746 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4206.900000 2021-02-19 04:44:57,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:57,959 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 76.96 % 2021-02-19 04:44:57,959 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 76.9589447242 2021-02-19 04:44:57,967 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8829.000000 2021-02-19 04:44:58,012 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2414.400000 2021-02-19 04:44:58,505 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5795.800000 2021-02-19 04:44:58,573 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:44:59,016 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1030.300000 2021-02-19 04:44:59,039 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4591.400000 2021-02-19 04:44:59,135 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6745.300000 2021-02-19 04:44:59,352 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 299.800000 2021-02-19 04:44:59,365 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4206.900000 2021-02-19 04:44:59,582 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:44:59,608 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8911.500000 2021-02-19 04:44:59,634 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3626.700000 2021-02-19 04:45:00,118 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5795.800000 2021-02-19 04:45:00,190 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:00,630 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1030.300000 2021-02-19 04:45:00,667 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4633.000000 2021-02-19 04:45:00,760 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5823.800000 2021-02-19 04:45:00,996 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3079.200000 2021-02-19 04:45:01,009 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 379.100000 2021-02-19 04:45:01,198 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:01,221 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8911.500000 2021-02-19 04:45:01,243 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3626.700000 2021-02-19 04:45:01,756 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5929.100000 2021-02-19 04:45:01,805 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:02,217 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1030.300000 2021-02-19 04:45:02,319 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4693.700000 2021-02-19 04:45:02,414 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5284.400000 2021-02-19 04:45:02,627 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1570.600000 2021-02-19 04:45:02,637 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 644.600000 2021-02-19 04:45:02,825 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:02,877 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9032.400000 2021-02-19 04:45:02,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4402.300000 2021-02-19 04:45:03,000 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 77.19 % 2021-02-19 04:45:03,000 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 77.1865875012 2021-02-19 04:45:03,394 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6066.300000 2021-02-19 04:45:03,414 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:03,815 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1077.100000 2021-02-19 04:45:03,924 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4693.700000 2021-02-19 04:45:04,040 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5284.400000 2021-02-19 04:45:04,259 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1570.600000 2021-02-19 04:45:04,270 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 644.600000 2021-02-19 04:45:04,461 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:04,500 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9149.000000 2021-02-19 04:45:04,515 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4834.600000 2021-02-19 04:45:05,009 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6171.800000 2021-02-19 04:45:05,029 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:05,411 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1077.100000 2021-02-19 04:45:05,543 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4739.500000 2021-02-19 04:45:05,674 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5030.100000 2021-02-19 04:45:05,897 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 994.000000 2021-02-19 04:45:05,901 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 403.700000 2021-02-19 04:45:05,921 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 77.32 % 2021-02-19 04:45:05,934 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:45:05,934 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:45:06,075 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:06,168 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9149.000000 2021-02-19 04:45:06,171 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4834.600000 2021-02-19 04:45:06,638 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:06,650 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6171.800000 2021-02-19 04:45:07,005 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1134.700000 2021-02-19 04:45:07,198 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4739.500000 2021-02-19 04:45:07,315 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5030.100000 2021-02-19 04:45:07,549 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 994.000000 2021-02-19 04:45:07,562 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 403.700000 2021-02-19 04:45:07,703 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:07,815 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4834.600000 2021-02-19 04:45:07,832 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9149.000000 2021-02-19 04:45:08,038 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 77.41 % 2021-02-19 04:45:08,038 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 77.4107839698 2021-02-19 04:45:08,229 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:08,249 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6171.800000 2021-02-19 04:45:08,592 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1134.700000 2021-02-19 04:45:08,826 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4739.500000 2021-02-19 04:45:08,927 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5030.100000 2021-02-19 04:45:09,180 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 994.000000 2021-02-19 04:45:09,200 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 403.700000 2021-02-19 04:45:09,342 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:09,519 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4854.400000 2021-02-19 04:45:09,548 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9205.200000 2021-02-19 04:45:09,838 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:09,855 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6213.900000 2021-02-19 04:45:10,194 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1134.700000 2021-02-19 04:45:10,464 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4772.900000 2021-02-19 04:45:10,540 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5046.500000 2021-02-19 04:45:10,806 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1066.600000 2021-02-19 04:45:10,822 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:10,961 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:11,127 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4854.400000 2021-02-19 04:45:11,148 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9205.200000 2021-02-19 04:45:11,427 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:11,463 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6213.900000 2021-02-19 04:45:11,799 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1134.700000 2021-02-19 04:45:12,076 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4772.900000 2021-02-19 04:45:12,158 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5046.500000 2021-02-19 04:45:12,436 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 915.500000 2021-02-19 04:45:12,450 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:12,575 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:12,747 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4881.000000 2021-02-19 04:45:12,773 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9198.300000 2021-02-19 04:45:13,036 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:13,079 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 77.63 % 2021-02-19 04:45:13,081 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 77.6286210484 2021-02-19 04:45:13,085 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6224.200000 2021-02-19 04:45:13,413 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1150.500000 2021-02-19 04:45:13,703 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4802.600000 2021-02-19 04:45:13,809 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5049.200000 2021-02-19 04:45:14,085 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 915.500000 2021-02-19 04:45:14,095 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:14,206 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:14,358 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4905.500000 2021-02-19 04:45:14,391 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9167.500000 2021-02-19 04:45:14,658 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:14,739 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6252.400000 2021-02-19 04:45:15,013 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1150.500000 2021-02-19 04:45:15,361 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4834.700000 2021-02-19 04:45:15,463 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5051.100000 2021-02-19 04:45:15,726 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 665.341807 2021-02-19 04:45:15,749 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:15,839 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:15,948 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 77.74 % 2021-02-19 04:45:15,960 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:45:15,960 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:45:15,980 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4905.500000 2021-02-19 04:45:16,010 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9167.500000 2021-02-19 04:45:16,273 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:16,362 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6252.400000 2021-02-19 04:45:16,618 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1145.847162 2021-02-19 04:45:17,042 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4834.700000 2021-02-19 04:45:17,128 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5051.100000 2021-02-19 04:45:17,378 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 665.341807 2021-02-19 04:45:17,391 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:17,469 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:17,601 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4905.500000 2021-02-19 04:45:17,638 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9167.500000 2021-02-19 04:45:17,877 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.499600 2021-02-19 04:45:17,997 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6252.400000 2021-02-19 04:45:18,124 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 77.83 % 2021-02-19 04:45:18,124 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 77.8283891354 2021-02-19 04:45:18,206 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1145.847162 2021-02-19 04:45:18,645 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4834.700000 2021-02-19 04:45:18,743 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5051.100000 2021-02-19 04:45:18,997 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 665.341807 2021-02-19 04:45:19,013 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:19,079 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:19,211 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4905.500000 2021-02-19 04:45:19,270 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9167.500000 2021-02-19 04:45:19,476 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.499600 2021-02-19 04:45:19,598 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6285.000000 2021-02-19 04:45:19,796 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1145.847162 2021-02-19 04:45:20,270 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4834.700000 2021-02-19 04:45:20,381 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5051.600000 2021-02-19 04:45:20,628 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 592.641807 2021-02-19 04:45:20,641 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:20,717 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:20,841 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4953.600000 2021-02-19 04:45:20,894 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9129.200000 2021-02-19 04:45:21,069 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.499600 2021-02-19 04:45:21,207 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6285.000000 2021-02-19 04:45:21,398 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1145.847162 2021-02-19 04:45:21,878 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4859.000000 2021-02-19 04:45:21,987 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5051.600000 2021-02-19 04:45:22,256 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 592.641807 2021-02-19 04:45:22,269 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:22,342 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:22,473 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4986.600000 2021-02-19 04:45:22,513 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9095.100000 2021-02-19 04:45:22,671 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.499600 2021-02-19 04:45:22,812 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6338.800000 2021-02-19 04:45:23,006 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1106.047162 2021-02-19 04:45:23,164 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 78.04 % 2021-02-19 04:45:23,164 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 78.0403714131 2021-02-19 04:45:23,490 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4876.600000 2021-02-19 04:45:23,591 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5046.500000 2021-02-19 04:45:23,900 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:23,914 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 564.241807 2021-02-19 04:45:23,971 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:24,105 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4986.600000 2021-02-19 04:45:24,134 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9095.100000 2021-02-19 04:45:24,269 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.499600 2021-02-19 04:45:24,460 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6345.400000 2021-02-19 04:45:24,627 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1106.047162 2021-02-19 04:45:25,148 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4876.600000 2021-02-19 04:45:25,226 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5022.300000 2021-02-19 04:45:25,542 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:25,565 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 516.946277 2021-02-19 04:45:25,615 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:25,733 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4998.800000 2021-02-19 04:45:25,763 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9052.800000 2021-02-19 04:45:25,859 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:25,973 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 78.19 % 2021-02-19 04:45:25,986 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:45:25,986 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:45:26,081 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6345.400000 2021-02-19 04:45:26,234 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1106.047162 2021-02-19 04:45:26,767 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4901.000000 2021-02-19 04:45:26,845 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5022.300000 2021-02-19 04:45:27,161 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:27,237 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:27,256 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 516.946277 2021-02-19 04:45:27,344 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4998.800000 2021-02-19 04:45:27,424 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9052.800000 2021-02-19 04:45:27,471 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:27,707 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6345.400000 2021-02-19 04:45:27,829 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1095.844676 2021-02-19 04:45:28,203 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 78.23 % 2021-02-19 04:45:28,203 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 78.2342846991 2021-02-19 04:45:28,382 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4901.000000 2021-02-19 04:45:28,470 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5022.300000 2021-02-19 04:45:28,790 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:28,904 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 516.946277 2021-02-19 04:45:28,904 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:29,005 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4998.800000 2021-02-19 04:45:29,042 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9052.800000 2021-02-19 04:45:29,073 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:29,315 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6345.400000 2021-02-19 04:45:29,463 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1095.844676 2021-02-19 04:45:30,023 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4933.600000 2021-02-19 04:45:30,124 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5033.200000 2021-02-19 04:45:30,456 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:30,556 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 471.546277 2021-02-19 04:45:30,601 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:30,640 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4973.800000 2021-02-19 04:45:30,696 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9049.100000 2021-02-19 04:45:30,704 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:30,917 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6291.500000 2021-02-19 04:45:31,071 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1095.844676 2021-02-19 04:45:31,631 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4933.600000 2021-02-19 04:45:31,762 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5033.200000 2021-02-19 04:45:32,079 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:32,186 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 471.546277 2021-02-19 04:45:32,259 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:32,321 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4973.800000 2021-02-19 04:45:32,349 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:32,354 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9078.000000 2021-02-19 04:45:32,546 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6238.100000 2021-02-19 04:45:32,667 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1118.444676 2021-02-19 04:45:33,247 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 78.40 % 2021-02-19 04:45:33,247 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 78.4017512478 2021-02-19 04:45:33,250 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4985.100000 2021-02-19 04:45:33,391 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5036.200000 2021-02-19 04:45:33,701 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:33,818 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 367.346277 2021-02-19 04:45:33,901 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:33,969 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:33,980 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4961.900000 2021-02-19 04:45:34,000 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9078.000000 2021-02-19 04:45:34,193 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6238.100000 2021-02-19 04:45:34,269 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1118.444676 2021-02-19 04:45:34,901 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4994.000000 2021-02-19 04:45:35,009 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5056.500000 2021-02-19 04:45:35,311 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:35,436 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 610.446277 2021-02-19 04:45:35,523 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:35,575 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:35,604 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4953.400000 2021-02-19 04:45:35,625 | infra | INFO | pool-2-thread-59 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:45:35,625 | infra | INFO | pool-2-thread-59 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:45:35,631 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9129.200000 2021-02-19 04:45:35,796 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6174.700000 2021-02-19 04:45:35,869 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1134.700000 2021-02-19 04:45:36,006 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 78.58 % 2021-02-19 04:45:36,019 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:45:36,019 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:45:36,523 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4994.000000 2021-02-19 04:45:36,630 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5056.500000 2021-02-19 04:45:36,921 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:37,069 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 678.800000 2021-02-19 04:45:37,220 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:37,244 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:37,298 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9129.200000 2021-02-19 04:45:37,302 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4953.400000 2021-02-19 04:45:37,434 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6174.700000 2021-02-19 04:45:37,470 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1134.700000 2021-02-19 04:45:38,173 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4994.000000 2021-02-19 04:45:38,286 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5056.500000 2021-02-19 04:45:38,290 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 78.71 % 2021-02-19 04:45:38,290 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 78.7089241074 2021-02-19 04:45:38,525 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:38,680 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 678.800000 2021-02-19 04:45:38,826 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:38,861 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:38,933 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4953.400000 2021-02-19 04:45:38,950 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9129.200000 2021-02-19 04:45:39,059 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6174.700000 2021-02-19 04:45:39,082 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1134.700000 2021-02-19 04:45:39,776 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4889.900000 2021-02-19 04:45:39,888 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4674.800000 2021-02-19 04:45:40,138 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:40,315 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 678.800000 2021-02-19 04:45:40,427 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:40,496 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:40,539 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5176.500000 2021-02-19 04:45:40,612 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9154.200000 2021-02-19 04:45:40,680 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5993.300000 2021-02-19 04:45:40,697 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1134.700000 2021-02-19 04:45:41,390 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4889.900000 2021-02-19 04:45:41,513 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4674.800000 2021-02-19 04:45:41,752 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:41,934 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1629.700000 2021-02-19 04:45:42,040 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:42,107 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:42,151 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5176.500000 2021-02-19 04:45:42,247 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9154.200000 2021-02-19 04:45:42,315 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1160.000000 2021-02-19 04:45:42,332 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5771.600000 2021-02-19 04:45:43,006 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4705.200000 2021-02-19 04:45:43,154 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3836.700000 2021-02-19 04:45:43,342 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 79.00 % 2021-02-19 04:45:43,342 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 78.9975233862 2021-02-19 04:45:43,364 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:43,562 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3347.700000 2021-02-19 04:45:43,642 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:43,726 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:43,775 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5760.300000 2021-02-19 04:45:43,891 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9030.200000 2021-02-19 04:45:43,915 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1160.000000 2021-02-19 04:45:43,970 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5771.600000 2021-02-19 04:45:44,627 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4551.800000 2021-02-19 04:45:44,780 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2641.800000 2021-02-19 04:45:44,982 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:45,230 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3347.700000 2021-02-19 04:45:45,250 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:45,391 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:45,407 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6655.700000 2021-02-19 04:45:45,533 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8824.800000 2021-02-19 04:45:45,549 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1166.700000 2021-02-19 04:45:45,605 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5603.300000 2021-02-19 04:45:46,032 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 79.15 % 2021-02-19 04:45:46,046 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:45:46,046 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:45:46,242 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4551.800000 2021-02-19 04:45:46,388 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2641.800000 2021-02-19 04:45:46,586 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:46,861 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:45:46,878 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5033.600000 2021-02-19 04:45:47,025 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:47,076 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6655.700000 2021-02-19 04:45:47,164 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1166.700000 2021-02-19 04:45:47,207 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8824.800000 2021-02-19 04:45:47,240 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5603.300000 2021-02-19 04:45:47,848 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4551.800000 2021-02-19 04:45:48,010 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2641.800000 2021-02-19 04:45:48,223 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:48,391 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 79.28 % 2021-02-19 04:45:48,391 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 79.2802678641 2021-02-19 04:45:48,463 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:45:48,499 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5033.600000 2021-02-19 04:45:48,664 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:48,730 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6655.700000 2021-02-19 04:45:48,786 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1166.700000 2021-02-19 04:45:48,858 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8824.800000 2021-02-19 04:45:48,875 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5603.300000 2021-02-19 04:45:49,464 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4523.300000 2021-02-19 04:45:49,631 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1335.500000 2021-02-19 04:45:49,825 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:50,061 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:45:50,130 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5543.100000 2021-02-19 04:45:50,328 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:50,344 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6655.700000 2021-02-19 04:45:50,391 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1166.700000 2021-02-19 04:45:50,502 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8473.400000 2021-02-19 04:45:50,512 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5685.600000 2021-02-19 04:45:51,108 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4523.300000 2021-02-19 04:45:51,256 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1335.500000 2021-02-19 04:45:51,446 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:51,657 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:45:51,750 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5543.100000 2021-02-19 04:45:51,964 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:51,997 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7808.400000 2021-02-19 04:45:52,015 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1166.700000 2021-02-19 04:45:52,135 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8473.400000 2021-02-19 04:45:52,151 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5685.600000 2021-02-19 04:45:52,723 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4551.200000 2021-02-19 04:45:52,868 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 487.000000 2021-02-19 04:45:53,052 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:53,262 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:45:53,375 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5592.300000 2021-02-19 04:45:53,433 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 79.56 % 2021-02-19 04:45:53,434 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 79.5566529522 2021-02-19 04:45:53,592 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:53,615 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1127.300000 2021-02-19 04:45:53,638 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8617.900000 2021-02-19 04:45:53,786 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8270.500000 2021-02-19 04:45:53,809 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5815.600000 2021-02-19 04:45:54,345 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4551.200000 2021-02-19 04:45:54,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:45:54,657 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:54,881 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:45:55,046 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5485.850850 2021-02-19 04:45:55,223 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1127.300000 2021-02-19 04:45:55,224 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:55,280 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8806.454009 2021-02-19 04:45:55,434 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8214.741772 2021-02-19 04:45:55,443 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5984.593321 2021-02-19 04:45:55,969 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4593.493281 2021-02-19 04:45:56,058 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 79.68 % 2021-02-19 04:45:56,071 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:45:56,072 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:45:56,131 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:45:56,269 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:56,483 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:56,678 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5304.250850 2021-02-19 04:45:56,812 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1095.700000 2021-02-19 04:45:56,865 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:56,915 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8806.454009 2021-02-19 04:45:57,059 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8214.741772 2021-02-19 04:45:57,075 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5984.593321 2021-02-19 04:45:57,588 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4593.493281 2021-02-19 04:45:57,737 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:45:57,878 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:58,078 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:58,315 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5304.250850 2021-02-19 04:45:58,447 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1095.700000 2021-02-19 04:45:58,479 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 79.81 % 2021-02-19 04:45:58,479 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 79.8096188365 2021-02-19 04:45:58,500 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:45:58,571 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8806.454009 2021-02-19 04:45:58,726 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8214.741772 2021-02-19 04:45:58,740 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5984.593321 2021-02-19 04:45:58,816 | infra | INFO | pool-2-thread-34 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:45:58,818 | infra | INFO | pool-2-thread-34 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:45:59,214 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4593.493281 2021-02-19 04:45:59,372 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:45:59,526 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:45:59,680 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:45:59,937 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5464.950850 2021-02-19 04:46:00,059 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1095.700000 2021-02-19 04:46:00,114 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:00,194 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8806.454009 2021-02-19 04:46:00,352 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8214.741772 2021-02-19 04:46:00,362 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5984.593321 2021-02-19 04:46:00,405 | infra | INFO | pool-2-thread-24 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:46:00,405 | infra | INFO | pool-2-thread-24 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:46:00,868 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4653.893281 2021-02-19 04:46:01,026 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:01,160 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:01,301 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:46:01,565 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5464.950850 2021-02-19 04:46:01,663 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1095.700000 2021-02-19 04:46:01,747 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:01,832 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7507.254009 2021-02-19 04:46:01,984 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8443.541772 2021-02-19 04:46:02,002 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6140.693321 2021-02-19 04:46:02,506 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4749.193281 2021-02-19 04:46:02,670 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:02,770 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:02,913 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:46:03,184 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5380.350850 2021-02-19 04:46:03,279 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1091.300000 2021-02-19 04:46:03,378 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:03,492 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6131.254009 2021-02-19 04:46:03,529 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.00 % 2021-02-19 04:46:03,529 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 80.0 2021-02-19 04:46:03,604 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8500.741772 2021-02-19 04:46:03,663 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6295.693321 2021-02-19 04:46:04,134 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4749.193281 2021-02-19 04:46:04,295 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:04,375 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:04,532 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:46:04,844 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5264.826045 2021-02-19 04:46:04,894 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1091.300000 2021-02-19 04:46:05,036 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:05,111 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5440.707882 2021-02-19 04:46:05,236 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8204.498980 2021-02-19 04:46:05,272 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6393.326205 2021-02-19 04:46:05,742 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4818.120504 2021-02-19 04:46:05,898 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:05,976 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:06,084 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.00 % 2021-02-19 04:46:06,096 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from lib/membase/api/rest_client.py -> rebalance_reached():L98 2021-02-19 04:46:06,096 | test | DEBUG | MainThread | [common_lib:sleep:24] Sleep 10 seconds. Reason: None 2021-02-19 04:46:06,138 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:46:06,496 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5131.226045 2021-02-19 04:46:06,506 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1765.200000 2021-02-19 04:46:06,680 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:06,762 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5440.707882 2021-02-19 04:46:06,891 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6393.326205 2021-02-19 04:46:06,913 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8204.498980 2021-02-19 04:46:07,345 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4818.120504 2021-02-19 04:46:07,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:07,573 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:07,740 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:46:08,115 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1765.200000 2021-02-19 04:46:08,135 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5131.226045 2021-02-19 04:46:08,338 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:08,451 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5440.707882 2021-02-19 04:46:08,553 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6393.326205 2021-02-19 04:46:08,563 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8204.498980 2021-02-19 04:46:08,569 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.00 % 2021-02-19 04:46:08,569 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 80.0 2021-02-19 04:46:08,960 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4818.120504 2021-02-19 04:46:09,119 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:09,180 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:09,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:46:09,737 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1765.200000 2021-02-19 04:46:09,767 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4918.026045 2021-02-19 04:46:09,976 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:10,107 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6841.407882 2021-02-19 04:46:10,190 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6393.326205 2021-02-19 04:46:10,207 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 8204.498980 2021-02-19 04:46:10,270 | infra | INFO | pool-2-thread-37 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope3_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:46:10,270 | infra | INFO | pool-2-thread-37 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:46:10,579 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4728.620504 2021-02-19 04:46:10,720 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:10,775 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:10,987 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:46:11,351 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1765.200000 2021-02-19 04:46:11,392 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4918.026045 2021-02-19 04:46:11,585 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:11,723 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6841.407882 2021-02-19 04:46:11,828 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6333.026205 2021-02-19 04:46:11,844 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 7109.798980 2021-02-19 04:46:12,186 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4728.620504 2021-02-19 04:46:12,339 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:12,394 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:12,601 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:46:12,961 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4221.200000 2021-02-19 04:46:13,000 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4611.226045 2021-02-19 04:46:13,210 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:13,341 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8367.007882 2021-02-19 04:46:13,453 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6233.926205 2021-02-19 04:46:13,463 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 5956.898980 2021-02-19 04:46:13,608 | test | DEBUG | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.00 % 2021-02-19 04:46:13,608 | test | INFO | pool-1-thread-3 | [task:check:330] Rebalance - status: running, progress: 80.0 2021-02-19 04:46:13,782 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4597.520504 2021-02-19 04:46:13,950 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:13,996 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:14,197 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:46:14,563 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4221.200000 2021-02-19 04:46:14,627 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4617.300000 2021-02-19 04:46:14,819 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:14,953 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9542.900000 2021-02-19 04:46:15,066 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6110.200000 2021-02-19 04:46:15,086 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4722.700000 2021-02-19 04:46:15,390 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4466.600000 2021-02-19 04:46:15,575 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:15,608 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:15,808 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:46:16,096 | test | INFO | MainThread | [rest_client:rebalance_reached:108] Rebalance reached >80.0% in 260.7099998 seconds 2021-02-19 04:46:16,108 | test | DEBUG | MainThread | [rest_client:diag_eval:1363] /diag/eval status on 172.23.110.64:8091: 1 content: true command: ns_orchestrator:needs_rebalance() 2021-02-19 04:46:16,108 | test | INFO | MainThread | [Magma:abort_rebalance:912] Abort rebalance 2021-02-19 04:46:16,168 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4221.200000 2021-02-19 04:46:16,240 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4617.300000 2021-02-19 04:46:16,447 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:16,546 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L914 2021-02-19 04:46:16,546 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 60 seconds. Reason: Sleep after error introduction 2021-02-19 04:46:16,602 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9542.900000 2021-02-19 04:46:16,690 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6110.200000 2021-02-19 04:46:16,720 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4722.700000 2021-02-19 04:46:16,990 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4466.600000 2021-02-19 04:46:17,184 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:17,213 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:17,391 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:46:17,770 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6019.800000 2021-02-19 04:46:17,839 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4617.300000 2021-02-19 04:46:18,059 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:18,227 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9542.900000 2021-02-19 04:46:18,282 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6110.200000 2021-02-19 04:46:18,339 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 4722.700000 2021-02-19 04:46:18,644 | test | ERROR | pool-1-thread-3 | [rest_client:_rebalance_status_and_progress:1494] {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 04:46:18,673 | test | INFO | pool-1-thread-3 | [rest_client:print_UI_logs:2599] Latest logs from UI on 172.23.110.69: 2021-02-19 04:46:18,673 | test | ERROR | pool-1-thread-3 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_orchestrator', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613738777176L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:46:17.176Z', u'text': u'Rebalance exited with reason {mover_crashed,\n {unexpected_exit,\n {\'EXIT\',<0.27820.69>,\n {{{badmatch,{error,closed}},\n [{mc_client_binary,cmd_vocal_recv,5,\n [{file,"src/mc_client_binary.erl"},\n {line,158}]},\n {mc_client_binary,select_bucket,2,\n [{file,"src/mc_client_binary.erl"},\n {line,350}]},\n {ns_memcached_sockets_pool,take_socket,2,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,46}]},\n {ns_memcached_sockets_pool,\n \'-executing_on_socket/3-fun-0-\',3,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,88}]},\n {async,\'-async_init/4-fun-1-\',3,\n [{file,"src/async.erl"},{line,197}]}]},\n {gen_server,call,\n [{\'janitor_agent-GleamBookUsers8\',\n \'ns_1@172.23.110.64\'},\n {if_rebalance,<0.25905.69>,\n {update_vbucket_state,1015,active,paused,\n undefined,\n [[\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.65\']]}},\n infinity]}}}}}.\nRebalance Operation Id = 3dd427f5121fd2e603cc02cba5c75855'} 2021-02-19 04:46:18,674 | test | ERROR | pool-1-thread-3 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_log', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613738777139L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:46:17.139Z', u'text': u"Service 'memcached' exited with status 137. Restarting. Messages:\nWARNING: Logging before InitGoogleLogging() is written to STDERR\nW0219 04:38:48.661697 49148 HazptrDomain.h:671] Using the default inline executor for asynchronous reclamation may be susceptible to deadlock if the current thread happens to hold a resource needed by the deleter of a reclaimable object"} 2021-02-19 04:46:18,674 | test | ERROR | pool-1-thread-3 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613738777136L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:46:17.136Z', u'text': u'Worker <0.27299.69> (for action {move,{1015,\n [\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.65\'],\n [\'ns_1@172.23.110.69\',\n \'ns_1@172.23.110.64\'],\n []}}) exited with reason {unexpected_exit,\n {\'EXIT\',\n <0.27820.69>,\n {{{badmatch,\n {error,\n closed}},\n [{mc_client_binary,\n cmd_vocal_recv,\n 5,\n [{file,\n "src/mc_client_binary.erl"},\n {line,\n 158}]},\n {mc_client_binary,\n select_bucket,\n 2,\n [{file,\n "src/mc_client_binary.erl"},\n {line,\n 350}]},\n {ns_memcached_sockets_pool,\n take_socket,\n 2,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,\n 46}]},\n {ns_memcached_sockets_pool,\n \'-executing_on_socket/3-fun-0-\',\n 3,\n [{file,\n "src/ns_memcached_sockets_pool.erl"},\n {line,\n 88}]},\n {async,\n \'-async_init/4-fun-1-\',\n 3,\n [{file,\n "src/async.erl"},\n {line,\n 197}]}]},\n {gen_server,\n call,\n [{\'janitor_agent-GleamBookUsers8\',\n \'ns_1@172.23.110.64\'},\n {if_rebalance,\n <0.25905.69>,\n {update_vbucket_state,\n 1015,\n active,\n paused,\n undefined,\n [[\'ns_1@172.23.110.64\',\n \'ns_1@172.23.110.65\']]}},\n infinity]}}}}'} 2021-02-19 04:46:18,674 | test | ERROR | pool-1-thread-3 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613738777136L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:46:17.136Z', u'text': u"Control connection to memcached on 'ns_1@172.23.110.64' disconnected. Check logs for details."} 2021-02-19 04:46:18,674 | test | ERROR | pool-1-thread-3 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613738772956L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:46:12.956Z', u'text': u'Bucket "GleamBookUsers8" rebalance does not seem to be swap rebalance'} 2021-02-19 04:46:18,674 | test | ERROR | pool-1-thread-3 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613738772499L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:46:12.499Z', u'text': u'Bucket "GleamBookUsers8" loaded on node \'ns_1@172.23.110.69\' in 0 seconds.'} 2021-02-19 04:46:18,674 | test | ERROR | pool-1-thread-3 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.65', u'tstamp': 1613738772312L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:46:12.312Z', u'text': u'Shutting down bucket "GleamBookUsers7" on \'ns_1@172.23.110.65\' for deletion'} 2021-02-19 04:46:18,674 | test | ERROR | pool-1-thread-3 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_rebalancer', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613738771798L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:46:11.798Z', u'text': u'Started rebalancing bucket GleamBookUsers8'} 2021-02-19 04:46:18,674 | test | ERROR | pool-1-thread-3 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.68', u'tstamp': 1613738771700L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:46:11.700Z', u'text': u'Bucket "GleamBookUsers8" loaded on node \'ns_1@172.23.110.68\' in 0 seconds.'} 2021-02-19 04:46:18,674 | test | ERROR | pool-1-thread-3 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_vbucket_mover', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613738566887L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:42:46.887Z', u'text': u'Bucket "GleamBookUsers7" rebalance does not seem to be swap rebalance'} 2021-02-19 04:46:18,674 | test | ERROR | pool-1-thread-3 | [task:call:242] Rebalance Failed: {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 04:46:18,706 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4466.600000 2021-02-19 04:46:18,818 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:18,890 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:19,019 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:46:19,473 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6019.800000 2021-02-19 04:46:19,519 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4541.400000 2021-02-19 04:46:19,680 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:19,829 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9226.600000 2021-02-19 04:46:19,938 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5805.200000 2021-02-19 04:46:19,969 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3314.400000 2021-02-19 04:46:20,325 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4466.600000 2021-02-19 04:46:20,411 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:20,494 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:20,608 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:46:21,075 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6019.800000 2021-02-19 04:46:21,207 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4541.400000 2021-02-19 04:46:21,346 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:21,420 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9226.600000 2021-02-19 04:46:21,542 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5805.200000 2021-02-19 04:46:21,569 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3314.400000 2021-02-19 04:46:21,921 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4284.200000 2021-02-19 04:46:22,005 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:22,095 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:22,214 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:46:22,674 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3019.700000 2021-02-19 04:46:22,812 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3043.000000 2021-02-19 04:46:22,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:23,076 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6022.300000 2021-02-19 04:46:23,194 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3762.100000 2021-02-19 04:46:23,210 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1681.200000 2021-02-19 04:46:23,526 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2792.700000 2021-02-19 04:46:23,598 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:23,694 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:23,803 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:46:24,282 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3019.700000 2021-02-19 04:46:24,420 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3043.000000 2021-02-19 04:46:24,523 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:24,680 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4019.057588 2021-02-19 04:46:24,811 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2517.047550 2021-02-19 04:46:24,825 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 420.500000 2021-02-19 04:46:25,134 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1918.380544 2021-02-19 04:46:25,183 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:25,292 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:25,397 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.500000 2021-02-19 04:46:25,885 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 498.599760 2021-02-19 04:46:26,026 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2025.276285 2021-02-19 04:46:26,119 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:26,309 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4019.057588 2021-02-19 04:46:26,427 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2517.047550 2021-02-19 04:46:26,443 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 420.500000 2021-02-19 04:46:26,780 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1918.380544 2021-02-19 04:46:26,823 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:26,911 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:27,013 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:46:27,502 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 498.599760 2021-02-19 04:46:27,631 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2025.276285 2021-02-19 04:46:27,717 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:27,953 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4019.057588 2021-02-19 04:46:28,028 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2517.047550 2021-02-19 04:46:28,095 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 420.500000 2021-02-19 04:46:28,420 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:28,457 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1918.380544 2021-02-19 04:46:28,565 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:28,602 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:46:29,096 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 498.599760 2021-02-19 04:46:29,226 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2025.276285 2021-02-19 04:46:29,306 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:29,552 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1212.057588 2021-02-19 04:46:29,614 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 762.247550 2021-02-19 04:46:29,687 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:29,996 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:30,065 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 597.280544 2021-02-19 04:46:30,157 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:30,188 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:46:30,716 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 498.599760 2021-02-19 04:46:30,864 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 618.576285 2021-02-19 04:46:30,882 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:31,204 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1212.057588 2021-02-19 04:46:31,250 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 762.247550 2021-02-19 04:46:31,279 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:31,572 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:31,665 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 597.280544 2021-02-19 04:46:31,762 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:31,779 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:46:32,278 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 498.999760 2021-02-19 04:46:32,466 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 618.576285 2021-02-19 04:46:32,476 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:32,832 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1212.057588 2021-02-19 04:46:32,845 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 762.247550 2021-02-19 04:46:32,900 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:33,137 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:33,252 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 597.280544 2021-02-19 04:46:33,345 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3.300000 2021-02-19 04:46:33,369 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:33,835 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 498.999760 2021-02-19 04:46:34,085 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 618.576285 2021-02-19 04:46:34,092 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:34,480 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1212.057588 2021-02-19 04:46:34,496 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:46:34,572 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:34,734 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:34,854 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:46:34,913 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3.300000 2021-02-19 04:46:34,947 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:35,444 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 497.800000 2021-02-19 04:46:35,707 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:46:35,717 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:36,078 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:46:36,092 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:46:36,158 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:36,302 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:36,437 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:46:36,525 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3.300000 2021-02-19 04:46:36,536 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:37,009 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.400000 2021-02-19 04:46:37,323 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:46:37,332 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:37,667 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:46:37,684 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:46:37,779 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:37,927 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:38,013 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:46:38,105 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3.300000 2021-02-19 04:46:38,117 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:38,582 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.400000 2021-02-19 04:46:38,907 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:38,924 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:46:39,296 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:46:39,322 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:46:39,362 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:39,500 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:39,596 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:46:39,680 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3.300000 2021-02-19 04:46:39,707 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:40,138 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.400000 2021-02-19 04:46:40,496 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:40,513 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:46:40,907 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:46:40,924 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:46:40,967 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:41,085 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:41,187 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:46:41,263 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3.300000 2021-02-19 04:46:41,311 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:41,717 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.400000 2021-02-19 04:46:42,091 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:42,105 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:46:42,506 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:46:42,519 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:46:42,565 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:42,680 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:42,779 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:46:42,828 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 22.000000 2021-02-19 04:46:42,895 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:43,285 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2.000000 2021-02-19 04:46:43,667 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:43,684 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:46:44,125 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:46:44,158 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:46:44,207 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:44,278 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:44,369 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:46:44,408 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 22.000000 2021-02-19 04:46:44,480 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:44,855 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2.000000 2021-02-19 04:46:45,247 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:45,303 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 180.928607 2021-02-19 04:46:45,724 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:46:45,756 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 697.154269 2021-02-19 04:46:45,796 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:45,878 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:45,956 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:46:45,969 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 22.000000 2021-02-19 04:46:46,069 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:46,431 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2.500952 2021-02-19 04:46:46,835 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:46,881 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 180.928607 2021-02-19 04:46:47,328 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:46:47,361 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 697.154269 2021-02-19 04:46:47,417 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:47,476 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:47,542 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 22.000000 2021-02-19 04:46:47,569 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:46:47,686 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:47,997 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2.500952 2021-02-19 04:46:48,414 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:48,463 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 180.928607 2021-02-19 04:46:48,946 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:46:48,963 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 697.154269 2021-02-19 04:46:49,052 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:49,089 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:49,121 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 22.000000 2021-02-19 04:46:49,200 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:46:49,276 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:49,586 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 12.700952 2021-02-19 04:46:50,051 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:50,086 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1270.428607 2021-02-19 04:46:50,576 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.200000 2021-02-19 04:46:50,604 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3147.054269 2021-02-19 04:46:50,660 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:50,697 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 22.000000 2021-02-19 04:46:50,730 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:50,812 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 43.000000 2021-02-19 04:46:50,868 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:51,167 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 12.700952 2021-02-19 04:46:51,638 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:51,673 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1270.428607 2021-02-19 04:46:52,180 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.200000 2021-02-19 04:46:52,223 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3147.054269 2021-02-19 04:46:52,301 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:52,316 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 7.700000 2021-02-19 04:46:52,365 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:52,433 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 490.600000 2021-02-19 04:46:52,479 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:52,746 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3304.400952 2021-02-19 04:46:53,230 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:53,267 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2808.728607 2021-02-19 04:46:53,782 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 423.800000 2021-02-19 04:46:53,842 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6486.054269 2021-02-19 04:46:53,908 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 7.700000 2021-02-19 04:46:53,918 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:53,960 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:54,111 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 490.600000 2021-02-19 04:46:54,118 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:54,328 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3304.400952 2021-02-19 04:46:54,825 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:54,871 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4322.542113 2021-02-19 04:46:55,371 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1258.351828 2021-02-19 04:46:55,428 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9110.482374 2021-02-19 04:46:55,486 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 8.600000 2021-02-19 04:46:55,519 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:55,556 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:55,703 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1232.913470 2021-02-19 04:46:55,711 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:55,918 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7896.995143 2021-02-19 04:46:56,407 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:56,467 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4322.542113 2021-02-19 04:46:56,976 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1258.351828 2021-02-19 04:46:57,025 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9110.482374 2021-02-19 04:46:57,081 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 8.600000 2021-02-19 04:46:57,163 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:57,191 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:57,322 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1232.913470 2021-02-19 04:46:57,332 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:57,499 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7896.995143 2021-02-19 04:46:58,003 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:58,072 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4322.542113 2021-02-19 04:46:58,585 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1258.351828 2021-02-19 04:46:58,660 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9110.482374 2021-02-19 04:46:58,686 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 8.600000 2021-02-19 04:46:58,785 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:46:58,809 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:46:58,924 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1232.913470 2021-02-19 04:46:58,960 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:46:59,092 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7896.995143 2021-02-19 04:46:59,614 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:46:59,687 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4811.442113 2021-02-19 04:47:00,230 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1258.351828 2021-02-19 04:47:00,257 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 8.600000 2021-02-19 04:47:00,338 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9110.482374 2021-02-19 04:47:00,431 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:00,463 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:00,542 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2569.713470 2021-02-19 04:47:00,648 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:47:00,720 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 7914.995143 2021-02-19 04:47:01,230 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:01,305 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4811.442113 2021-02-19 04:47:01,831 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 8.600000 2021-02-19 04:47:01,841 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3046.151828 2021-02-19 04:47:01,967 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9827.682374 2021-02-19 04:47:02,042 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:02,065 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:02,142 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2569.713470 2021-02-19 04:47:02,246 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:47:02,299 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9309.895143 2021-02-19 04:47:02,812 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:02,915 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4852.742113 2021-02-19 04:47:03,427 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.500000 2021-02-19 04:47:03,453 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4530.151828 2021-02-19 04:47:03,565 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9674.082374 2021-02-19 04:47:03,645 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:03,683 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:03,737 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3481.313470 2021-02-19 04:47:03,894 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:47:03,907 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9309.895143 2021-02-19 04:47:04,395 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:04,505 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4736.300000 2021-02-19 04:47:05,023 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.500000 2021-02-19 04:47:05,079 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5609.900000 2021-02-19 04:47:05,181 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9538.100000 2021-02-19 04:47:05,255 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:05,306 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:05,367 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4117.800000 2021-02-19 04:47:05,492 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:47:05,515 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9448.300000 2021-02-19 04:47:05,976 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:06,089 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4736.300000 2021-02-19 04:47:06,611 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 04:47:06,677 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5609.900000 2021-02-19 04:47:06,772 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9538.100000 2021-02-19 04:47:06,839 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:06,927 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:06,970 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4117.800000 2021-02-19 04:47:07,105 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:47:07,121 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9448.300000 2021-02-19 04:47:07,259 | infra | INFO | pool-2-thread-38 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.39' completed 2021-02-19 04:47:07,260 | infra | INFO | pool-2-thread-38 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:47:07,575 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:07,687 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4736.300000 2021-02-19 04:47:08,201 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 04:47:08,273 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5609.900000 2021-02-19 04:47:08,380 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9538.100000 2021-02-19 04:47:08,430 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:08,517 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:08,627 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4117.800000 2021-02-19 04:47:08,697 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:47:08,746 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9448.300000 2021-02-19 04:47:09,173 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:09,270 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4736.300000 2021-02-19 04:47:09,780 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 04:47:09,874 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5710.600000 2021-02-19 04:47:10,059 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9626.000000 2021-02-19 04:47:10,109 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:10,130 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:10,247 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4117.800000 2021-02-19 04:47:10,322 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:47:10,371 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9448.300000 2021-02-19 04:47:10,752 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:10,848 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4783.500000 2021-02-19 04:47:11,351 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 04:47:11,476 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5710.600000 2021-02-19 04:47:11,671 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9626.000000 2021-02-19 04:47:11,707 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:11,782 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:11,864 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4121.400000 2021-02-19 04:47:11,953 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 60.500000 2021-02-19 04:47:12,023 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9448.300000 2021-02-19 04:47:12,339 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:12,434 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4798.900000 2021-02-19 04:47:12,920 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.100000 2021-02-19 04:47:13,081 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5691.600000 2021-02-19 04:47:13,318 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:13,323 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9656.800000 2021-02-19 04:47:13,421 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:13,476 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4154.400000 2021-02-19 04:47:13,605 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 543.900000 2021-02-19 04:47:13,683 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9445.800000 2021-02-19 04:47:13,934 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:14,022 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4798.900000 2021-02-19 04:47:14,500 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.100000 2021-02-19 04:47:14,674 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5620.700000 2021-02-19 04:47:14,930 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:14,953 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9675.100000 2021-02-19 04:47:15,065 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:15,115 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4128.300000 2021-02-19 04:47:15,200 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1369.400000 2021-02-19 04:47:15,301 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9444.600000 2021-02-19 04:47:15,519 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:15,612 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4809.000000 2021-02-19 04:47:16,076 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.100000 2021-02-19 04:47:16,269 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5620.700000 2021-02-19 04:47:16,569 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.69:8091 2021-02-19 04:47:16,569 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 04:47:16,576 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:16,594 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.69:8091 is running 2021-02-19 04:47:16,594 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:16,618 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9675.100000 2021-02-19 04:47:16,673 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:16,742 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4128.300000 2021-02-19 04:47:16,834 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1369.400000 2021-02-19 04:47:16,941 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9346.800000 2021-02-19 04:47:17,032 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.43799996376. 2021-02-19 04:47:17,032 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:17,125 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:17,194 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4809.000000 2021-02-19 04:47:17,482 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.449000120163. 2021-02-19 04:47:17,483 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:17,660 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.100000 2021-02-19 04:47:17,891 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5620.700000 2021-02-19 04:47:17,937 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.454999923706. 2021-02-19 04:47:17,937 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:18,171 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:18,244 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9675.100000 2021-02-19 04:47:18,305 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:18,342 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4128.300000 2021-02-19 04:47:18,385 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.447999954224. 2021-02-19 04:47:18,387 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:18,440 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1369.400000 2021-02-19 04:47:18,615 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9346.800000 2021-02-19 04:47:18,703 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:18,789 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4809.000000 2021-02-19 04:47:18,828 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.441999912262. 2021-02-19 04:47:18,829 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:19,253 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.100000 2021-02-19 04:47:19,266 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.436000108719. 2021-02-19 04:47:19,266 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:19,470 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5529.000000 2021-02-19 04:47:19,740 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.473000049591. 2021-02-19 04:47:19,740 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:19,806 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:19,903 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9481.200000 2021-02-19 04:47:19,953 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4031.900000 2021-02-19 04:47:19,963 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:20,028 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2827.500000 2021-02-19 04:47:20,184 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.444999933243. 2021-02-19 04:47:20,186 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:20,230 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9343.500000 2021-02-19 04:47:20,289 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:20,384 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4809.000000 2021-02-19 04:47:20,642 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.456999778748. 2021-02-19 04:47:20,642 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:20,829 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.100000 2021-02-19 04:47:21,056 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5529.000000 2021-02-19 04:47:21,085 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.443000078201. 2021-02-19 04:47:21,108 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.64:8091 2021-02-19 04:47:21,108 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 04:47:21,128 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.64:8091 is running 2021-02-19 04:47:21,128 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:21,415 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:21,502 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9481.200000 2021-02-19 04:47:21,568 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4031.900000 2021-02-19 04:47:21,592 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 0.463999986649. 2021-02-19 04:47:21,592 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:21,599 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:21,661 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2827.500000 2021-02-19 04:47:21,842 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9343.500000 2021-02-19 04:47:21,892 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:21,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4701.300000 2021-02-19 04:47:22,049 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.457000017166. 2021-02-19 04:47:22,049 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:22,440 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:22,490 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.44000005722. 2021-02-19 04:47:22,490 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:22,727 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5440.500000 2021-02-19 04:47:22,910 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.419000148773. 2021-02-19 04:47:22,911 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:23,061 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:23,144 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9324.700000 2021-02-19 04:47:23,246 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3904.700000 2021-02-19 04:47:23,259 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:23,325 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3865.900000 2021-02-19 04:47:23,357 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.446000099182. 2021-02-19 04:47:23,357 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:23,479 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9164.300000 2021-02-19 04:47:23,546 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:23,638 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4628.800000 2021-02-19 04:47:23,782 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.425999879837. 2021-02-19 04:47:23,782 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:24,058 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:24,226 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.443000078201. 2021-02-19 04:47:24,226 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:24,346 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5440.500000 2021-02-19 04:47:24,677 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.450000047684. 2021-02-19 04:47:24,677 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:24,714 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:24,822 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9152.400000 2021-02-19 04:47:24,907 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3802.500000 2021-02-19 04:47:24,940 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:24,999 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4540.200000 2021-02-19 04:47:25,131 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9159.200000 2021-02-19 04:47:25,138 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.460999965668. 2021-02-19 04:47:25,138 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:25,194 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:25,273 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4543.200000 2021-02-19 04:47:25,573 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.43499994278. 2021-02-19 04:47:25,598 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:138] Waiting for ns_server @ 172.23.110.68:8091 2021-02-19 04:47:25,598 | test | DEBUG | MainThread | [rest_client:is_ns_server_running:46] Checking if ns_server is running with timeout 1200secs 2021-02-19 04:47:25,621 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_ns_servers_or_assert:141] ns_server @ 172.23.110.68:8091 is running 2021-02-19 04:47:25,621 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:25,714 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:47:25,986 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5398.700000 2021-02-19 04:47:26,381 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:26,480 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9152.400000 2021-02-19 04:47:26,582 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3802.500000 2021-02-19 04:47:26,608 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:26,660 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4540.200000 2021-02-19 04:47:26,835 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8999.800000 2021-02-19 04:47:26,859 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:26,937 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4543.200000 2021-02-19 04:47:27,354 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:47:27,661 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5398.700000 2021-02-19 04:47:28,049 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:28,177 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9152.400000 2021-02-19 04:47:28,292 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3802.500000 2021-02-19 04:47:28,316 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:28,345 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4540.200000 2021-02-19 04:47:28,484 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8999.800000 2021-02-19 04:47:28,519 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:28,604 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4543.200000 2021-02-19 04:47:28,990 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:47:29,302 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5398.700000 2021-02-19 04:47:29,700 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:29,864 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9108.000000 2021-02-19 04:47:29,959 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3775.600000 2021-02-19 04:47:30,032 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:30,071 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4500.600000 2021-02-19 04:47:30,226 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:30,236 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9000.900000 2021-02-19 04:47:30,295 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4543.200000 2021-02-19 04:47:30,667 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:47:30,987 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5377.500000 2021-02-19 04:47:31,319 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers0 warm-up completed in 5.69799995422. 2021-02-19 04:47:31,319 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:31,355 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:31,559 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9108.000000 2021-02-19 04:47:31,647 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3775.600000 2021-02-19 04:47:31,703 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:31,753 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers1 warm-up completed in 0.434000015259. 2021-02-19 04:47:31,753 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:31,765 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4500.600000 2021-02-19 04:47:31,915 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 9000.900000 2021-02-19 04:47:31,923 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:31,973 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4525.300000 2021-02-19 04:47:32,183 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers2 warm-up completed in 0.429000139236. 2021-02-19 04:47:32,183 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:32,308 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:47:32,605 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5348.700000 2021-02-19 04:47:32,632 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers3 warm-up completed in 0.449999809265. 2021-02-19 04:47:32,632 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:32,970 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:33,055 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers4 warm-up completed in 0.422000169754. 2021-02-19 04:47:33,055 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:33,242 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9077.200000 2021-02-19 04:47:33,280 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3780.400000 2021-02-19 04:47:33,378 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:33,407 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4463.100000 2021-02-19 04:47:33,503 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers5 warm-up completed in 0.447999954224. 2021-02-19 04:47:33,505 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:33,562 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:33,575 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8872.200000 2021-02-19 04:47:33,631 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4506.500000 2021-02-19 04:47:33,907 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:47:33,948 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers6 warm-up completed in 0.443999767303. 2021-02-19 04:47:33,950 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:34,217 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5316.100000 2021-02-19 04:47:34,365 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers7 warm-up completed in 0.414999961853. 2021-02-19 04:47:34,365 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:34,582 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:34,809 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers8 warm-up completed in 0.443000078201. 2021-02-19 04:47:34,809 | test | DEBUG | MainThread | [bucket_ready_functions:_wait_warmup_completed:3864] Waiting for bucket GleamBookUsers0 to complete warm-up 2021-02-19 04:47:34,855 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9046.200000 2021-02-19 04:47:34,917 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3779.300000 2021-02-19 04:47:35,002 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:35,055 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4463.900000 2021-02-19 04:47:35,187 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:35,221 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8867.900000 2021-02-19 04:47:35,243 | test | INFO | MainThread | [Magma:check_warmup_complete:796] Bucket:GleamBookUsers9 warm-up completed in 0.43499994278. 2021-02-19 04:47:35,243 | test | INFO | MainThread | [Magma:abort_rebalance:927] Restarting Rebalance after killing at 80 2021-02-19 04:47:35,293 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4505.700000 2021-02-19 04:47:35,298 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[]_OUT=[172.23.110.65]_1613738855.24 2021-02-19 04:47:35,299 | infra | INFO | pool-1-thread-4 | [task:start_task:84] Thread 'Rebalance_task_IN=[]_OUT=[172.23.110.65]_1613738855.24' started 2021-02-19 04:47:35,315 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L932 2021-02-19 04:47:35,315 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 120 seconds. Reason: Let the rebalance begin after abort 2021-02-19 04:47:35,348 | test | DEBUG | pool-1-thread-4 | [task:start_rebalance:301] Removing node 172.23.110.65:8091 from cluster 2021-02-19 04:47:35,348 | test | DEBUG | pool-1-thread-4 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.68,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': u'ns_1@172.23.110.65', 'user': 'Administrator'} 2021-02-19 04:47:35,390 | test | DEBUG | pool-1-thread-4 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 04:47:35,397 | test | INFO | pool-1-thread-4 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+---------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 16.4919587455 | Cluster node | | 172.23.110.68 | kv | 7.0.0-4498-enterprise | 12.1940258682 | Cluster node | | 172.23.110.69 | kv | 7.0.0-4498-enterprise | 12.2638996004 | Cluster node | | 172.23.110.65 | kv | 7.0.0-4498-enterprise | 6.23805871278 | --- OUT ---> | +---------------+----------+-----------------------+---------------+--------------+ 2021-02-19 04:47:35,415 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 04:47:35,415 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 04:47:35,516 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:35,828 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5316.100000 2021-02-19 04:47:36,206 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:36,493 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9046.200000 2021-02-19 04:47:36,549 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3779.300000 2021-02-19 04:47:36,658 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:36,697 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4463.900000 2021-02-19 04:47:36,878 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:36,884 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8834.100000 2021-02-19 04:47:36,930 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4505.700000 2021-02-19 04:47:37,119 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:37,461 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5316.100000 2021-02-19 04:47:37,835 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:38,117 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9046.200000 2021-02-19 04:47:38,176 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3779.300000 2021-02-19 04:47:38,289 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:38,342 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4463.900000 2021-02-19 04:47:38,509 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:38,525 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8834.100000 2021-02-19 04:47:38,566 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4505.700000 2021-02-19 04:47:38,746 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:39,068 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5316.100000 2021-02-19 04:47:39,447 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:39,755 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9047.300000 2021-02-19 04:47:39,805 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3769.000000 2021-02-19 04:47:39,921 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:39,959 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4511.100000 2021-02-19 04:47:40,151 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8834.500000 2021-02-19 04:47:40,177 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:40,227 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4504.100000 2021-02-19 04:47:40,351 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:40,456 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.09 % 2021-02-19 04:47:40,456 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 80.0889416801 2021-02-19 04:47:40,700 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5336.600000 2021-02-19 04:47:41,063 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:41,382 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9047.300000 2021-02-19 04:47:41,447 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3769.000000 2021-02-19 04:47:41,561 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:41,611 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4511.100000 2021-02-19 04:47:41,805 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8834.500000 2021-02-19 04:47:41,811 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:41,861 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4504.100000 2021-02-19 04:47:41,970 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:42,323 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5407.600000 2021-02-19 04:47:42,665 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:43,036 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9009.700000 2021-02-19 04:47:43,105 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3802.100000 2021-02-19 04:47:43,183 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:43,234 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4540.800000 2021-02-19 04:47:43,447 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8095.700000 2021-02-19 04:47:43,479 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:43,526 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4503.400000 2021-02-19 04:47:43,585 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:43,933 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5407.600000 2021-02-19 04:47:44,325 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:44,677 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8933.600000 2021-02-19 04:47:44,753 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3901.600000 2021-02-19 04:47:44,865 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:44,881 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4525.400000 2021-02-19 04:47:45,102 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:45,141 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 8054.900000 2021-02-19 04:47:45,203 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4530.800000 2021-02-19 04:47:45,223 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:45,490 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.50 % 2021-02-19 04:47:45,490 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 80.4970755343 2021-02-19 04:47:45,563 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5549.000000 2021-02-19 04:47:45,950 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:46,338 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8933.600000 2021-02-19 04:47:46,423 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3901.600000 2021-02-19 04:47:46,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4525.400000 2021-02-19 04:47:46,519 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:46,740 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:46,779 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6235.200000 2021-02-19 04:47:46,838 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4530.800000 2021-02-19 04:47:46,857 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:47,190 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5549.000000 2021-02-19 04:47:47,569 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:47,966 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8933.600000 2021-02-19 04:47:48,049 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3901.600000 2021-02-19 04:47:48,148 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4525.400000 2021-02-19 04:47:48,161 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:48,365 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:48,414 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6235.200000 2021-02-19 04:47:48,470 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4530.800000 2021-02-19 04:47:48,489 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:48,813 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5549.000000 2021-02-19 04:47:49,200 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:49,576 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8732.900000 2021-02-19 04:47:49,717 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4064.700000 2021-02-19 04:47:49,783 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4483.700000 2021-02-19 04:47:49,812 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:50,028 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:50,052 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6225.800000 2021-02-19 04:47:50,101 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:50,131 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4586.900000 2021-02-19 04:47:50,428 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5793.700000 2021-02-19 04:47:50,532 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 80.86 % 2021-02-19 04:47:50,532 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 80.8593744563 2021-02-19 04:47:50,793 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:51,216 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8732.900000 2021-02-19 04:47:51,394 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4064.700000 2021-02-19 04:47:51,453 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4483.700000 2021-02-19 04:47:51,473 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:51,657 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:51,700 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6225.800000 2021-02-19 04:47:51,723 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:51,766 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4586.900000 2021-02-19 04:47:52,059 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5793.700000 2021-02-19 04:47:52,394 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:52,835 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8560.400000 2021-02-19 04:47:53,010 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4164.300000 2021-02-19 04:47:53,092 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4469.400000 2021-02-19 04:47:53,105 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:53,276 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:53,325 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3101.000000 2021-02-19 04:47:53,341 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:53,380 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4657.700000 2021-02-19 04:47:53,691 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6017.500000 2021-02-19 04:47:53,999 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:54,447 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8560.400000 2021-02-19 04:47:54,648 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4212.500000 2021-02-19 04:47:54,727 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:54,746 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4476.900000 2021-02-19 04:47:54,934 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:54,983 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:55,019 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3051.200000 2021-02-19 04:47:55,033 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4684.900000 2021-02-19 04:47:55,305 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6146.200000 2021-02-19 04:47:55,568 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 81.14 % 2021-02-19 04:47:55,568 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 81.1438798315 2021-02-19 04:47:55,628 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:56,055 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8439.500000 2021-02-19 04:47:56,296 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4212.500000 2021-02-19 04:47:56,377 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4476.900000 2021-02-19 04:47:56,391 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:56,563 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:56,585 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:56,647 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1035.900000 2021-02-19 04:47:56,667 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4684.900000 2021-02-19 04:47:56,923 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6146.200000 2021-02-19 04:47:57,240 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:57,694 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8439.500000 2021-02-19 04:47:57,947 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4212.500000 2021-02-19 04:47:58,017 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4476.900000 2021-02-19 04:47:58,069 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:58,178 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:58,256 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:58,296 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4684.900000 2021-02-19 04:47:58,315 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1035.900000 2021-02-19 04:47:58,529 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6146.200000 2021-02-19 04:47:58,855 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:47:59,323 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8439.500000 2021-02-19 04:47:59,622 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4205.700000 2021-02-19 04:47:59,676 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4435.500000 2021-02-19 04:47:59,753 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:47:59,782 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:47:59,920 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:47:59,948 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4701.200000 2021-02-19 04:47:59,963 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1054.200000 2021-02-19 04:48:00,163 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6169.400000 2021-02-19 04:48:00,457 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:00,608 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 81.54 % 2021-02-19 04:48:00,608 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 81.5398491754 2021-02-19 04:48:00,946 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8403.100000 2021-02-19 04:48:01,260 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4205.700000 2021-02-19 04:48:01,293 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4435.500000 2021-02-19 04:48:01,384 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:01,395 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:01,582 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:01,601 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1054.200000 2021-02-19 04:48:01,615 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4701.200000 2021-02-19 04:48:01,806 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6169.400000 2021-02-19 04:48:02,079 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:02,559 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8358.600000 2021-02-19 04:48:02,891 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4242.100000 2021-02-19 04:48:02,934 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4387.900000 2021-02-19 04:48:02,990 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:03,036 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:03,253 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 950.700000 2021-02-19 04:48:03,259 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:03,289 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4706.800000 2021-02-19 04:48:03,417 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6154.300000 2021-02-19 04:48:03,703 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:04,174 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8358.600000 2021-02-19 04:48:04,526 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4242.100000 2021-02-19 04:48:04,561 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4302.000000 2021-02-19 04:48:04,586 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:04,671 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:04,901 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:04,924 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 986.200000 2021-02-19 04:48:04,947 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4727.100000 2021-02-19 04:48:05,039 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6145.300000 2021-02-19 04:48:05,328 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:05,644 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 81.84 % 2021-02-19 04:48:05,644 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 81.8408975058 2021-02-19 04:48:05,782 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8341.400000 2021-02-19 04:48:06,160 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4295.200000 2021-02-19 04:48:06,198 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:06,240 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4302.000000 2021-02-19 04:48:06,325 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:06,530 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:06,558 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1065.900000 2021-02-19 04:48:06,591 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4727.100000 2021-02-19 04:48:06,644 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6145.300000 2021-02-19 04:48:06,934 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:07,391 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8341.400000 2021-02-19 04:48:07,773 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4295.200000 2021-02-19 04:48:07,796 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:07,862 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4302.000000 2021-02-19 04:48:07,940 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:08,209 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:08,224 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4727.100000 2021-02-19 04:48:08,269 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1065.900000 2021-02-19 04:48:08,312 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6145.300000 2021-02-19 04:48:08,549 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:08,999 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8341.400000 2021-02-19 04:48:09,403 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:09,414 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4295.200000 2021-02-19 04:48:09,499 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4302.000000 2021-02-19 04:48:09,586 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:09,861 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:09,892 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4748.100000 2021-02-19 04:48:09,917 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1122.600000 2021-02-19 04:48:09,960 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6096.600000 2021-02-19 04:48:10,167 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:10,642 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8379.300000 2021-02-19 04:48:10,684 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 82.20 % 2021-02-19 04:48:10,684 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 82.1991333641 2021-02-19 04:48:11,007 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:11,063 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4407.400000 2021-02-19 04:48:11,122 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4186.000000 2021-02-19 04:48:11,207 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:11,499 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:11,539 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4748.100000 2021-02-19 04:48:11,578 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1122.600000 2021-02-19 04:48:11,602 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6096.600000 2021-02-19 04:48:11,779 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:12,267 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8379.300000 2021-02-19 04:48:12,653 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:12,740 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4503.600000 2021-02-19 04:48:12,747 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3976.800000 2021-02-19 04:48:12,822 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:13,157 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:13,194 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4755.100000 2021-02-19 04:48:13,220 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1543.900000 2021-02-19 04:48:13,244 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6063.600000 2021-02-19 04:48:13,397 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:13,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8408.800000 2021-02-19 04:48:14,256 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:14,381 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4503.600000 2021-02-19 04:48:14,392 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3976.800000 2021-02-19 04:48:14,457 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:14,789 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:14,858 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4771.400000 2021-02-19 04:48:14,859 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1578.500000 2021-02-19 04:48:14,890 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6056.600000 2021-02-19 04:48:15,010 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:15,510 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8385.000000 2021-02-19 04:48:15,720 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 82.59 % 2021-02-19 04:48:15,720 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 82.591026429 2021-02-19 04:48:15,858 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:48:16,009 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4606.600000 2021-02-19 04:48:16,032 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3806.500000 2021-02-19 04:48:16,075 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:16,448 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:16,506 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4771.400000 2021-02-19 04:48:16,519 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1568.800000 2021-02-19 04:48:16,532 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6056.600000 2021-02-19 04:48:16,632 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:17,131 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8385.000000 2021-02-19 04:48:17,450 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:48:17,641 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4606.600000 2021-02-19 04:48:17,651 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3806.500000 2021-02-19 04:48:17,698 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:18,072 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:18,161 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4771.400000 2021-02-19 04:48:18,174 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1568.800000 2021-02-19 04:48:18,187 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6056.600000 2021-02-19 04:48:18,266 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:18,780 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8385.000000 2021-02-19 04:48:19,056 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:48:19,282 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4606.600000 2021-02-19 04:48:19,283 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3806.500000 2021-02-19 04:48:19,362 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:19,696 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:19,776 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4760.600000 2021-02-19 04:48:19,836 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1564.100000 2021-02-19 04:48:19,851 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6099.100000 2021-02-19 04:48:19,884 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:20,403 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8241.400000 2021-02-19 04:48:20,653 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:48:20,756 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 82.93 % 2021-02-19 04:48:20,756 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 82.9305440158 2021-02-19 04:48:20,936 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3735.500000 2021-02-19 04:48:20,954 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4645.000000 2021-02-19 04:48:21,016 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:21,309 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:21,398 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4760.600000 2021-02-19 04:48:21,471 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1564.100000 2021-02-19 04:48:21,486 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6099.100000 2021-02-19 04:48:21,525 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:22,009 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8241.400000 2021-02-19 04:48:22,247 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:48:22,573 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4682.628182 2021-02-19 04:48:22,585 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3778.114346 2021-02-19 04:48:22,638 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:22,937 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:23,063 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4765.022753 2021-02-19 04:48:23,128 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 905.647816 2021-02-19 04:48:23,138 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6141.082005 2021-02-19 04:48:23,190 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:23,630 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8073.609197 2021-02-19 04:48:23,836 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:48:24,232 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4684.528182 2021-02-19 04:48:24,240 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3856.014346 2021-02-19 04:48:24,269 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:24,561 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:24,710 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4748.022753 2021-02-19 04:48:24,778 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 840.147816 2021-02-19 04:48:24,796 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6190.882005 2021-02-19 04:48:24,851 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:25,253 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8019.909197 2021-02-19 04:48:25,437 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:48:25,801 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 83.31 % 2021-02-19 04:48:25,802 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 83.3067839345 2021-02-19 04:48:25,868 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3856.014346 2021-02-19 04:48:25,938 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4684.528182 2021-02-19 04:48:25,953 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:26,168 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:26,348 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4748.022753 2021-02-19 04:48:26,437 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6190.882005 2021-02-19 04:48:26,447 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 840.147816 2021-02-19 04:48:26,496 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:26,877 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8019.909197 2021-02-19 04:48:27,045 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:27,546 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3856.014346 2021-02-19 04:48:27,592 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:27,617 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4684.528182 2021-02-19 04:48:27,796 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:28,038 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4748.022753 2021-02-19 04:48:28,075 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6190.882005 2021-02-19 04:48:28,105 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 468.747816 2021-02-19 04:48:28,112 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:28,507 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8019.909197 2021-02-19 04:48:28,661 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:29,187 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3856.014346 2021-02-19 04:48:29,223 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:29,253 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4684.528182 2021-02-19 04:48:29,408 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:29,706 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4755.222753 2021-02-19 04:48:29,749 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 454.147816 2021-02-19 04:48:29,756 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:29,779 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6205.182005 2021-02-19 04:48:30,151 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8253.109197 2021-02-19 04:48:30,279 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:30,819 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3961.214346 2021-02-19 04:48:30,836 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 83.73 % 2021-02-19 04:48:30,836 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 83.7346635606 2021-02-19 04:48:30,845 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:30,891 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4653.828182 2021-02-19 04:48:31,038 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:31,381 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4755.222753 2021-02-19 04:48:31,400 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 454.147816 2021-02-19 04:48:31,430 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6205.182005 2021-02-19 04:48:31,446 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:31,769 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8253.109197 2021-02-19 04:48:31,888 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:32,470 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:32,480 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4102.227958 2021-02-19 04:48:32,546 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4626.463609 2021-02-19 04:48:32,651 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:33,022 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 566.185796 2021-02-19 04:48:33,039 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4764.780114 2021-02-19 04:48:33,085 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6186.812484 2021-02-19 04:48:33,095 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:33,391 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8658.012274 2021-02-19 04:48:33,496 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:34,098 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:34,118 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4102.227958 2021-02-19 04:48:34,180 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4626.463609 2021-02-19 04:48:34,269 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:34,660 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4776.880114 2021-02-19 04:48:34,690 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 624.585796 2021-02-19 04:48:34,726 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6109.212484 2021-02-19 04:48:34,740 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:35,015 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8977.012274 2021-02-19 04:48:35,098 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:35,799 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:35,815 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4217.627958 2021-02-19 04:48:35,835 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4616.863609 2021-02-19 04:48:35,881 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 84.24 % 2021-02-19 04:48:35,882 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 84.2433204916 2021-02-19 04:48:35,907 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:36,298 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4776.880114 2021-02-19 04:48:36,351 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 679.385796 2021-02-19 04:48:36,374 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6109.212484 2021-02-19 04:48:36,384 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:36,622 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8977.012274 2021-02-19 04:48:36,710 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:37,438 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:37,463 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4616.863609 2021-02-19 04:48:37,492 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4217.627958 2021-02-19 04:48:37,591 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:37,969 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4776.880114 2021-02-19 04:48:38,003 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 679.385796 2021-02-19 04:48:38,010 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:38,026 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6109.212484 2021-02-19 04:48:38,265 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8977.012274 2021-02-19 04:48:38,316 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:39,086 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:39,098 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4616.863609 2021-02-19 04:48:39,125 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4217.627958 2021-02-19 04:48:39,217 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:39,621 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4769.080114 2021-02-19 04:48:39,651 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 699.385796 2021-02-19 04:48:39,664 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5897.112484 2021-02-19 04:48:39,664 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:39,911 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9103.512274 2021-02-19 04:48:39,924 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:40,789 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4337.927958 2021-02-19 04:48:40,803 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:40,816 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4662.963609 2021-02-19 04:48:40,848 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:40,921 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 84.69 % 2021-02-19 04:48:40,921 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 84.6949811415 2021-02-19 04:48:41,278 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4769.080114 2021-02-19 04:48:41,290 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5897.112484 2021-02-19 04:48:41,312 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 699.385796 2021-02-19 04:48:41,362 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:41,530 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9103.512274 2021-02-19 04:48:41,539 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:42,440 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:42,483 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4411.300000 2021-02-19 04:48:42,505 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4669.900000 2021-02-19 04:48:42,517 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:42,917 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4763.700000 2021-02-19 04:48:42,947 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5640.100000 2021-02-19 04:48:42,993 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 818.800000 2021-02-19 04:48:43,012 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:43,132 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:43,160 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9146.800000 2021-02-19 04:48:44,078 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:44,148 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4669.900000 2021-02-19 04:48:44,165 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4411.300000 2021-02-19 04:48:44,183 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:44,551 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4763.700000 2021-02-19 04:48:44,576 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5640.100000 2021-02-19 04:48:44,632 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 918.600000 2021-02-19 04:48:44,644 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:44,782 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9198.200000 2021-02-19 04:48:44,790 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:45,823 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4504.200000 2021-02-19 04:48:45,835 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:45,842 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4695.500000 2021-02-19 04:48:45,851 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:45,954 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 85.05 % 2021-02-19 04:48:45,954 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 85.0525942399 2021-02-19 04:48:46,173 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4781.700000 2021-02-19 04:48:46,210 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5395.000000 2021-02-19 04:48:46,302 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 969.600000 2021-02-19 04:48:46,309 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:46,405 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:46,420 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9198.200000 2021-02-19 04:48:47,483 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4504.200000 2021-02-19 04:48:47,502 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4695.500000 2021-02-19 04:48:47,546 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:47,559 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:47,799 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4781.700000 2021-02-19 04:48:47,861 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5395.000000 2021-02-19 04:48:47,928 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:47,950 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 969.600000 2021-02-19 04:48:48,013 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:48,048 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9198.200000 2021-02-19 04:48:49,142 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4504.200000 2021-02-19 04:48:49,177 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4695.500000 2021-02-19 04:48:49,190 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:49,209 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:49,431 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4781.700000 2021-02-19 04:48:49,500 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5395.000000 2021-02-19 04:48:49,545 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:49,581 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 969.600000 2021-02-19 04:48:49,614 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:49,671 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9195.800000 2021-02-19 04:48:50,799 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4574.700000 2021-02-19 04:48:50,821 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4689.400000 2021-02-19 04:48:50,823 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:50,855 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:50,993 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 85.31 % 2021-02-19 04:48:50,993 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 85.3135279249 2021-02-19 04:48:51,095 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4807.600000 2021-02-19 04:48:51,165 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5297.100000 2021-02-19 04:48:51,219 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:51,239 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:51,255 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1033.500000 2021-02-19 04:48:51,299 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9195.800000 2021-02-19 04:48:52,433 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4619.800000 2021-02-19 04:48:52,460 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:52,486 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4712.600000 2021-02-19 04:48:52,496 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:52,736 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4819.400000 2021-02-19 04:48:52,841 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5354.700000 2021-02-19 04:48:52,857 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:52,869 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:52,894 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 871.500000 2021-02-19 04:48:52,937 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9126.500000 2021-02-19 04:48:54,079 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4619.800000 2021-02-19 04:48:54,105 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:54,151 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4712.600000 2021-02-19 04:48:54,161 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:54,361 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4819.400000 2021-02-19 04:48:54,480 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:54,493 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5354.700000 2021-02-19 04:48:54,528 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:54,579 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 871.500000 2021-02-19 04:48:54,596 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9126.500000 2021-02-19 04:48:55,740 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4632.450509 2021-02-19 04:48:55,753 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:55,796 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4684.539744 2021-02-19 04:48:55,812 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:56,002 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4804.272359 2021-02-19 04:48:56,032 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 85.78 % 2021-02-19 04:48:56,032 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 85.7848696678 2021-02-19 04:48:56,085 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:56,118 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5441.328440 2021-02-19 04:48:56,150 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:56,219 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 734.672818 2021-02-19 04:48:56,233 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9073.662952 2021-02-19 04:48:57,382 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4632.450509 2021-02-19 04:48:57,392 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:57,430 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4684.539744 2021-02-19 04:48:57,441 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:57,641 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4804.272359 2021-02-19 04:48:57,710 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:57,746 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5441.328440 2021-02-19 04:48:57,779 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:57,869 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 734.672818 2021-02-19 04:48:57,878 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9073.662952 2021-02-19 04:48:59,023 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:48:59,045 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4632.450509 2021-02-19 04:48:59,063 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4684.539744 2021-02-19 04:48:59,069 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:48:59,279 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4804.272359 2021-02-19 04:48:59,319 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:48:59,385 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5441.328440 2021-02-19 04:48:59,427 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:48:59,513 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 734.672818 2021-02-19 04:48:59,526 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9073.662952 2021-02-19 04:49:00,644 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:00,664 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4623.950509 2021-02-19 04:49:00,690 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:00,701 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4632.239744 2021-02-19 04:49:00,914 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4768.972359 2021-02-19 04:49:00,934 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:49:01,019 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5640.228440 2021-02-19 04:49:01,059 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:01,075 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 86.13 % 2021-02-19 04:49:01,075 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 86.1323756904 2021-02-19 04:49:01,154 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 684.772818 2021-02-19 04:49:01,183 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9048.562952 2021-02-19 04:49:02,273 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:02,290 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4629.750509 2021-02-19 04:49:02,316 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:02,339 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4569.439744 2021-02-19 04:49:02,535 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:49:02,552 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4728.272359 2021-02-19 04:49:02,644 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5802.328440 2021-02-19 04:49:02,694 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:02,799 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 583.672818 2021-02-19 04:49:02,822 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8984.062952 2021-02-19 04:49:03,887 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:03,934 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4629.750509 2021-02-19 04:49:03,954 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:03,977 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4569.439744 2021-02-19 04:49:04,134 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:49:04,174 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4728.272359 2021-02-19 04:49:04,266 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6003.352994 2021-02-19 04:49:04,311 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:04,430 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 583.672818 2021-02-19 04:49:04,463 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8984.062952 2021-02-19 04:49:05,509 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:05,565 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4650.879071 2021-02-19 04:49:05,578 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:05,618 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4548.230563 2021-02-19 04:49:05,743 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:49:05,786 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4704.594492 2021-02-19 04:49:05,897 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6003.352994 2021-02-19 04:49:05,950 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:06,081 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 371.500941 2021-02-19 04:49:06,095 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8835.328820 2021-02-19 04:49:06,111 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 86.27 % 2021-02-19 04:49:06,111 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 86.2652144732 2021-02-19 04:49:07,127 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:07,203 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4650.879071 2021-02-19 04:49:07,223 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:07,263 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4548.230563 2021-02-19 04:49:07,355 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:49:07,407 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4704.594492 2021-02-19 04:49:07,519 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6003.352994 2021-02-19 04:49:07,601 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:07,753 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 371.500941 2021-02-19 04:49:07,769 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8835.328820 2021-02-19 04:49:08,756 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:08,839 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4650.879071 2021-02-19 04:49:08,881 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:08,937 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4548.230563 2021-02-19 04:49:09,009 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:49:09,030 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4704.594492 2021-02-19 04:49:09,140 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6003.352994 2021-02-19 04:49:09,230 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:09,381 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 371.500941 2021-02-19 04:49:09,413 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8835.328820 2021-02-19 04:49:10,411 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:10,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4708.479071 2021-02-19 04:49:10,528 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:10,592 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4526.930563 2021-02-19 04:49:10,612 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:49:10,664 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4766.294492 2021-02-19 04:49:10,779 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6052.352994 2021-02-19 04:49:10,884 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:11,045 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 287.900941 2021-02-19 04:49:11,056 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8548.428820 2021-02-19 04:49:11,144 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 86.54 % 2021-02-19 04:49:11,144 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 86.5402821246 2021-02-19 04:49:12,042 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:12,184 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:12,203 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4708.479071 2021-02-19 04:49:12,223 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:49:12,292 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4526.930563 2021-02-19 04:49:12,318 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4848.794492 2021-02-19 04:49:12,447 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6012.452994 2021-02-19 04:49:12,500 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:12,670 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 179.400941 2021-02-19 04:49:12,681 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8219.228820 2021-02-19 04:49:13,667 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:13,828 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:13,836 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:49:13,858 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4751.879071 2021-02-19 04:49:13,936 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4552.530563 2021-02-19 04:49:13,976 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4848.794492 2021-02-19 04:49:14,095 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6012.452994 2021-02-19 04:49:14,118 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:14,299 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 133.800000 2021-02-19 04:49:14,313 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7958.600000 2021-02-19 04:49:15,290 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:15,450 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:49:15,467 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:15,483 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4769.900000 2021-02-19 04:49:15,569 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4558.100000 2021-02-19 04:49:15,605 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4910.200000 2021-02-19 04:49:15,733 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5943.200000 2021-02-19 04:49:15,773 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:15,947 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7958.600000 2021-02-19 04:49:15,954 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 103.000000 2021-02-19 04:49:16,184 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 86.82 % 2021-02-19 04:49:16,184 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 86.8153497759 2021-02-19 04:49:16,907 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:17,108 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:17,131 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:49:17,144 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4769.900000 2021-02-19 04:49:17,240 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4910.200000 2021-02-19 04:49:17,267 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4558.100000 2021-02-19 04:49:17,414 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5943.200000 2021-02-19 04:49:17,453 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:17,572 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7958.600000 2021-02-19 04:49:17,586 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 103.000000 2021-02-19 04:49:18,513 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:18,746 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:49:18,766 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:18,809 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4769.900000 2021-02-19 04:49:18,874 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4910.200000 2021-02-19 04:49:18,936 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4558.100000 2021-02-19 04:49:19,049 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5943.200000 2021-02-19 04:49:19,078 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:19,221 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7958.600000 2021-02-19 04:49:19,236 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 103.000000 2021-02-19 04:49:20,118 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:20,365 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:49:20,420 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:20,454 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4689.100000 2021-02-19 04:49:20,526 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4852.200000 2021-02-19 04:49:20,585 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4628.100000 2021-02-19 04:49:20,704 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5959.100000 2021-02-19 04:49:20,730 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:20,865 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7988.900000 2021-02-19 04:49:20,877 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 122.500000 2021-02-19 04:49:21,224 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 87.13 % 2021-02-19 04:49:21,226 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 87.1273556866 2021-02-19 04:49:21,732 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:21,977 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.100000 2021-02-19 04:49:22,072 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:22,118 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4689.100000 2021-02-19 04:49:22,151 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4852.200000 2021-02-19 04:49:22,207 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4628.100000 2021-02-19 04:49:22,352 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:22,377 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6058.600000 2021-02-19 04:49:22,507 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8225.900000 2021-02-19 04:49:22,517 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 153.700000 2021-02-19 04:49:23,335 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:23,599 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.800000 2021-02-19 04:49:23,750 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:23,809 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4628.800000 2021-02-19 04:49:23,838 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4778.400000 2021-02-19 04:49:23,867 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4635.400000 2021-02-19 04:49:24,002 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:24,017 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6058.600000 2021-02-19 04:49:24,164 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 153.700000 2021-02-19 04:49:24,171 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8225.900000 2021-02-19 04:49:24,954 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:25,226 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.800000 2021-02-19 04:49:25,372 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:25,476 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4733.500000 2021-02-19 04:49:25,500 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4581.600000 2021-02-19 04:49:25,529 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4665.000000 2021-02-19 04:49:25,642 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:25,664 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6151.300000 2021-02-19 04:49:25,801 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8466.900000 2021-02-19 04:49:25,815 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 245.700000 2021-02-19 04:49:26,262 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 87.43 % 2021-02-19 04:49:26,263 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 87.4272968825 2021-02-19 04:49:26,559 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:26,828 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.500000 2021-02-19 04:49:27,036 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:27,108 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4733.500000 2021-02-19 04:49:27,144 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4581.600000 2021-02-19 04:49:27,170 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4665.000000 2021-02-19 04:49:27,275 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:27,298 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6151.300000 2021-02-19 04:49:27,434 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 245.700000 2021-02-19 04:49:27,443 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8466.900000 2021-02-19 04:49:28,177 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:28,431 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.500000 2021-02-19 04:49:28,727 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:28,796 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4733.500000 2021-02-19 04:49:28,812 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4581.600000 2021-02-19 04:49:28,832 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4665.000000 2021-02-19 04:49:28,941 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:28,960 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6151.300000 2021-02-19 04:49:29,069 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 245.700000 2021-02-19 04:49:29,075 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8466.900000 2021-02-19 04:49:29,825 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:30,043 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.500000 2021-02-19 04:49:30,362 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:30,457 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4730.100000 2021-02-19 04:49:30,477 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4542.100000 2021-02-19 04:49:30,489 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4591.500000 2021-02-19 04:49:30,569 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:30,617 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6110.700000 2021-02-19 04:49:30,694 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 266.100000 2021-02-19 04:49:30,707 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8516.300000 2021-02-19 04:49:31,306 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 87.71 % 2021-02-19 04:49:31,308 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 87.7091773417 2021-02-19 04:49:31,423 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:31,634 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.500000 2021-02-19 04:49:32,006 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:32,114 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4542.100000 2021-02-19 04:49:32,137 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4591.500000 2021-02-19 04:49:32,144 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4730.100000 2021-02-19 04:49:32,230 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:32,250 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6110.700000 2021-02-19 04:49:32,335 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8432.400000 2021-02-19 04:49:32,348 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 290.900000 2021-02-19 04:49:33,020 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:33,229 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1889.900000 2021-02-19 04:49:33,628 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:33,767 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4460.100000 2021-02-19 04:49:33,815 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4707.300000 2021-02-19 04:49:33,829 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4485.900000 2021-02-19 04:49:33,888 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:33,940 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5989.200000 2021-02-19 04:49:33,967 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8432.400000 2021-02-19 04:49:33,986 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 290.900000 2021-02-19 04:49:34,618 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:34,828 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1889.900000 2021-02-19 04:49:35,250 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:35,325 | test | DEBUG | MainThread | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 87.91 % 2021-02-19 04:49:35,326 | test | INFO | MainThread | [Magma:abort_rebalance:933] Rebalance % = 87.9110127938 2021-02-19 04:49:35,440 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4372.300000 2021-02-19 04:49:35,459 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4646.300000 2021-02-19 04:49:35,487 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4318.000000 2021-02-19 04:49:35,543 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:35,582 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5809.300000 2021-02-19 04:49:35,604 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8313.400000 2021-02-19 04:49:35,635 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 245.000000 2021-02-19 04:49:36,226 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:36,342 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 87.97 % 2021-02-19 04:49:36,342 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 87.9665563138 2021-02-19 04:49:36,420 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1889.900000 2021-02-19 04:49:36,892 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:37,124 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4372.300000 2021-02-19 04:49:37,141 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4646.300000 2021-02-19 04:49:37,148 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4318.000000 2021-02-19 04:49:37,200 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:37,253 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5809.300000 2021-02-19 04:49:37,273 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8313.400000 2021-02-19 04:49:37,295 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 211.500000 2021-02-19 04:49:37,832 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:37,907 | infra | INFO | pool-2-thread-39 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:49:37,907 | infra | INFO | pool-2-thread-39 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers2__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:49:38,019 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4643.400000 2021-02-19 04:49:38,525 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:38,776 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4372.300000 2021-02-19 04:49:38,805 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4646.300000 2021-02-19 04:49:38,818 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4318.000000 2021-02-19 04:49:38,869 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:38,937 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5809.300000 2021-02-19 04:49:38,951 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8313.400000 2021-02-19 04:49:38,973 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 211.500000 2021-02-19 04:49:39,440 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:39,611 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4643.400000 2021-02-19 04:49:40,148 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:40,430 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4356.700000 2021-02-19 04:49:40,467 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4555.100000 2021-02-19 04:49:40,492 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4190.100000 2021-02-19 04:49:40,520 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:40,581 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5677.400000 2021-02-19 04:49:40,625 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8250.700000 2021-02-19 04:49:40,641 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 196.700000 2021-02-19 04:49:41,078 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:41,233 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4643.400000 2021-02-19 04:49:41,380 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 88.17 % 2021-02-19 04:49:41,380 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 88.1738161393 2021-02-19 04:49:41,757 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:42,058 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4356.700000 2021-02-19 04:49:42,121 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4555.100000 2021-02-19 04:49:42,138 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4190.100000 2021-02-19 04:49:42,177 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:42,262 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5677.400000 2021-02-19 04:49:42,280 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8250.700000 2021-02-19 04:49:42,319 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 196.700000 2021-02-19 04:49:42,691 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:42,839 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5964.200000 2021-02-19 04:49:43,405 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:43,670 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4396.100000 2021-02-19 04:49:43,762 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4118.200000 2021-02-19 04:49:43,782 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4164.400000 2021-02-19 04:49:43,821 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:43,894 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5600.600000 2021-02-19 04:49:43,960 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8249.000000 2021-02-19 04:49:43,997 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 164.800000 2021-02-19 04:49:44,328 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:44,443 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5964.200000 2021-02-19 04:49:45,012 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:45,329 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4456.200000 2021-02-19 04:49:45,404 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3376.300000 2021-02-19 04:49:45,453 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4210.100000 2021-02-19 04:49:45,486 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:45,562 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5613.100000 2021-02-19 04:49:45,598 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8321.600000 2021-02-19 04:49:45,677 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 176.300000 2021-02-19 04:49:45,967 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:46,081 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6497.700000 2021-02-19 04:49:46,414 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 88.46 % 2021-02-19 04:49:46,415 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 88.4578020232 2021-02-19 04:49:46,617 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:46,950 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4456.200000 2021-02-19 04:49:47,036 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3376.300000 2021-02-19 04:49:47,092 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4210.100000 2021-02-19 04:49:47,121 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:47,188 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5613.100000 2021-02-19 04:49:47,230 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8321.600000 2021-02-19 04:49:47,306 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 177.900000 2021-02-19 04:49:47,573 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:47,671 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6497.700000 2021-02-19 04:49:48,223 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:48,582 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4456.200000 2021-02-19 04:49:48,698 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3376.300000 2021-02-19 04:49:48,785 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4210.100000 2021-02-19 04:49:48,815 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:48,864 | infra | INFO | pool-2-thread-15 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 04:49:48,864 | infra | INFO | pool-2-thread-15 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:49:48,864 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5613.100000 2021-02-19 04:49:48,884 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8321.600000 2021-02-19 04:49:48,941 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 177.900000 2021-02-19 04:49:49,177 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:49,279 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6497.700000 2021-02-19 04:49:49,828 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:50,224 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4503.000000 2021-02-19 04:49:50,358 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1937.200000 2021-02-19 04:49:50,460 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4329.800000 2021-02-19 04:49:50,469 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:50,509 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5693.900000 2021-02-19 04:49:50,565 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8552.600000 2021-02-19 04:49:50,615 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 192.300000 2021-02-19 04:49:50,779 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:49:50,878 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6497.700000 2021-02-19 04:49:51,424 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:51,456 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 88.71 % 2021-02-19 04:49:51,457 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 88.7057662292 2021-02-19 04:49:51,839 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4503.000000 2021-02-19 04:49:52,005 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1937.200000 2021-02-19 04:49:52,138 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4329.800000 2021-02-19 04:49:52,147 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:52,167 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5693.900000 2021-02-19 04:49:52,230 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8552.600000 2021-02-19 04:49:52,263 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 192.300000 2021-02-19 04:49:52,398 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 220.700000 2021-02-19 04:49:52,484 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6690.200000 2021-02-19 04:49:53,020 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:53,453 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4552.200000 2021-02-19 04:49:53,648 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 822.100000 2021-02-19 04:49:53,779 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4383.600000 2021-02-19 04:49:53,803 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:53,806 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5763.200000 2021-02-19 04:49:53,865 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8838.100000 2021-02-19 04:49:53,904 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 238.400000 2021-02-19 04:49:54,039 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 220.700000 2021-02-19 04:49:54,098 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6690.200000 2021-02-19 04:49:54,638 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:55,076 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4579.400000 2021-02-19 04:49:55,282 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 41.000000 2021-02-19 04:49:55,437 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:55,500 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4387.200000 2021-02-19 04:49:55,526 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5738.100000 2021-02-19 04:49:55,539 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9063.000000 2021-02-19 04:49:55,575 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 383.500000 2021-02-19 04:49:55,668 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 742.400000 2021-02-19 04:49:55,704 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6765.600000 2021-02-19 04:49:56,253 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:56,496 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 88.89 % 2021-02-19 04:49:56,496 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 88.8913741074 2021-02-19 04:49:56,687 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4579.400000 2021-02-19 04:49:56,910 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 41.000000 2021-02-19 04:49:57,069 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:57,167 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4387.200000 2021-02-19 04:49:57,193 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5738.100000 2021-02-19 04:49:57,203 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9063.000000 2021-02-19 04:49:57,246 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 422.300000 2021-02-19 04:49:57,313 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 742.400000 2021-02-19 04:49:57,328 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6765.600000 2021-02-19 04:49:57,881 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:58,305 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4579.400000 2021-02-19 04:49:58,519 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 41.000000 2021-02-19 04:49:58,707 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:49:58,802 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4387.200000 2021-02-19 04:49:58,834 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5738.100000 2021-02-19 04:49:58,884 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9063.000000 2021-02-19 04:49:58,921 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 422.300000 2021-02-19 04:49:58,948 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6765.600000 2021-02-19 04:49:58,963 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 742.400000 2021-02-19 04:49:59,477 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:49:59,918 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4538.500000 2021-02-19 04:50:00,134 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:50:00,180 | infra | INFO | pool-2-thread-31 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope2_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.32' completed 2021-02-19 04:50:00,181 | infra | INFO | pool-2-thread-31 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:50:00,384 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:00,500 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5555.400000 2021-02-19 04:50:00,506 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4246.900000 2021-02-19 04:50:00,556 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9052.500000 2021-02-19 04:50:00,598 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6765.600000 2021-02-19 04:50:00,605 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 674.200000 2021-02-19 04:50:00,611 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1931.700000 2021-02-19 04:50:01,084 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:01,552 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 89.10 % 2021-02-19 04:50:01,552 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 89.1010387443 2021-02-19 04:50:01,555 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4538.500000 2021-02-19 04:50:01,746 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:50:02,000 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:02,017 | infra | INFO | pool-2-thread-12 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope0_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.38' completed 2021-02-19 04:50:02,017 | infra | INFO | pool-2-thread-12 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope4_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:50:02,141 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5555.400000 2021-02-19 04:50:02,167 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4246.900000 2021-02-19 04:50:02,194 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 9052.500000 2021-02-19 04:50:02,236 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6765.600000 2021-02-19 04:50:02,273 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1931.700000 2021-02-19 04:50:02,282 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 674.200000 2021-02-19 04:50:02,693 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:03,187 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4451.600000 2021-02-19 04:50:03,367 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 23.900000 2021-02-19 04:50:03,628 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:03,776 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5328.300000 2021-02-19 04:50:03,852 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 4051.300000 2021-02-19 04:50:03,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8897.400000 2021-02-19 04:50:03,924 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6564.800000 2021-02-19 04:50:03,950 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3069.100000 2021-02-19 04:50:03,976 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1122.700000 2021-02-19 04:50:04,302 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:04,816 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4348.700000 2021-02-19 04:50:05,007 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 355.700000 2021-02-19 04:50:05,236 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:05,411 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5134.000000 2021-02-19 04:50:05,496 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3855.000000 2021-02-19 04:50:05,535 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8707.700000 2021-02-19 04:50:05,551 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6564.800000 2021-02-19 04:50:05,589 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3883.800000 2021-02-19 04:50:05,641 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1394.600000 2021-02-19 04:50:05,911 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:06,434 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4348.700000 2021-02-19 04:50:06,500 | infra | INFO | pool-2-thread-50 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:50:06,500 | infra | INFO | pool-2-thread-50 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9_VolumeScope1_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:50:06,602 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 89.28 % 2021-02-19 04:50:06,602 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 89.2784725048 2021-02-19 04:50:06,644 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 355.700000 2021-02-19 04:50:06,835 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:07,045 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5134.000000 2021-02-19 04:50:07,177 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6329.300000 2021-02-19 04:50:07,203 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3855.000000 2021-02-19 04:50:07,213 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8707.700000 2021-02-19 04:50:07,267 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3883.800000 2021-02-19 04:50:07,282 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1427.900000 2021-02-19 04:50:07,536 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:08,056 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4348.700000 2021-02-19 04:50:08,315 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 355.700000 2021-02-19 04:50:08,471 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:08,696 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 5134.000000 2021-02-19 04:50:08,796 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6329.300000 2021-02-19 04:50:08,855 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3855.000000 2021-02-19 04:50:08,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8707.700000 2021-02-19 04:50:08,907 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3883.800000 2021-02-19 04:50:08,944 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1427.900000 2021-02-19 04:50:09,164 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:09,697 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4348.700000 2021-02-19 04:50:09,957 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1396.100000 2021-02-19 04:50:10,121 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:10,338 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4945.600000 2021-02-19 04:50:10,420 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6329.300000 2021-02-19 04:50:10,497 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3704.600000 2021-02-19 04:50:10,559 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8410.900000 2021-02-19 04:50:10,575 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3987.400000 2021-02-19 04:50:10,605 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1711.800000 2021-02-19 04:50:10,790 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:11,303 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4295.000000 2021-02-19 04:50:11,569 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1396.100000 2021-02-19 04:50:11,653 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 89.50 % 2021-02-19 04:50:11,654 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 89.4997571281 2021-02-19 04:50:11,720 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:11,976 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4945.600000 2021-02-19 04:50:12,081 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6329.300000 2021-02-19 04:50:12,158 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3704.600000 2021-02-19 04:50:12,181 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8410.900000 2021-02-19 04:50:12,257 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3987.400000 2021-02-19 04:50:12,267 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1711.800000 2021-02-19 04:50:12,430 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:12,923 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4226.100000 2021-02-19 04:50:13,170 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2783.500000 2021-02-19 04:50:13,332 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:13,618 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4784.200000 2021-02-19 04:50:13,693 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6104.500000 2021-02-19 04:50:13,798 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3610.300000 2021-02-19 04:50:13,839 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8135.200000 2021-02-19 04:50:13,937 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1891.600000 2021-02-19 04:50:13,950 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3878.400000 2021-02-19 04:50:14,069 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:14,553 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4226.100000 2021-02-19 04:50:14,793 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3868.700000 2021-02-19 04:50:14,947 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:15,278 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4649.900000 2021-02-19 04:50:15,315 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6104.500000 2021-02-19 04:50:15,437 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3544.600000 2021-02-19 04:50:15,512 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7916.000000 2021-02-19 04:50:15,575 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2209.400000 2021-02-19 04:50:15,588 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3779.900000 2021-02-19 04:50:15,693 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:16,213 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4175.500000 2021-02-19 04:50:16,421 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3868.700000 2021-02-19 04:50:16,565 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:16,696 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 89.65 % 2021-02-19 04:50:16,697 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 89.6464211177 2021-02-19 04:50:16,927 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4649.900000 2021-02-19 04:50:16,940 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5932.600000 2021-02-19 04:50:17,078 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3544.600000 2021-02-19 04:50:17,151 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7916.000000 2021-02-19 04:50:17,217 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2192.400000 2021-02-19 04:50:17,302 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3779.900000 2021-02-19 04:50:17,387 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:17,881 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4175.500000 2021-02-19 04:50:18,078 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3868.700000 2021-02-19 04:50:18,193 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:18,559 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5932.600000 2021-02-19 04:50:18,572 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4649.900000 2021-02-19 04:50:18,701 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3544.600000 2021-02-19 04:50:18,829 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7916.000000 2021-02-19 04:50:18,861 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2192.400000 2021-02-19 04:50:18,940 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3779.900000 2021-02-19 04:50:19,003 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:19,493 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4175.500000 2021-02-19 04:50:19,701 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4229.100000 2021-02-19 04:50:19,798 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:20,173 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5932.600000 2021-02-19 04:50:20,190 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4680.100000 2021-02-19 04:50:20,378 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3554.800000 2021-02-19 04:50:20,510 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8020.200000 2021-02-19 04:50:20,523 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2199.400000 2021-02-19 04:50:20,605 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3777.800000 2021-02-19 04:50:20,647 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:21,111 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4142.200000 2021-02-19 04:50:21,355 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4229.100000 2021-02-19 04:50:21,420 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:21,746 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 89.90 % 2021-02-19 04:50:21,746 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 89.8991198315 2021-02-19 04:50:21,786 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5932.600000 2021-02-19 04:50:21,816 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4680.100000 2021-02-19 04:50:22,082 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3554.800000 2021-02-19 04:50:22,193 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8020.200000 2021-02-19 04:50:22,203 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2199.400000 2021-02-19 04:50:22,230 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3777.800000 2021-02-19 04:50:22,265 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:22,757 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4158.800000 2021-02-19 04:50:22,983 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4175.900000 2021-02-19 04:50:23,019 | infra | INFO | pool-2-thread-33 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.32' completed 2021-02-19 04:50:23,020 | infra | INFO | pool-2-thread-33 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:50:23,079 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:23,411 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5901.000000 2021-02-19 04:50:23,476 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4743.300000 2021-02-19 04:50:23,716 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3575.000000 2021-02-19 04:50:23,828 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8202.600000 2021-02-19 04:50:23,868 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2132.800000 2021-02-19 04:50:23,888 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3886.700000 2021-02-19 04:50:23,921 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:24,374 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4211.900000 2021-02-19 04:50:24,612 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4175.900000 2021-02-19 04:50:24,717 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:25,029 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5901.000000 2021-02-19 04:50:25,128 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4809.000000 2021-02-19 04:50:25,194 | infra | INFO | pool-2-thread-62 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' completed 2021-02-19 04:50:25,196 | infra | INFO | pool-2-thread-62 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5_VolumeScope4_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:50:25,336 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3588.300000 2021-02-19 04:50:25,490 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8407.300000 2021-02-19 04:50:25,519 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1948.600000 2021-02-19 04:50:25,525 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4039.500000 2021-02-19 04:50:25,569 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:25,994 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4211.900000 2021-02-19 04:50:26,256 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4106.900000 2021-02-19 04:50:26,342 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:26,677 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5934.000000 2021-02-19 04:50:26,802 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4809.000000 2021-02-19 04:50:26,805 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 89.96 % 2021-02-19 04:50:26,805 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 89.9646226415 2021-02-19 04:50:26,970 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3588.300000 2021-02-19 04:50:27,140 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8407.300000 2021-02-19 04:50:27,190 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1899.300000 2021-02-19 04:50:27,197 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4039.500000 2021-02-19 04:50:27,226 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:27,637 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4211.900000 2021-02-19 04:50:27,872 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4106.900000 2021-02-19 04:50:27,983 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:28,315 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5934.000000 2021-02-19 04:50:28,453 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4809.000000 2021-02-19 04:50:28,628 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3588.300000 2021-02-19 04:50:28,779 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8407.300000 2021-02-19 04:50:28,842 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1899.300000 2021-02-19 04:50:28,878 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4039.500000 2021-02-19 04:50:28,888 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:29,286 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4211.900000 2021-02-19 04:50:29,538 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4106.900000 2021-02-19 04:50:29,628 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:29,983 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5934.000000 2021-02-19 04:50:30,125 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4746.800000 2021-02-19 04:50:30,285 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3564.000000 2021-02-19 04:50:30,453 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8329.800000 2021-02-19 04:50:30,509 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1576.500000 2021-02-19 04:50:30,568 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4128.800000 2021-02-19 04:50:30,572 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:30,944 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4808.100000 2021-02-19 04:50:31,164 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4064.100000 2021-02-19 04:50:31,250 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:31,614 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5934.000000 2021-02-19 04:50:31,756 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4746.800000 2021-02-19 04:50:31,859 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 90.00 % 2021-02-19 04:50:31,861 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 90.0 2021-02-19 04:50:31,924 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3564.000000 2021-02-19 04:50:32,105 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8329.800000 2021-02-19 04:50:32,164 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1576.500000 2021-02-19 04:50:32,233 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:32,273 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4128.800000 2021-02-19 04:50:32,576 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5691.900000 2021-02-19 04:50:32,782 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4068.000000 2021-02-19 04:50:32,881 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:33,262 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5698.400000 2021-02-19 04:50:33,408 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4582.600000 2021-02-19 04:50:33,545 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3484.400000 2021-02-19 04:50:33,812 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8028.700000 2021-02-19 04:50:33,865 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1505.100000 2021-02-19 04:50:33,913 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:33,926 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4089.500000 2021-02-19 04:50:34,210 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6744.300000 2021-02-19 04:50:34,421 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4023.200000 2021-02-19 04:50:34,502 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:34,887 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5698.400000 2021-02-19 04:50:35,052 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4351.900000 2021-02-19 04:50:35,183 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3349.300000 2021-02-19 04:50:35,456 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7539.300000 2021-02-19 04:50:35,526 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2000.900000 2021-02-19 04:50:35,588 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:35,594 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3965.200000 2021-02-19 04:50:35,851 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6744.300000 2021-02-19 04:50:36,069 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4023.200000 2021-02-19 04:50:36,134 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:36,513 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5200.000000 2021-02-19 04:50:36,736 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4351.900000 2021-02-19 04:50:36,821 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3349.300000 2021-02-19 04:50:36,923 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 90.00 % 2021-02-19 04:50:36,923 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 90.0 2021-02-19 04:50:37,117 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7539.300000 2021-02-19 04:50:37,187 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1975.200000 2021-02-19 04:50:37,233 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:37,243 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3965.200000 2021-02-19 04:50:37,487 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6744.300000 2021-02-19 04:50:37,694 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4023.200000 2021-02-19 04:50:37,757 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:38,114 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5200.000000 2021-02-19 04:50:38,374 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4351.900000 2021-02-19 04:50:38,467 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3349.300000 2021-02-19 04:50:38,753 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7539.300000 2021-02-19 04:50:38,825 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1975.200000 2021-02-19 04:50:38,854 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:38,861 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3965.200000 2021-02-19 04:50:39,115 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6744.300000 2021-02-19 04:50:39,296 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4023.200000 2021-02-19 04:50:39,372 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:39,726 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5200.000000 2021-02-19 04:50:40,012 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4103.600000 2021-02-19 04:50:40,098 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3132.300000 2021-02-19 04:50:40,385 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7042.000000 2021-02-19 04:50:40,480 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3992.500000 2021-02-19 04:50:40,526 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:40,542 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3789.100000 2021-02-19 04:50:40,759 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7199.200000 2021-02-19 04:50:40,914 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3883.000000 2021-02-19 04:50:40,994 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:41,338 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 5200.000000 2021-02-19 04:50:41,638 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 4103.600000 2021-02-19 04:50:41,770 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 3132.300000 2021-02-19 04:50:41,983 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 90.02 % 2021-02-19 04:50:41,983 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 90.0180689917 2021-02-19 04:50:42,020 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7042.000000 2021-02-19 04:50:42,102 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3992.500000 2021-02-19 04:50:42,167 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:42,180 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3789.100000 2021-02-19 04:50:42,388 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7332.600000 2021-02-19 04:50:42,572 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3731.900000 2021-02-19 04:50:42,615 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:42,691 | infra | INFO | pool-2-thread-20 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.28' completed 2021-02-19 04:50:42,691 | infra | INFO | pool-2-thread-20 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:50:42,691 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 50 docs from 0 to 1000000 2021-02-19 04:50:42,693 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 29 docs from 0 to 1000000 2021-02-19 04:50:42,693 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 21 docs from 0 to 1000000 2021-02-19 04:50:42,693 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 24 docs from 0 to 1000000 2021-02-19 04:50:42,693 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 21 docs from 0 to 1000000 2021-02-19 04:50:42,693 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 25 docs from 0 to 1000000 2021-02-19 04:50:42,694 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 17 docs from 0 to 1000000 2021-02-19 04:50:42,694 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 14 docs from 0 to 1000000 2021-02-19 04:50:42,694 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 24 docs from 0 to 1000000 2021-02-19 04:50:42,694 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 12 docs from 0 to 1000000 2021-02-19 04:50:42,694 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 27 docs from 0 to 1000000 2021-02-19 04:50:42,694 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 44 docs from 0 to 1000000 2021-02-19 04:50:42,694 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 20 docs from 0 to 1000000 2021-02-19 04:50:42,694 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 43 docs from 0 to 1000000 2021-02-19 04:50:42,694 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 9 docs from 0 to 1000000 2021-02-19 04:50:42,694 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 32 docs from 0 to 1000000 2021-02-19 04:50:42,963 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4729.200000 2021-02-19 04:50:43,298 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3923.300000 2021-02-19 04:50:43,401 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2927.500000 2021-02-19 04:50:43,746 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6719.500000 2021-02-19 04:50:43,801 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5735.700000 2021-02-19 04:50:43,839 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:43,859 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3691.000000 2021-02-19 04:50:44,026 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7332.600000 2021-02-19 04:50:44,193 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3660.400000 2021-02-19 04:50:44,237 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:44,572 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4729.200000 2021-02-19 04:50:44,918 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3815.800000 2021-02-19 04:50:45,012 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2780.900000 2021-02-19 04:50:45,375 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6531.500000 2021-02-19 04:50:45,464 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6946.900000 2021-02-19 04:50:45,476 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:45,512 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3640.000000 2021-02-19 04:50:45,663 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7252.300000 2021-02-19 04:50:45,828 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3660.400000 2021-02-19 04:50:45,867 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:46,213 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4268.600000 2021-02-19 04:50:46,532 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3815.800000 2021-02-19 04:50:46,631 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2780.900000 2021-02-19 04:50:47,010 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6531.500000 2021-02-19 04:50:47,022 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 90.24 % 2021-02-19 04:50:47,022 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 90.2442208723 2021-02-19 04:50:47,109 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6946.900000 2021-02-19 04:50:47,157 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:47,210 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3640.000000 2021-02-19 04:50:47,293 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7252.300000 2021-02-19 04:50:47,471 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3660.400000 2021-02-19 04:50:47,499 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:47,845 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4268.600000 2021-02-19 04:50:48,226 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3815.800000 2021-02-19 04:50:48,299 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2780.900000 2021-02-19 04:50:48,667 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6531.500000 2021-02-19 04:50:48,760 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6946.900000 2021-02-19 04:50:48,821 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:50:48,865 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3640.000000 2021-02-19 04:50:48,953 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7252.300000 2021-02-19 04:50:49,098 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3660.400000 2021-02-19 04:50:49,121 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:49,480 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4268.600000 2021-02-19 04:50:49,855 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3813.400000 2021-02-19 04:50:49,927 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2670.900000 2021-02-19 04:50:50,311 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6430.800000 2021-02-19 04:50:50,407 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6901.200000 2021-02-19 04:50:50,509 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 530.600000 2021-02-19 04:50:50,542 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3678.400000 2021-02-19 04:50:50,634 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7175.700000 2021-02-19 04:50:50,747 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3707.100000 2021-02-19 04:50:50,779 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:50,805 | infra | INFO | pool-2-thread-36 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.33' completed 2021-02-19 04:50:50,806 | infra | INFO | pool-2-thread-36 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7_VolumeScope3_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' started 2021-02-19 04:50:50,806 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 41 docs from 0 to 1000000 2021-02-19 04:50:50,806 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 16 docs from 0 to 1000000 2021-02-19 04:50:50,808 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 5 docs from 0 to 1000000 2021-02-19 04:50:50,808 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 10 docs from 0 to 1000000 2021-02-19 04:50:50,808 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 11 docs from 0 to 1000000 2021-02-19 04:50:51,098 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 4268.600000 2021-02-19 04:50:51,492 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3813.400000 2021-02-19 04:50:51,573 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2670.900000 2021-02-19 04:50:51,933 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6430.800000 2021-02-19 04:50:52,069 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 90.48 % 2021-02-19 04:50:52,069 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 90.4791692734 2021-02-19 04:50:52,111 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6901.200000 2021-02-19 04:50:52,138 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 530.600000 2021-02-19 04:50:52,242 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3678.400000 2021-02-19 04:50:52,263 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7175.700000 2021-02-19 04:50:52,417 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:52,433 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3816.900000 2021-02-19 04:50:52,733 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2487.100000 2021-02-19 04:50:53,161 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3871.100000 2021-02-19 04:50:53,236 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2557.500000 2021-02-19 04:50:53,598 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6341.300000 2021-02-19 04:50:53,796 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1341.900000 2021-02-19 04:50:53,822 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6850.700000 2021-02-19 04:50:53,951 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7105.700000 2021-02-19 04:50:53,976 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3750.100000 2021-02-19 04:50:54,095 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:54,119 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3816.900000 2021-02-19 04:50:54,358 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2490.900000 2021-02-19 04:50:54,802 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3903.400000 2021-02-19 04:50:54,884 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2455.000000 2021-02-19 04:50:55,230 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6276.500000 2021-02-19 04:50:55,434 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2400.700000 2021-02-19 04:50:55,539 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6782.900000 2021-02-19 04:50:55,655 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3816.600000 2021-02-19 04:50:55,661 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7022.500000 2021-02-19 04:50:55,782 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:55,805 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4057.300000 2021-02-19 04:50:56,002 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 526.400000 2021-02-19 04:50:56,430 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3903.400000 2021-02-19 04:50:56,473 | infra | INFO | pool-2-thread-61 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.36' completed 2021-02-19 04:50:56,473 | infra | INFO | pool-2-thread-61 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope1_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.43' started 2021-02-19 04:50:56,499 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2455.000000 2021-02-19 04:50:56,846 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6276.500000 2021-02-19 04:50:57,107 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2400.700000 2021-02-19 04:50:57,128 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 90.71 % 2021-02-19 04:50:57,128 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 90.7141176745 2021-02-19 04:50:57,207 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6782.900000 2021-02-19 04:50:57,328 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3816.600000 2021-02-19 04:50:57,361 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7022.500000 2021-02-19 04:50:57,446 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4057.300000 2021-02-19 04:50:57,493 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:57,667 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 526.400000 2021-02-19 04:50:58,068 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3903.400000 2021-02-19 04:50:58,144 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2455.000000 2021-02-19 04:50:58,493 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6276.500000 2021-02-19 04:50:58,766 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2400.700000 2021-02-19 04:50:58,861 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6782.900000 2021-02-19 04:50:59,026 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3816.600000 2021-02-19 04:50:59,048 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 7022.500000 2021-02-19 04:50:59,177 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4057.300000 2021-02-19 04:50:59,196 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:50:59,302 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 526.400000 2021-02-19 04:50:59,706 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3903.400000 2021-02-19 04:50:59,829 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2444.900000 2021-02-19 04:51:00,121 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6147.600000 2021-02-19 04:51:00,392 | infra | INFO | pool-2-thread-41 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.33' completed 2021-02-19 04:51:00,394 | infra | INFO | pool-2-thread-41 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope2_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.43' started 2021-02-19 04:51:00,394 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 42 docs from 0 to 1000000 2021-02-19 04:51:00,394 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 21 docs from 0 to 1000000 2021-02-19 04:51:00,394 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 10 docs from 0 to 1000000 2021-02-19 04:51:00,394 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 11 docs from 0 to 1000000 2021-02-19 04:51:00,394 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 23 docs from 0 to 1000000 2021-02-19 04:51:00,394 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 15 docs from 0 to 1000000 2021-02-19 04:51:00,395 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 12 docs from 0 to 1000000 2021-02-19 04:51:00,395 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 11 docs from 0 to 1000000 2021-02-19 04:51:00,410 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2928.900000 2021-02-19 04:51:00,523 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6688.000000 2021-02-19 04:51:00,700 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6867.700000 2021-02-19 04:51:00,732 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3895.600000 2021-02-19 04:51:00,894 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4690.000000 2021-02-19 04:51:00,940 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:00,970 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 530.000000 2021-02-19 04:51:01,342 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3889.900000 2021-02-19 04:51:01,470 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2444.900000 2021-02-19 04:51:01,773 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6147.600000 2021-02-19 04:51:02,042 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2928.900000 2021-02-19 04:51:02,157 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6688.000000 2021-02-19 04:51:02,171 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 90.96 % 2021-02-19 04:51:02,171 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 90.9612802663 2021-02-19 04:51:02,339 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6662.700000 2021-02-19 04:51:02,375 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4132.600000 2021-02-19 04:51:02,536 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5469.400000 2021-02-19 04:51:02,586 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:02,592 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 422.900000 2021-02-19 04:51:02,665 | infra | INFO | pool-2-thread-38 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope3_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:51:02,665 | infra | INFO | pool-2-thread-38 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.43' started 2021-02-19 04:51:02,973 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3752.100000 2021-02-19 04:51:03,111 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2518.400000 2021-02-19 04:51:03,410 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5967.700000 2021-02-19 04:51:03,700 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3197.300000 2021-02-19 04:51:03,792 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6548.700000 2021-02-19 04:51:03,999 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6662.700000 2021-02-19 04:51:04,048 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4132.600000 2021-02-19 04:51:04,177 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5469.400000 2021-02-19 04:51:04,207 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 455.400000 2021-02-19 04:51:04,230 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:04,641 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3752.100000 2021-02-19 04:51:04,733 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2518.400000 2021-02-19 04:51:05,089 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5708.400000 2021-02-19 04:51:05,348 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3189.100000 2021-02-19 04:51:05,436 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6420.000000 2021-02-19 04:51:05,677 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6440.900000 2021-02-19 04:51:05,703 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4545.100000 2021-02-19 04:51:05,834 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6098.900000 2021-02-19 04:51:05,842 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 785.500000 2021-02-19 04:51:05,888 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:06,290 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3601.600000 2021-02-19 04:51:06,395 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2565.700000 2021-02-19 04:51:06,724 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5708.400000 2021-02-19 04:51:06,980 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3189.100000 2021-02-19 04:51:07,085 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6420.000000 2021-02-19 04:51:07,226 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 91.19 % 2021-02-19 04:51:07,226 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 91.1928109971 2021-02-19 04:51:07,335 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6440.900000 2021-02-19 04:51:07,374 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4545.100000 2021-02-19 04:51:07,496 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 785.500000 2021-02-19 04:51:07,523 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6098.900000 2021-02-19 04:51:07,549 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:07,960 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3601.600000 2021-02-19 04:51:08,049 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2565.700000 2021-02-19 04:51:08,368 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5708.400000 2021-02-19 04:51:08,604 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3189.100000 2021-02-19 04:51:08,739 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6420.000000 2021-02-19 04:51:09,000 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6440.900000 2021-02-19 04:51:09,029 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4545.100000 2021-02-19 04:51:09,108 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 785.500000 2021-02-19 04:51:09,161 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6098.900000 2021-02-19 04:51:09,183 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:09,601 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3601.600000 2021-02-19 04:51:09,667 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2565.700000 2021-02-19 04:51:10,042 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5558.600000 2021-02-19 04:51:10,226 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3175.800000 2021-02-19 04:51:10,374 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6388.500000 2021-02-19 04:51:10,684 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6293.400000 2021-02-19 04:51:10,734 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 798.500000 2021-02-19 04:51:10,752 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5289.900000 2021-02-19 04:51:10,838 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6267.500000 2021-02-19 04:51:10,858 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:11,273 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3427.700000 2021-02-19 04:51:11,315 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2555.000000 2021-02-19 04:51:11,664 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5558.600000 2021-02-19 04:51:11,868 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3175.800000 2021-02-19 04:51:11,999 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6388.500000 2021-02-19 04:51:12,147 | infra | INFO | pool-2-thread-49 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.34' completed 2021-02-19 04:51:12,147 | infra | INFO | pool-2-thread-49 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.43' started 2021-02-19 04:51:12,147 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 47 docs from 0 to 1000000 2021-02-19 04:51:12,147 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 21 docs from 0 to 1000000 2021-02-19 04:51:12,148 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 23 docs from 0 to 1000000 2021-02-19 04:51:12,283 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 91.41 % 2021-02-19 04:51:12,283 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 91.4091972527 2021-02-19 04:51:12,403 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 944.500000 2021-02-19 04:51:12,410 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6249.100000 2021-02-19 04:51:12,428 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5848.700000 2021-02-19 04:51:12,529 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:12,542 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6277.700000 2021-02-19 04:51:12,947 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3325.500000 2021-02-19 04:51:12,948 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2521.500000 2021-02-19 04:51:13,309 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5438.100000 2021-02-19 04:51:13,536 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3142.200000 2021-02-19 04:51:13,668 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6396.100000 2021-02-19 04:51:14,042 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 944.500000 2021-02-19 04:51:14,104 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5848.700000 2021-02-19 04:51:14,104 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6249.100000 2021-02-19 04:51:14,184 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6277.700000 2021-02-19 04:51:14,184 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:14,594 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3325.500000 2021-02-19 04:51:14,611 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2521.500000 2021-02-19 04:51:14,940 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5426.908175 2021-02-19 04:51:15,178 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3118.583810 2021-02-19 04:51:15,303 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6439.006456 2021-02-19 04:51:15,671 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 965.265761 2021-02-19 04:51:15,776 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6245.345373 2021-02-19 04:51:15,805 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6244.446692 2021-02-19 04:51:15,865 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6278.238717 2021-02-19 04:51:15,885 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:16,253 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3232.765940 2021-02-19 04:51:16,276 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2508.795942 2021-02-19 04:51:16,598 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5426.908175 2021-02-19 04:51:16,822 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3118.583810 2021-02-19 04:51:16,966 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6439.006456 2021-02-19 04:51:17,298 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 958.565761 2021-02-19 04:51:17,344 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 91.71 % 2021-02-19 04:51:17,344 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 91.7057097615 2021-02-19 04:51:17,464 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6245.345373 2021-02-19 04:51:17,466 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6244.446692 2021-02-19 04:51:17,536 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6278.238717 2021-02-19 04:51:17,552 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:17,921 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3232.765940 2021-02-19 04:51:17,944 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2508.795942 2021-02-19 04:51:18,237 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5426.908175 2021-02-19 04:51:18,464 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3118.583810 2021-02-19 04:51:18,608 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6439.006456 2021-02-19 04:51:18,926 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 958.565761 2021-02-19 04:51:19,223 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6278.238717 2021-02-19 04:51:19,230 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6245.345373 2021-02-19 04:51:19,237 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:19,247 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6244.446692 2021-02-19 04:51:19,552 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3232.765940 2021-02-19 04:51:19,572 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2508.795942 2021-02-19 04:51:19,904 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5378.408175 2021-02-19 04:51:20,092 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3027.783810 2021-02-19 04:51:20,253 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6340.706456 2021-02-19 04:51:20,542 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 960.165761 2021-02-19 04:51:20,885 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6209.938717 2021-02-19 04:51:20,930 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6151.446692 2021-02-19 04:51:20,941 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6198.645373 2021-02-19 04:51:20,947 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:21,214 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3155.165940 2021-02-19 04:51:21,239 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2534.495942 2021-02-19 04:51:21,562 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5378.408175 2021-02-19 04:51:21,752 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3027.783810 2021-02-19 04:51:21,884 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6340.706456 2021-02-19 04:51:22,187 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 960.165761 2021-02-19 04:51:22,398 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 91.95 % 2021-02-19 04:51:22,398 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 91.9509169414 2021-02-19 04:51:22,549 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5999.038717 2021-02-19 04:51:22,608 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:22,621 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 6081.645373 2021-02-19 04:51:22,625 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5932.946692 2021-02-19 04:51:22,930 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3082.965940 2021-02-19 04:51:22,953 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2536.095942 2021-02-19 04:51:23,236 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5287.708175 2021-02-19 04:51:23,410 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2900.983810 2021-02-19 04:51:23,522 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6166.006456 2021-02-19 04:51:23,841 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 835.465761 2021-02-19 04:51:24,226 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5999.038717 2021-02-19 04:51:24,236 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:24,289 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5946.573584 2021-02-19 04:51:24,355 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5683.303522 2021-02-19 04:51:24,582 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3082.965940 2021-02-19 04:51:24,607 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2536.095942 2021-02-19 04:51:24,895 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5147.607765 2021-02-19 04:51:25,029 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2784.046028 2021-02-19 04:51:25,160 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5968.575085 2021-02-19 04:51:25,476 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 809.446108 2021-02-19 04:51:25,891 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:25,898 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5748.210786 2021-02-19 04:51:25,948 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5946.573584 2021-02-19 04:51:26,046 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5683.303522 2021-02-19 04:51:26,217 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3070.726716 2021-02-19 04:51:26,263 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2538.805683 2021-02-19 04:51:26,556 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5147.607765 2021-02-19 04:51:26,664 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2784.046028 2021-02-19 04:51:26,805 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5968.575085 2021-02-19 04:51:27,092 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 809.446108 2021-02-19 04:51:27,463 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 92.23 % 2021-02-19 04:51:27,463 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 92.2308112816 2021-02-19 04:51:27,553 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:27,556 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5748.210786 2021-02-19 04:51:27,608 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5946.573584 2021-02-19 04:51:27,697 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5683.303522 2021-02-19 04:51:27,881 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3070.726716 2021-02-19 04:51:27,901 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2538.805683 2021-02-19 04:51:28,200 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5147.607765 2021-02-19 04:51:28,323 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2784.046028 2021-02-19 04:51:28,460 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5968.575085 2021-02-19 04:51:28,701 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 809.446108 2021-02-19 04:51:29,233 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:29,262 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5748.210786 2021-02-19 04:51:29,275 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5946.573584 2021-02-19 04:51:29,357 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5683.303522 2021-02-19 04:51:29,526 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3070.726716 2021-02-19 04:51:29,555 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2538.805683 2021-02-19 04:51:29,822 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5041.107765 2021-02-19 04:51:30,005 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2769.646028 2021-02-19 04:51:30,076 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5944.675085 2021-02-19 04:51:30,328 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 827.046108 2021-02-19 04:51:30,934 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5937.273584 2021-02-19 04:51:30,951 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:30,970 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5618.910786 2021-02-19 04:51:31,079 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5602.403522 2021-02-19 04:51:31,223 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2508.605683 2021-02-19 04:51:31,250 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3072.926716 2021-02-19 04:51:31,493 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5041.107765 2021-02-19 04:51:31,650 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2769.646028 2021-02-19 04:51:31,727 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5944.675085 2021-02-19 04:51:31,953 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 827.046108 2021-02-19 04:51:32,529 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 92.40 % 2021-02-19 04:51:32,529 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 92.3993385167 2021-02-19 04:51:32,594 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5941.778463 2021-02-19 04:51:32,638 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:32,648 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5573.639961 2021-02-19 04:51:32,723 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5579.032056 2021-02-19 04:51:32,894 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3075.624057 2021-02-19 04:51:32,901 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2485.841796 2021-02-19 04:51:33,167 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5032.668353 2021-02-19 04:51:33,292 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2784.659165 2021-02-19 04:51:33,369 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5961.575585 2021-02-19 04:51:33,584 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 935.750067 2021-02-19 04:51:34,232 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5961.904879 2021-02-19 04:51:34,270 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:34,302 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5550.529174 2021-02-19 04:51:34,371 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5618.528534 2021-02-19 04:51:34,608 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2485.841796 2021-02-19 04:51:34,615 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3075.624057 2021-02-19 04:51:34,831 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5058.860588 2021-02-19 04:51:34,959 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2817.113137 2021-02-19 04:51:35,013 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6022.100500 2021-02-19 04:51:35,230 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 965.503959 2021-02-19 04:51:35,983 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:35,993 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5961.904879 2021-02-19 04:51:36,019 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5550.529174 2021-02-19 04:51:36,052 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5618.528534 2021-02-19 04:51:36,299 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2440.336113 2021-02-19 04:51:36,302 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3024.097341 2021-02-19 04:51:36,486 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5058.860588 2021-02-19 04:51:36,601 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2817.113137 2021-02-19 04:51:36,640 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6022.100500 2021-02-19 04:51:36,864 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 992.003959 2021-02-19 04:51:37,602 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 92.76 % 2021-02-19 04:51:37,604 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 92.7642905472 2021-02-19 04:51:37,693 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:37,742 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5550.529174 2021-02-19 04:51:37,759 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5961.904879 2021-02-19 04:51:37,769 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5618.528534 2021-02-19 04:51:37,950 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2440.336113 2021-02-19 04:51:37,986 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3024.097341 2021-02-19 04:51:38,154 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5058.860588 2021-02-19 04:51:38,255 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2817.113137 2021-02-19 04:51:38,285 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6022.100500 2021-02-19 04:51:38,532 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 992.003959 2021-02-19 04:51:39,391 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5550.529174 2021-02-19 04:51:39,421 | infra | INFO | pool-2-thread-52 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers1_VolumeScope1_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.35' completed 2021-02-19 04:51:39,421 | infra | INFO | pool-2-thread-52 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope0_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.43' started 2021-02-19 04:51:39,421 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 37 docs from 0 to 1000000 2021-02-19 04:51:39,423 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 19 docs from 0 to 1000000 2021-02-19 04:51:39,423 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 20 docs from 0 to 1000000 2021-02-19 04:51:39,423 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 5 docs from 0 to 1000000 2021-02-19 04:51:39,424 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 25 docs from 0 to 1000000 2021-02-19 04:51:39,424 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 11 docs from 0 to 1000000 2021-02-19 04:51:39,424 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 39 docs from 0 to 1000000 2021-02-19 04:51:39,424 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 11 docs from 0 to 1000000 2021-02-19 04:51:39,424 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 27 docs from 0 to 1000000 2021-02-19 04:51:39,424 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 43 docs from 0 to 1000000 2021-02-19 04:51:39,424 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 38 docs from 0 to 1000000 2021-02-19 04:51:39,424 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 12 docs from 0 to 1000000 2021-02-19 04:51:39,424 | test | ERROR | pool-2-thread-1 | [task:call:3768] Failed to load 10 docs from 0 to 1000000 2021-02-19 04:51:39,433 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:39,440 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5961.904879 2021-02-19 04:51:39,470 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5604.928534 2021-02-19 04:51:39,611 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2440.336113 2021-02-19 04:51:39,635 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3024.097341 2021-02-19 04:51:39,802 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5144.560588 2021-02-19 04:51:39,953 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2649.613137 2021-02-19 04:51:39,984 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6011.000500 2021-02-19 04:51:40,200 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1003.303959 2021-02-19 04:51:41,086 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5375.129174 2021-02-19 04:51:41,108 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5911.304879 2021-02-19 04:51:41,154 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:41,167 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5604.928534 2021-02-19 04:51:41,275 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2480.436113 2021-02-19 04:51:41,328 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3019.597341 2021-02-19 04:51:41,441 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5144.560588 2021-02-19 04:51:41,628 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2649.613137 2021-02-19 04:51:41,660 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6011.000500 2021-02-19 04:51:41,892 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1003.303959 2021-02-19 04:51:42,674 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 93.02 % 2021-02-19 04:51:42,674 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 93.018833142 2021-02-19 04:51:42,769 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5175.030806 2021-02-19 04:51:42,802 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5941.001060 2021-02-19 04:51:42,838 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:42,872 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5690.588598 2021-02-19 04:51:42,940 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2538.175435 2021-02-19 04:51:43,006 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3042.807301 2021-02-19 04:51:43,088 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5183.147129 2021-02-19 04:51:43,292 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2424.941928 2021-02-19 04:51:43,309 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6027.402781 2021-02-19 04:51:43,565 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 853.866153 2021-02-19 04:51:44,430 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4999.030806 2021-02-19 04:51:44,463 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5897.601060 2021-02-19 04:51:44,497 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:44,526 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5758.488598 2021-02-19 04:51:44,601 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2538.175435 2021-02-19 04:51:44,711 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3042.807301 2021-02-19 04:51:44,766 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5183.147129 2021-02-19 04:51:44,934 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2201.341928 2021-02-19 04:51:45,006 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6009.102781 2021-02-19 04:51:45,249 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 873.066153 2021-02-19 04:51:46,109 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4999.030806 2021-02-19 04:51:46,178 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5897.601060 2021-02-19 04:51:46,194 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5758.488598 2021-02-19 04:51:46,194 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:46,240 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2629.175435 2021-02-19 04:51:46,390 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3087.807301 2021-02-19 04:51:46,433 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5184.947129 2021-02-19 04:51:46,565 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2201.341928 2021-02-19 04:51:46,638 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6009.102781 2021-02-19 04:51:46,957 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 826.566153 2021-02-19 04:51:47,740 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 93.35 % 2021-02-19 04:51:47,740 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 93.352481377 2021-02-19 04:51:47,759 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4999.030806 2021-02-19 04:51:47,835 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5897.601060 2021-02-19 04:51:47,869 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:47,888 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5758.488598 2021-02-19 04:51:47,900 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2629.175435 2021-02-19 04:51:48,073 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3087.807301 2021-02-19 04:51:48,102 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5184.947129 2021-02-19 04:51:48,226 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2201.341928 2021-02-19 04:51:48,278 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6009.102781 2021-02-19 04:51:48,631 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 826.566153 2021-02-19 04:51:49,407 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4999.030806 2021-02-19 04:51:49,505 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5676.401060 2021-02-19 04:51:49,522 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:49,555 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5831.488598 2021-02-19 04:51:49,561 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2629.175435 2021-02-19 04:51:49,737 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3087.807301 2021-02-19 04:51:49,769 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5184.947129 2021-02-19 04:51:49,890 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2298.641928 2021-02-19 04:51:49,918 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6021.802781 2021-02-19 04:51:50,253 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 863.466153 2021-02-19 04:51:51,108 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5036.630806 2021-02-19 04:51:51,168 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5676.401060 2021-02-19 04:51:51,184 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:51,211 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2595.275435 2021-02-19 04:51:51,276 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5831.488598 2021-02-19 04:51:51,410 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3081.607301 2021-02-19 04:51:51,430 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5108.047129 2021-02-19 04:51:51,526 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2298.641928 2021-02-19 04:51:51,558 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6021.802781 2021-02-19 04:51:51,874 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 863.466153 2021-02-19 04:51:52,799 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5256.200000 2021-02-19 04:51:52,802 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 93.58 % 2021-02-19 04:51:52,802 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 93.5825212113 2021-02-19 04:51:52,823 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5348.500000 2021-02-19 04:51:52,901 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:52,903 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2514.300000 2021-02-19 04:51:52,976 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5856.400000 2021-02-19 04:51:53,069 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3053.900000 2021-02-19 04:51:53,108 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5060.300000 2021-02-19 04:51:53,191 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2581.100000 2021-02-19 04:51:53,213 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6066.400000 2021-02-19 04:51:53,509 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1202.400000 2021-02-19 04:51:54,466 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5563.600000 2021-02-19 04:51:54,507 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5090.300000 2021-02-19 04:51:54,571 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:54,627 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2514.300000 2021-02-19 04:51:54,665 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5856.400000 2021-02-19 04:51:54,711 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3053.900000 2021-02-19 04:51:54,760 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5060.300000 2021-02-19 04:51:54,874 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2854.600000 2021-02-19 04:51:54,884 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6135.500000 2021-02-19 04:51:55,150 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1353.300000 2021-02-19 04:51:56,135 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5563.600000 2021-02-19 04:51:56,165 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5090.300000 2021-02-19 04:51:56,239 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:56,325 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2432.600000 2021-02-19 04:51:56,391 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5900.100000 2021-02-19 04:51:56,430 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3011.500000 2021-02-19 04:51:56,444 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5072.200000 2021-02-19 04:51:56,535 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6135.500000 2021-02-19 04:51:56,558 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2854.600000 2021-02-19 04:51:56,792 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1474.966520 2021-02-19 04:51:57,785 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5563.600000 2021-02-19 04:51:57,815 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5090.300000 2021-02-19 04:51:57,861 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 93.80 % 2021-02-19 04:51:57,862 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 93.7959314418 2021-02-19 04:51:57,874 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:57,987 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2432.600000 2021-02-19 04:51:58,049 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5900.100000 2021-02-19 04:51:58,128 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5072.200000 2021-02-19 04:51:58,142 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3011.500000 2021-02-19 04:51:58,174 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6135.500000 2021-02-19 04:51:58,203 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2854.600000 2021-02-19 04:51:58,448 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1474.966520 2021-02-19 04:51:59,467 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5924.500000 2021-02-19 04:51:59,509 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5002.300000 2021-02-19 04:51:59,536 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:51:59,641 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2432.600000 2021-02-19 04:51:59,706 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5900.100000 2021-02-19 04:51:59,845 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6252.500000 2021-02-19 04:51:59,854 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5072.200000 2021-02-19 04:51:59,855 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3011.500000 2021-02-19 04:51:59,884 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3022.600000 2021-02-19 04:52:00,095 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1447.366520 2021-02-19 04:52:01,134 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5924.500000 2021-02-19 04:52:01,171 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:01,210 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 5002.300000 2021-02-19 04:52:01,286 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2436.700000 2021-02-19 04:52:01,372 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6044.900000 2021-02-19 04:52:01,526 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3010.900000 2021-02-19 04:52:01,549 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6252.500000 2021-02-19 04:52:01,575 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5201.400000 2021-02-19 04:52:01,622 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3022.600000 2021-02-19 04:52:01,773 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1447.366520 2021-02-19 04:52:02,799 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6084.900000 2021-02-19 04:52:02,812 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:02,897 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4927.200000 2021-02-19 04:52:02,924 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 94.05 % 2021-02-19 04:52:02,924 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 94.0503882226 2021-02-19 04:52:02,953 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2502.500000 2021-02-19 04:52:03,013 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6119.000000 2021-02-19 04:52:03,213 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2993.300000 2021-02-19 04:52:03,217 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6281.900000 2021-02-19 04:52:03,262 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5282.000000 2021-02-19 04:52:03,290 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3036.900000 2021-02-19 04:52:03,421 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1043.466520 2021-02-19 04:52:04,487 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:04,492 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6147.700000 2021-02-19 04:52:04,572 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4856.100000 2021-02-19 04:52:04,664 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2502.500000 2021-02-19 04:52:04,730 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6119.000000 2021-02-19 04:52:04,924 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2975.600000 2021-02-19 04:52:04,928 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6282.000000 2021-02-19 04:52:04,963 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3040.800000 2021-02-19 04:52:04,983 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5286.600000 2021-02-19 04:52:05,078 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 870.066520 2021-02-19 04:52:06,155 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:06,167 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6147.700000 2021-02-19 04:52:06,233 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4856.100000 2021-02-19 04:52:06,355 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2527.800000 2021-02-19 04:52:06,421 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6135.200000 2021-02-19 04:52:06,622 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2975.600000 2021-02-19 04:52:06,653 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6282.000000 2021-02-19 04:52:06,683 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3040.800000 2021-02-19 04:52:06,716 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5286.600000 2021-02-19 04:52:06,743 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 573.677813 2021-02-19 04:52:07,877 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6147.700000 2021-02-19 04:52:07,887 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:07,907 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4856.100000 2021-02-19 04:52:07,983 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 94.23 % 2021-02-19 04:52:07,983 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 94.2296158817 2021-02-19 04:52:08,043 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2527.800000 2021-02-19 04:52:08,086 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6135.200000 2021-02-19 04:52:08,312 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2975.600000 2021-02-19 04:52:08,339 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3040.800000 2021-02-19 04:52:08,351 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6282.000000 2021-02-19 04:52:08,404 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5286.600000 2021-02-19 04:52:08,413 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 573.677813 2021-02-19 04:52:09,563 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6015.800000 2021-02-19 04:52:09,596 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:09,598 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4856.100000 2021-02-19 04:52:09,740 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 6135.200000 2021-02-19 04:52:09,742 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2527.800000 2021-02-19 04:52:09,976 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2943.100000 2021-02-19 04:52:10,053 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6195.500000 2021-02-19 04:52:10,063 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2962.100000 2021-02-19 04:52:10,101 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5145.600000 2021-02-19 04:52:10,115 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 559.077813 2021-02-19 04:52:11,255 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6015.800000 2021-02-19 04:52:11,278 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:11,289 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4841.800000 2021-02-19 04:52:11,411 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2503.700000 2021-02-19 04:52:11,424 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5982.800000 2021-02-19 04:52:11,683 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2943.100000 2021-02-19 04:52:11,785 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5145.600000 2021-02-19 04:52:11,809 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 559.077813 2021-02-19 04:52:11,832 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2962.100000 2021-02-19 04:52:11,868 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6195.500000 2021-02-19 04:52:12,934 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5935.500000 2021-02-19 04:52:12,970 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:13,003 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4877.000000 2021-02-19 04:52:13,058 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 94.54 % 2021-02-19 04:52:13,059 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 94.5412213572 2021-02-19 04:52:13,091 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2445.000000 2021-02-19 04:52:13,095 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5857.200000 2021-02-19 04:52:13,346 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2940.400000 2021-02-19 04:52:13,457 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5036.500000 2021-02-19 04:52:13,486 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 579.977813 2021-02-19 04:52:13,526 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2916.200000 2021-02-19 04:52:13,530 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6120.100000 2021-02-19 04:52:14,608 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5935.500000 2021-02-19 04:52:14,628 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:14,717 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4877.000000 2021-02-19 04:52:14,739 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2445.000000 2021-02-19 04:52:14,752 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5857.200000 2021-02-19 04:52:15,006 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2953.003798 2021-02-19 04:52:15,121 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4967.238065 2021-02-19 04:52:15,150 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 662.703403 2021-02-19 04:52:15,203 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2869.220272 2021-02-19 04:52:15,217 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6014.014474 2021-02-19 04:52:16,273 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5832.032427 2021-02-19 04:52:16,296 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:16,384 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4870.861096 2021-02-19 04:52:16,398 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2435.171172 2021-02-19 04:52:16,427 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5720.652019 2021-02-19 04:52:16,640 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2953.003798 2021-02-19 04:52:16,788 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4967.238065 2021-02-19 04:52:16,832 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 781.025590 2021-02-19 04:52:16,861 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2869.220272 2021-02-19 04:52:16,915 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6014.014474 2021-02-19 04:52:17,928 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5832.032427 2021-02-19 04:52:17,963 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:18,065 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4870.861096 2021-02-19 04:52:18,092 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2435.171172 2021-02-19 04:52:18,124 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5720.652019 2021-02-19 04:52:18,131 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 94.81 % 2021-02-19 04:52:18,131 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 94.8064300705 2021-02-19 04:52:18,298 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2953.003798 2021-02-19 04:52:18,490 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4967.238065 2021-02-19 04:52:18,513 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 781.025590 2021-02-19 04:52:18,535 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2869.220272 2021-02-19 04:52:18,625 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6014.014474 2021-02-19 04:52:19,569 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5832.032427 2021-02-19 04:52:19,592 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:19,753 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2435.171172 2021-02-19 04:52:19,756 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4870.861096 2021-02-19 04:52:19,776 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5720.652019 2021-02-19 04:52:19,924 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2944.603798 2021-02-19 04:52:20,197 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4990.438065 2021-02-19 04:52:20,233 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2587.720272 2021-02-19 04:52:20,255 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 915.325590 2021-02-19 04:52:20,292 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5909.414474 2021-02-19 04:52:21,250 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5770.132427 2021-02-19 04:52:21,267 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:21,486 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2532.571172 2021-02-19 04:52:21,493 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5586.752019 2021-02-19 04:52:21,506 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4791.261096 2021-02-19 04:52:21,578 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2944.603798 2021-02-19 04:52:21,890 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4990.438065 2021-02-19 04:52:21,900 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2587.720272 2021-02-19 04:52:21,961 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 915.325590 2021-02-19 04:52:21,999 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5909.414474 2021-02-19 04:52:22,905 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5716.032427 2021-02-19 04:52:22,913 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:23,188 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2582.871172 2021-02-19 04:52:23,191 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5501.652019 2021-02-19 04:52:23,200 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 95.01 % 2021-02-19 04:52:23,200 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 95.0051661093 2021-02-19 04:52:23,221 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4644.961096 2021-02-19 04:52:23,253 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2871.703798 2021-02-19 04:52:23,562 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2324.220272 2021-02-19 04:52:23,621 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5000.638065 2021-02-19 04:52:23,665 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1426.425590 2021-02-19 04:52:23,674 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5840.814474 2021-02-19 04:52:24,551 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:24,551 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5663.846699 2021-02-19 04:52:24,855 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2582.871172 2021-02-19 04:52:24,888 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5501.652019 2021-02-19 04:52:24,924 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4517.187795 2021-02-19 04:52:24,927 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2749.247219 2021-02-19 04:52:25,282 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2069.877991 2021-02-19 04:52:25,316 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5015.567907 2021-02-19 04:52:25,338 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5848.988796 2021-02-19 04:52:25,381 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1724.093477 2021-02-19 04:52:26,193 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:26,207 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5663.846699 2021-02-19 04:52:26,553 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2576.726371 2021-02-19 04:52:26,575 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5483.840856 2021-02-19 04:52:26,591 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4517.187795 2021-02-19 04:52:26,614 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2749.247219 2021-02-19 04:52:26,948 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2069.877991 2021-02-19 04:52:27,009 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5015.567907 2021-02-19 04:52:27,029 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5848.988796 2021-02-19 04:52:27,061 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1979.593477 2021-02-19 04:52:27,864 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:27,871 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5663.846699 2021-02-19 04:52:28,250 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2576.726371 2021-02-19 04:52:28,273 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 95.20 % 2021-02-19 04:52:28,273 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 95.197101113 2021-02-19 04:52:28,273 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4517.187795 2021-02-19 04:52:28,285 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5483.840856 2021-02-19 04:52:28,322 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2749.247219 2021-02-19 04:52:28,579 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2069.877991 2021-02-19 04:52:28,671 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5848.988796 2021-02-19 04:52:28,703 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5015.567907 2021-02-19 04:52:28,789 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1979.593477 2021-02-19 04:52:29,536 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:29,578 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5666.146699 2021-02-19 04:52:29,888 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2452.826371 2021-02-19 04:52:29,928 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4423.687795 2021-02-19 04:52:29,970 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5586.240856 2021-02-19 04:52:29,996 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2628.947219 2021-02-19 04:52:30,207 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2381.877991 2021-02-19 04:52:30,346 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5902.788796 2021-02-19 04:52:30,392 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4981.367907 2021-02-19 04:52:30,477 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2068.393477 2021-02-19 04:52:31,204 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:31,263 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5666.146699 2021-02-19 04:52:31,569 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2452.826371 2021-02-19 04:52:31,615 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4423.687795 2021-02-19 04:52:31,680 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5586.240856 2021-02-19 04:52:31,681 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2628.947219 2021-02-19 04:52:31,848 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2381.877991 2021-02-19 04:52:32,033 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5902.788796 2021-02-19 04:52:32,062 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4981.367907 2021-02-19 04:52:32,130 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2068.393477 2021-02-19 04:52:32,858 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:32,894 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5655.846699 2021-02-19 04:52:33,242 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2433.026371 2021-02-19 04:52:33,289 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4498.487795 2021-02-19 04:52:33,364 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5654.640856 2021-02-19 04:52:33,394 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 95.50 % 2021-02-19 04:52:33,394 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 95.5028517876 2021-02-19 04:52:33,417 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2607.647219 2021-02-19 04:52:33,513 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2653.477991 2021-02-19 04:52:33,677 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5957.888796 2021-02-19 04:52:33,744 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4954.767907 2021-02-19 04:52:33,816 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2084.793477 2021-02-19 04:52:34,500 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:34,552 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5656.325716 2021-02-19 04:52:34,910 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2488.718249 2021-02-19 04:52:34,963 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4623.489368 2021-02-19 04:52:35,009 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5672.720625 2021-02-19 04:52:35,056 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2662.031866 2021-02-19 04:52:35,190 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2904.192323 2021-02-19 04:52:35,371 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5948.164151 2021-02-19 04:52:35,381 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4912.932515 2021-02-19 04:52:35,469 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2100.251443 2021-02-19 04:52:36,130 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:36,180 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5656.325716 2021-02-19 04:52:36,568 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2488.718249 2021-02-19 04:52:36,628 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4623.489368 2021-02-19 04:52:36,658 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5672.720625 2021-02-19 04:52:36,733 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2662.031866 2021-02-19 04:52:36,841 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2904.192323 2021-02-19 04:52:37,026 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5948.164151 2021-02-19 04:52:37,082 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4912.932515 2021-02-19 04:52:37,167 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2089.451443 2021-02-19 04:52:37,181 | infra | INFO | pool-2-thread-59 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5__default_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:52:37,183 | infra | INFO | pool-2-thread-59 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers9__default_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.43' started 2021-02-19 04:52:37,773 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:37,834 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5656.325716 2021-02-19 04:52:38,265 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2488.718249 2021-02-19 04:52:38,289 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4623.489368 2021-02-19 04:52:38,328 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5672.720625 2021-02-19 04:52:38,421 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2662.031866 2021-02-19 04:52:38,482 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 95.78 % 2021-02-19 04:52:38,482 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 95.7802746917 2021-02-19 04:52:38,496 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2904.192323 2021-02-19 04:52:38,687 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5948.164151 2021-02-19 04:52:38,744 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4912.932515 2021-02-19 04:52:38,822 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2089.451443 2021-02-19 04:52:39,410 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:39,477 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5615.425716 2021-02-19 04:52:39,973 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2572.518249 2021-02-19 04:52:39,976 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4764.989368 2021-02-19 04:52:40,029 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5637.320625 2021-02-19 04:52:40,098 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2750.131866 2021-02-19 04:52:40,154 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2837.092323 2021-02-19 04:52:40,351 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5936.964151 2021-02-19 04:52:40,464 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4885.332515 2021-02-19 04:52:40,470 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2122.451443 2021-02-19 04:52:41,071 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:41,140 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5615.425716 2021-02-19 04:52:41,664 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4764.989368 2021-02-19 04:52:41,720 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2572.518249 2021-02-19 04:52:41,740 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5637.320625 2021-02-19 04:52:41,826 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2750.131866 2021-02-19 04:52:41,841 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2837.092323 2021-02-19 04:52:42,003 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5936.964151 2021-02-19 04:52:42,134 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2122.451443 2021-02-19 04:52:42,140 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4885.332515 2021-02-19 04:52:42,724 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:42,798 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5634.925716 2021-02-19 04:52:43,369 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4786.389368 2021-02-19 04:52:43,387 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2631.518249 2021-02-19 04:52:43,436 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5615.320625 2021-02-19 04:52:43,509 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2783.031866 2021-02-19 04:52:43,569 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2798.092323 2021-02-19 04:52:43,573 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 96.06 % 2021-02-19 04:52:43,573 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 96.0635523967 2021-02-19 04:52:43,657 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5929.664151 2021-02-19 04:52:43,861 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4957.932515 2021-02-19 04:52:43,881 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2057.351443 2021-02-19 04:52:44,384 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:44,454 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5659.716428 2021-02-19 04:52:45,052 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4756.359581 2021-02-19 04:52:45,081 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2653.519153 2021-02-19 04:52:45,125 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5598.550866 2021-02-19 04:52:45,165 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2801.199018 2021-02-19 04:52:45,246 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2765.552359 2021-02-19 04:52:45,334 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5937.849765 2021-02-19 04:52:45,496 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5077.871381 2021-02-19 04:52:45,546 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1953.816198 2021-02-19 04:52:46,043 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:46,144 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5659.716428 2021-02-19 04:52:46,746 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2653.519153 2021-02-19 04:52:46,792 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4756.359581 2021-02-19 04:52:46,818 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5598.550866 2021-02-19 04:52:46,875 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2801.199018 2021-02-19 04:52:46,921 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2765.552359 2021-02-19 04:52:47,003 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5937.849765 2021-02-19 04:52:47,216 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5077.871381 2021-02-19 04:52:47,230 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1953.816198 2021-02-19 04:52:47,706 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:47,801 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5659.716428 2021-02-19 04:52:48,440 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2653.519153 2021-02-19 04:52:48,471 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4756.359581 2021-02-19 04:52:48,503 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5598.550866 2021-02-19 04:52:48,572 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2801.199018 2021-02-19 04:52:48,637 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2765.552359 2021-02-19 04:52:48,663 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 96.38 % 2021-02-19 04:52:48,663 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 96.3756624612 2021-02-19 04:52:48,690 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5937.849765 2021-02-19 04:52:48,865 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5077.871381 2021-02-19 04:52:48,911 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1953.816198 2021-02-19 04:52:49,365 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:49,441 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5559.116428 2021-02-19 04:52:50,167 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2694.919153 2021-02-19 04:52:50,187 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4728.759581 2021-02-19 04:52:50,233 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5565.250866 2021-02-19 04:52:50,276 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2846.899018 2021-02-19 04:52:50,321 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2733.252359 2021-02-19 04:52:50,352 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5894.549765 2021-02-19 04:52:50,563 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5375.971381 2021-02-19 04:52:50,598 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1964.416198 2021-02-19 04:52:51,022 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:51,085 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5559.116428 2021-02-19 04:52:51,845 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2694.919153 2021-02-19 04:52:51,910 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4728.759581 2021-02-19 04:52:51,944 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5565.250866 2021-02-19 04:52:52,007 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2846.899018 2021-02-19 04:52:52,030 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2733.252359 2021-02-19 04:52:52,055 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5894.549765 2021-02-19 04:52:52,239 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5375.971381 2021-02-19 04:52:52,252 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1964.416198 2021-02-19 04:52:52,663 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:52,739 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5185.616428 2021-02-19 04:52:53,555 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2729.019153 2021-02-19 04:52:53,589 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4732.959581 2021-02-19 04:52:53,638 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5478.750866 2021-02-19 04:52:53,704 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2691.452359 2021-02-19 04:52:53,717 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2935.799018 2021-02-19 04:52:53,749 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 96.55 % 2021-02-19 04:52:53,749 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 96.5519884741 2021-02-19 04:52:53,765 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5834.249765 2021-02-19 04:52:53,917 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1957.516198 2021-02-19 04:52:53,936 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5598.671381 2021-02-19 04:52:54,311 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:54,378 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4837.200000 2021-02-19 04:52:55,220 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2755.300000 2021-02-19 04:52:55,266 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4771.200000 2021-02-19 04:52:55,329 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5404.000000 2021-02-19 04:52:55,387 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2675.400000 2021-02-19 04:52:55,421 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2996.400000 2021-02-19 04:52:55,470 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5794.100000 2021-02-19 04:52:55,628 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5801.400000 2021-02-19 04:52:55,638 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2101.400000 2021-02-19 04:52:55,953 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:56,055 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4837.200000 2021-02-19 04:52:56,904 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2755.300000 2021-02-19 04:52:56,938 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4771.200000 2021-02-19 04:52:57,009 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5404.000000 2021-02-19 04:52:57,075 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2675.400000 2021-02-19 04:52:57,135 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2996.400000 2021-02-19 04:52:57,214 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5794.100000 2021-02-19 04:52:57,332 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5801.400000 2021-02-19 04:52:57,365 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2101.400000 2021-02-19 04:52:57,598 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:57,732 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4837.200000 2021-02-19 04:52:58,601 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2755.300000 2021-02-19 04:52:58,622 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4771.200000 2021-02-19 04:52:58,681 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5404.000000 2021-02-19 04:52:58,775 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2675.400000 2021-02-19 04:52:58,812 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2996.400000 2021-02-19 04:52:58,845 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 96.79 % 2021-02-19 04:52:58,845 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 96.7898785947 2021-02-19 04:52:58,934 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5794.100000 2021-02-19 04:52:59,017 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2101.400000 2021-02-19 04:52:59,023 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5801.400000 2021-02-19 04:52:59,229 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:52:59,375 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4837.200000 2021-02-19 04:53:00,255 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2755.500000 2021-02-19 04:53:00,286 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4792.300000 2021-02-19 04:53:00,328 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5298.200000 2021-02-19 04:53:00,440 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2670.000000 2021-02-19 04:53:00,499 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3017.100000 2021-02-19 04:53:00,598 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5758.400000 2021-02-19 04:53:00,711 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2274.200000 2021-02-19 04:53:00,726 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5817.000000 2021-02-19 04:53:00,913 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:01,025 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4677.000000 2021-02-19 04:53:01,930 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2755.500000 2021-02-19 04:53:01,990 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4792.300000 2021-02-19 04:53:02,020 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5298.200000 2021-02-19 04:53:02,140 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2670.000000 2021-02-19 04:53:02,193 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3017.100000 2021-02-19 04:53:02,263 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5758.400000 2021-02-19 04:53:02,371 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5792.300000 2021-02-19 04:53:02,404 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2377.500000 2021-02-19 04:53:02,619 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:02,694 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4911.400000 2021-02-19 04:53:03,595 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2715.900000 2021-02-19 04:53:03,674 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4784.600000 2021-02-19 04:53:03,736 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5244.500000 2021-02-19 04:53:03,799 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2647.300000 2021-02-19 04:53:03,868 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2990.600000 2021-02-19 04:53:03,917 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 96.96 % 2021-02-19 04:53:03,917 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 96.9583543213 2021-02-19 04:53:03,928 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5721.300000 2021-02-19 04:53:04,076 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2377.500000 2021-02-19 04:53:04,079 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5792.300000 2021-02-19 04:53:04,309 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:04,341 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5154.600000 2021-02-19 04:53:05,272 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2675.500000 2021-02-19 04:53:05,391 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4751.100000 2021-02-19 04:53:05,426 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5229.600000 2021-02-19 04:53:05,496 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2623.400000 2021-02-19 04:53:05,549 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2986.400000 2021-02-19 04:53:05,585 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5709.500000 2021-02-19 04:53:05,737 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5749.700000 2021-02-19 04:53:05,760 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2466.200000 2021-02-19 04:53:05,959 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:05,992 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5154.600000 2021-02-19 04:53:06,930 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2675.500000 2021-02-19 04:53:07,105 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5229.600000 2021-02-19 04:53:07,131 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4751.100000 2021-02-19 04:53:07,177 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2623.400000 2021-02-19 04:53:07,259 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2986.400000 2021-02-19 04:53:07,276 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5709.500000 2021-02-19 04:53:07,427 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5749.700000 2021-02-19 04:53:07,463 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2450.500000 2021-02-19 04:53:07,642 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:07,676 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5154.600000 2021-02-19 04:53:08,604 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2675.500000 2021-02-19 04:53:08,828 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4751.100000 2021-02-19 04:53:08,849 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5229.600000 2021-02-19 04:53:08,857 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2623.400000 2021-02-19 04:53:08,937 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2986.400000 2021-02-19 04:53:09,003 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5709.500000 2021-02-19 04:53:09,013 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 97.15 % 2021-02-19 04:53:09,013 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 97.1454036285 2021-02-19 04:53:09,148 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2450.500000 2021-02-19 04:53:09,161 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5749.700000 2021-02-19 04:53:09,276 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:09,332 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5154.600000 2021-02-19 04:53:09,450 | infra | INFO | pool-2-thread-60 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope0_VolumeCollection1_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:53:09,450 | infra | INFO | pool-2-thread-60 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers7__default_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.43' started 2021-02-19 04:53:10,279 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2644.200000 2021-02-19 04:53:10,493 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4753.700000 2021-02-19 04:53:10,503 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5385.600000 2021-02-19 04:53:10,565 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2654.600000 2021-02-19 04:53:10,612 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2978.600000 2021-02-19 04:53:10,697 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5821.000000 2021-02-19 04:53:10,822 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5833.600000 2021-02-19 04:53:10,868 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2475.700000 2021-02-19 04:53:10,956 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:10,980 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5474.100000 2021-02-19 04:53:11,946 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2644.200000 2021-02-19 04:53:12,167 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4753.700000 2021-02-19 04:53:12,233 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5385.600000 2021-02-19 04:53:12,316 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2654.600000 2021-02-19 04:53:12,358 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2978.600000 2021-02-19 04:53:12,384 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5920.300000 2021-02-19 04:53:12,483 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5941.900000 2021-02-19 04:53:12,530 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2455.200000 2021-02-19 04:53:12,601 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:12,680 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5649.600000 2021-02-19 04:53:13,609 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2650.900000 2021-02-19 04:53:13,872 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4787.700000 2021-02-19 04:53:13,881 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5525.500000 2021-02-19 04:53:14,020 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2706.100000 2021-02-19 04:53:14,069 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5920.300000 2021-02-19 04:53:14,075 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3009.900000 2021-02-19 04:53:14,088 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 97.35 % 2021-02-19 04:53:14,088 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 97.3505219274 2021-02-19 04:53:14,197 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2455.200000 2021-02-19 04:53:14,226 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5941.900000 2021-02-19 04:53:14,266 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:14,362 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5789.600000 2021-02-19 04:53:15,276 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2672.200000 2021-02-19 04:53:15,575 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5591.600000 2021-02-19 04:53:15,621 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4825.900000 2021-02-19 04:53:15,690 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2720.900000 2021-02-19 04:53:15,755 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5906.000000 2021-02-19 04:53:15,786 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3020.600000 2021-02-19 04:53:15,894 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2488.900000 2021-02-19 04:53:15,940 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6039.000000 2021-02-19 04:53:15,967 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:16,006 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5789.600000 2021-02-19 04:53:16,921 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2672.200000 2021-02-19 04:53:17,213 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5591.600000 2021-02-19 04:53:17,279 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4825.900000 2021-02-19 04:53:17,362 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2720.900000 2021-02-19 04:53:17,436 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5906.000000 2021-02-19 04:53:17,453 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3020.600000 2021-02-19 04:53:17,549 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2467.100000 2021-02-19 04:53:17,621 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6039.000000 2021-02-19 04:53:17,625 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:17,676 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5789.600000 2021-02-19 04:53:18,572 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2672.200000 2021-02-19 04:53:18,888 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5591.600000 2021-02-19 04:53:18,966 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4825.900000 2021-02-19 04:53:19,042 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2720.900000 2021-02-19 04:53:19,125 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5906.000000 2021-02-19 04:53:19,138 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3020.600000 2021-02-19 04:53:19,161 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 97.50 % 2021-02-19 04:53:19,161 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 97.5009286623 2021-02-19 04:53:19,250 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2467.100000 2021-02-19 04:53:19,316 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6039.000000 2021-02-19 04:53:19,342 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:19,361 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5789.600000 2021-02-19 04:53:20,203 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2708.300000 2021-02-19 04:53:20,538 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5445.500000 2021-02-19 04:53:20,677 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4778.000000 2021-02-19 04:53:20,753 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2641.200000 2021-02-19 04:53:20,818 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5667.000000 2021-02-19 04:53:20,828 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3043.600000 2021-02-19 04:53:20,956 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2470.200000 2021-02-19 04:53:20,992 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5954.900000 2021-02-19 04:53:21,000 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:21,029 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5764.200000 2021-02-19 04:53:21,858 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2708.300000 2021-02-19 04:53:22,201 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5445.500000 2021-02-19 04:53:22,354 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4722.900000 2021-02-19 04:53:22,487 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2587.700000 2021-02-19 04:53:22,520 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3014.000000 2021-02-19 04:53:22,532 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5480.200000 2021-02-19 04:53:22,621 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2459.300000 2021-02-19 04:53:22,664 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5907.600000 2021-02-19 04:53:22,684 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:22,711 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5774.700000 2021-02-19 04:53:23,499 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2701.100000 2021-02-19 04:53:23,858 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5382.000000 2021-02-19 04:53:24,036 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4722.900000 2021-02-19 04:53:24,157 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2587.700000 2021-02-19 04:53:24,191 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5480.200000 2021-02-19 04:53:24,213 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 97.69 % 2021-02-19 04:53:24,213 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 97.6933281815 2021-02-19 04:53:24,246 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3003.900000 2021-02-19 04:53:24,312 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2453.600000 2021-02-19 04:53:24,342 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:24,368 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5886.300000 2021-02-19 04:53:24,381 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5833.400000 2021-02-19 04:53:25,147 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2678.600000 2021-02-19 04:53:25,512 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5397.800000 2021-02-19 04:53:25,704 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4678.600000 2021-02-19 04:53:25,874 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2585.600000 2021-02-19 04:53:25,898 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5422.800000 2021-02-19 04:53:25,911 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3003.900000 2021-02-19 04:53:26,065 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5886.300000 2021-02-19 04:53:26,076 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2375.300000 2021-02-19 04:53:26,088 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:26,121 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5833.400000 2021-02-19 04:53:26,799 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2678.600000 2021-02-19 04:53:27,190 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5397.800000 2021-02-19 04:53:27,361 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4678.600000 2021-02-19 04:53:27,588 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2585.600000 2021-02-19 04:53:27,601 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5422.800000 2021-02-19 04:53:27,641 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3003.900000 2021-02-19 04:53:27,785 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5886.300000 2021-02-19 04:53:27,803 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2375.300000 2021-02-19 04:53:27,806 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:27,875 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5833.400000 2021-02-19 04:53:28,430 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2678.600000 2021-02-19 04:53:28,868 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5397.800000 2021-02-19 04:53:29,020 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4678.600000 2021-02-19 04:53:29,270 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 97.87 % 2021-02-19 04:53:29,272 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 97.8740180989 2021-02-19 04:53:29,309 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5422.800000 2021-02-19 04:53:29,365 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2585.600000 2021-02-19 04:53:29,381 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3003.900000 2021-02-19 04:53:29,483 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5931.200000 2021-02-19 04:53:29,517 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2394.600000 2021-02-19 04:53:29,545 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:29,552 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5911.200000 2021-02-19 04:53:30,108 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2616.400000 2021-02-19 04:53:30,552 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5466.700000 2021-02-19 04:53:30,681 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4681.200000 2021-02-19 04:53:31,051 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5481.500000 2021-02-19 04:53:31,088 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2974.300000 2021-02-19 04:53:31,105 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2659.500000 2021-02-19 04:53:31,171 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5931.200000 2021-02-19 04:53:31,240 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:31,282 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2394.600000 2021-02-19 04:53:31,285 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5911.200000 2021-02-19 04:53:31,776 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2616.400000 2021-02-19 04:53:32,197 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5466.700000 2021-02-19 04:53:32,326 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4662.600000 2021-02-19 04:53:32,736 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5438.300000 2021-02-19 04:53:32,808 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2999.600000 2021-02-19 04:53:32,828 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2682.200000 2021-02-19 04:53:32,878 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5871.600000 2021-02-19 04:53:33,006 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2333.600000 2021-02-19 04:53:33,012 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5898.900000 2021-02-19 04:53:33,023 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:33,413 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2634.300000 2021-02-19 04:53:33,842 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5401.700000 2021-02-19 04:53:33,990 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4662.600000 2021-02-19 04:53:34,371 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 98.03 % 2021-02-19 04:53:34,371 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 98.0302796346 2021-02-19 04:53:34,453 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5343.874288 2021-02-19 04:53:34,483 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3022.793762 2021-02-19 04:53:34,533 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2669.538029 2021-02-19 04:53:34,584 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5798.526782 2021-02-19 04:53:34,671 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5898.900000 2021-02-19 04:53:34,721 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:34,742 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2333.600000 2021-02-19 04:53:35,088 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2662.927922 2021-02-19 04:53:35,471 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5281.482355 2021-02-19 04:53:35,644 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4643.436819 2021-02-19 04:53:36,141 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5343.874288 2021-02-19 04:53:36,157 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3022.793762 2021-02-19 04:53:36,250 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5798.526782 2021-02-19 04:53:36,276 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2669.538029 2021-02-19 04:53:36,355 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5839.222253 2021-02-19 04:53:36,381 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:36,414 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2288.689433 2021-02-19 04:53:36,766 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2662.927922 2021-02-19 04:53:37,168 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5281.482355 2021-02-19 04:53:37,269 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4643.436819 2021-02-19 04:53:37,828 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3022.793762 2021-02-19 04:53:37,834 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5343.874288 2021-02-19 04:53:37,907 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5798.526782 2021-02-19 04:53:37,956 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2669.538029 2021-02-19 04:53:38,036 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5839.222253 2021-02-19 04:53:38,076 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:38,098 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2288.689433 2021-02-19 04:53:38,385 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2662.927922 2021-02-19 04:53:38,852 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5281.482355 2021-02-19 04:53:38,930 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4643.436819 2021-02-19 04:53:39,436 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 98.16 % 2021-02-19 04:53:39,436 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 98.1572671657 2021-02-19 04:53:39,506 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3064.293762 2021-02-19 04:53:39,520 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5270.174288 2021-02-19 04:53:39,582 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5736.626782 2021-02-19 04:53:39,630 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2623.138029 2021-02-19 04:53:39,703 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5839.222253 2021-02-19 04:53:39,757 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2288.689433 2021-02-19 04:53:39,779 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:40,029 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2727.427922 2021-02-19 04:53:40,496 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5251.782355 2021-02-19 04:53:40,585 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4634.036819 2021-02-19 04:53:41,198 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5270.174288 2021-02-19 04:53:41,240 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3064.293762 2021-02-19 04:53:41,244 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5736.626782 2021-02-19 04:53:41,299 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2623.138029 2021-02-19 04:53:41,385 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5821.022253 2021-02-19 04:53:41,451 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2329.889433 2021-02-19 04:53:41,473 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:41,671 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2727.427922 2021-02-19 04:53:42,196 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5251.782355 2021-02-19 04:53:42,260 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4634.036819 2021-02-19 04:53:42,842 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5343.274288 2021-02-19 04:53:42,938 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5794.226782 2021-02-19 04:53:42,973 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3066.293762 2021-02-19 04:53:43,023 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2660.638029 2021-02-19 04:53:43,131 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5858.322253 2021-02-19 04:53:43,173 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:43,187 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2494.789433 2021-02-19 04:53:43,325 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2740.027922 2021-02-19 04:53:43,848 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5339.982355 2021-02-19 04:53:43,901 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4656.836819 2021-02-19 04:53:44,517 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5422.167493 2021-02-19 04:53:44,526 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 98.27 % 2021-02-19 04:53:44,528 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 98.266185705 2021-02-19 04:53:44,624 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5857.410436 2021-02-19 04:53:44,660 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3050.697921 2021-02-19 04:53:44,716 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2660.638029 2021-02-19 04:53:44,818 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5858.322253 2021-02-19 04:53:44,878 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2494.789433 2021-02-19 04:53:44,894 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:44,992 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2748.933667 2021-02-19 04:53:45,519 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5470.357657 2021-02-19 04:53:45,556 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4686.270652 2021-02-19 04:53:46,174 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5422.167493 2021-02-19 04:53:46,275 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5857.410436 2021-02-19 04:53:46,361 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3050.697921 2021-02-19 04:53:46,404 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2723.725470 2021-02-19 04:53:46,464 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5910.708717 2021-02-19 04:53:46,539 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2689.044222 2021-02-19 04:53:46,565 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:46,674 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2748.933667 2021-02-19 04:53:47,151 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5470.357657 2021-02-19 04:53:47,219 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4686.270652 2021-02-19 04:53:47,851 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5422.167493 2021-02-19 04:53:47,983 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5857.410436 2021-02-19 04:53:48,040 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3050.697921 2021-02-19 04:53:48,055 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2723.725470 2021-02-19 04:53:48,138 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5910.708717 2021-02-19 04:53:48,239 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2689.044222 2021-02-19 04:53:48,242 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:48,325 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2748.933667 2021-02-19 04:53:48,812 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5470.357657 2021-02-19 04:53:48,898 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4686.270652 2021-02-19 04:53:49,493 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5473.467493 2021-02-19 04:53:49,615 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 98.41 % 2021-02-19 04:53:49,615 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 98.4107376389 2021-02-19 04:53:49,687 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5930.210436 2021-02-19 04:53:49,698 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3050.697921 2021-02-19 04:53:49,733 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2723.725470 2021-02-19 04:53:49,796 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5910.708717 2021-02-19 04:53:49,936 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:49,940 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2689.044222 2021-02-19 04:53:50,013 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2744.833667 2021-02-19 04:53:50,467 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5500.757657 2021-02-19 04:53:50,551 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4721.870652 2021-02-19 04:53:51,180 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5473.467493 2021-02-19 04:53:51,380 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 3013.397921 2021-02-19 04:53:51,407 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5930.210436 2021-02-19 04:53:51,424 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2769.825470 2021-02-19 04:53:51,464 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5903.308717 2021-02-19 04:53:51,615 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:51,621 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2799.644222 2021-02-19 04:53:51,667 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2744.833667 2021-02-19 04:53:52,098 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5500.757657 2021-02-19 04:53:52,197 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4721.870652 2021-02-19 04:53:52,832 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5379.267493 2021-02-19 04:53:53,079 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2992.197921 2021-02-19 04:53:53,101 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5907.010436 2021-02-19 04:53:53,119 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2721.925470 2021-02-19 04:53:53,200 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5842.308717 2021-02-19 04:53:53,328 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:53,338 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2757.944222 2021-02-19 04:53:53,372 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2740.533667 2021-02-19 04:53:53,766 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5415.357657 2021-02-19 04:53:53,842 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4732.670652 2021-02-19 04:53:54,325 | infra | INFO | pool-2-thread-37 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers5__default_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:53:54,325 | infra | INFO | pool-2-thread-37 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope0_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.43' started 2021-02-19 04:53:54,466 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5304.329431 2021-02-19 04:53:54,690 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 98.60 % 2021-02-19 04:53:54,690 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 98.5972823572 2021-02-19 04:53:54,822 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2721.925470 2021-02-19 04:53:54,832 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5907.010436 2021-02-19 04:53:54,877 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2992.197921 2021-02-19 04:53:54,885 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5842.308717 2021-02-19 04:53:54,984 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:54,993 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2680.668518 2021-02-19 04:53:55,028 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2721.928060 2021-02-19 04:53:55,415 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5297.916892 2021-02-19 04:53:55,502 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4715.489333 2021-02-19 04:53:56,114 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5304.329431 2021-02-19 04:53:56,480 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2660.312299 2021-02-19 04:53:56,549 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5885.967007 2021-02-19 04:53:56,562 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5778.339968 2021-02-19 04:53:56,585 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2987.400280 2021-02-19 04:53:56,670 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:56,677 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2610.668518 2021-02-19 04:53:56,684 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2721.928060 2021-02-19 04:53:57,069 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5297.916892 2021-02-19 04:53:57,177 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4715.489333 2021-02-19 04:53:57,809 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5304.329431 2021-02-19 04:53:58,171 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2660.312299 2021-02-19 04:53:58,303 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5778.339968 2021-02-19 04:53:58,316 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5885.967007 2021-02-19 04:53:58,339 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2987.400280 2021-02-19 04:53:58,382 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2721.928060 2021-02-19 04:53:58,391 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2610.668518 2021-02-19 04:53:58,434 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:53:58,726 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5297.916892 2021-02-19 04:53:58,858 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4715.489333 2021-02-19 04:53:59,469 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5395.829431 2021-02-19 04:53:59,763 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 98.75 % 2021-02-19 04:53:59,765 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 98.7471845031 2021-02-19 04:53:59,836 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2660.312299 2021-02-19 04:53:59,977 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5855.639968 2021-02-19 04:53:59,994 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5926.967007 2021-02-19 04:54:00,072 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2673.628060 2021-02-19 04:54:00,088 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2977.100280 2021-02-19 04:54:00,107 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2429.468518 2021-02-19 04:54:00,121 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:00,364 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5351.216892 2021-02-19 04:54:00,513 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4736.189333 2021-02-19 04:54:01,102 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5395.829431 2021-02-19 04:54:01,503 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3036.212299 2021-02-19 04:54:01,676 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5926.967007 2021-02-19 04:54:01,714 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5855.639968 2021-02-19 04:54:01,756 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2977.100280 2021-02-19 04:54:01,799 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2429.468518 2021-02-19 04:54:01,805 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2673.628060 2021-02-19 04:54:01,825 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:02,038 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5351.216892 2021-02-19 04:54:02,164 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4736.189333 2021-02-19 04:54:02,756 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5615.629431 2021-02-19 04:54:03,141 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3761.512299 2021-02-19 04:54:03,335 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6015.867007 2021-02-19 04:54:03,388 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6020.039968 2021-02-19 04:54:03,451 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2947.300280 2021-02-19 04:54:03,517 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2615.628060 2021-02-19 04:54:03,519 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2216.568518 2021-02-19 04:54:03,553 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:03,743 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5521.816892 2021-02-19 04:54:03,839 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4769.389333 2021-02-19 04:54:04,430 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5831.000000 2021-02-19 04:54:04,825 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3761.512299 2021-02-19 04:54:04,861 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 98.93 % 2021-02-19 04:54:04,861 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 98.9278744205 2021-02-19 04:54:05,002 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6071.700000 2021-02-19 04:54:05,073 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6205.400000 2021-02-19 04:54:05,141 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2904.200000 2021-02-19 04:54:05,203 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2561.000000 2021-02-19 04:54:05,246 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2071.000000 2021-02-19 04:54:05,253 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:05,428 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5730.200000 2021-02-19 04:54:05,506 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4837.700000 2021-02-19 04:54:06,072 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5831.000000 2021-02-19 04:54:06,526 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4700.700000 2021-02-19 04:54:06,723 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6205.400000 2021-02-19 04:54:06,726 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6071.700000 2021-02-19 04:54:06,861 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2904.200000 2021-02-19 04:54:06,887 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2561.000000 2021-02-19 04:54:06,921 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1992.300000 2021-02-19 04:54:06,930 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:07,105 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5730.200000 2021-02-19 04:54:07,148 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4837.700000 2021-02-19 04:54:07,713 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5831.000000 2021-02-19 04:54:08,180 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4700.700000 2021-02-19 04:54:08,395 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6205.400000 2021-02-19 04:54:08,404 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 6071.700000 2021-02-19 04:54:08,543 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2904.200000 2021-02-19 04:54:08,569 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2561.000000 2021-02-19 04:54:08,622 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:08,625 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1992.300000 2021-02-19 04:54:08,766 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5730.200000 2021-02-19 04:54:08,801 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4837.700000 2021-02-19 04:54:09,374 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5831.000000 2021-02-19 04:54:09,828 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4700.700000 2021-02-19 04:54:09,924 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 99.08 % 2021-02-19 04:54:09,924 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 99.0836313673 2021-02-19 04:54:10,066 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6210.400000 2021-02-19 04:54:10,079 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5971.400000 2021-02-19 04:54:10,232 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2867.500000 2021-02-19 04:54:10,250 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2570.900000 2021-02-19 04:54:10,316 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:10,339 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2019.000000 2021-02-19 04:54:10,407 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5753.500000 2021-02-19 04:54:10,474 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4817.300000 2021-02-19 04:54:10,987 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5834.200000 2021-02-19 04:54:11,463 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5327.600000 2021-02-19 04:54:11,752 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6210.400000 2021-02-19 04:54:11,775 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5971.400000 2021-02-19 04:54:11,953 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2867.500000 2021-02-19 04:54:11,990 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2570.900000 2021-02-19 04:54:12,000 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:12,038 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2019.000000 2021-02-19 04:54:12,085 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5753.500000 2021-02-19 04:54:12,184 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4817.300000 2021-02-19 04:54:12,627 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5754.900000 2021-02-19 04:54:13,104 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5608.400000 2021-02-19 04:54:13,395 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6152.800000 2021-02-19 04:54:13,424 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5824.600000 2021-02-19 04:54:13,671 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2843.000000 2021-02-19 04:54:13,710 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:13,733 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2014.100000 2021-02-19 04:54:13,737 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2609.600000 2021-02-19 04:54:13,765 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5699.000000 2021-02-19 04:54:13,832 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4825.700000 2021-02-19 04:54:14,299 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5635.700000 2021-02-19 04:54:14,742 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5608.400000 2021-02-19 04:54:14,997 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 99.26 % 2021-02-19 04:54:14,997 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 99.2643212847 2021-02-19 04:54:15,035 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6058.800000 2021-02-19 04:54:15,078 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5677.100000 2021-02-19 04:54:15,338 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2818.400000 2021-02-19 04:54:15,423 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:15,447 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2668.900000 2021-02-19 04:54:15,471 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1998.000000 2021-02-19 04:54:15,479 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5580.200000 2021-02-19 04:54:15,519 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4800.000000 2021-02-19 04:54:15,938 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5635.700000 2021-02-19 04:54:16,365 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5636.500000 2021-02-19 04:54:16,677 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6058.800000 2021-02-19 04:54:16,721 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5677.100000 2021-02-19 04:54:16,989 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2818.400000 2021-02-19 04:54:17,086 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:17,144 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2668.900000 2021-02-19 04:54:17,214 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5580.200000 2021-02-19 04:54:17,236 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1960.600000 2021-02-19 04:54:17,240 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4800.000000 2021-02-19 04:54:17,598 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5635.700000 2021-02-19 04:54:18,052 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5636.500000 2021-02-19 04:54:18,335 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6058.800000 2021-02-19 04:54:18,364 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5677.100000 2021-02-19 04:54:18,707 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2818.400000 2021-02-19 04:54:18,756 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:18,828 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2668.900000 2021-02-19 04:54:18,964 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1960.600000 2021-02-19 04:54:18,971 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4800.000000 2021-02-19 04:54:18,971 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5580.200000 2021-02-19 04:54:19,230 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5635.700000 2021-02-19 04:54:19,696 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5636.500000 2021-02-19 04:54:20,035 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5591.900000 2021-02-19 04:54:20,039 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6071.700000 2021-02-19 04:54:20,059 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 99.44 % 2021-02-19 04:54:20,059 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 99.4391564011 2021-02-19 04:54:20,368 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2855.300000 2021-02-19 04:54:20,380 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:20,483 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2668.200000 2021-02-19 04:54:20,644 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1980.000000 2021-02-19 04:54:20,651 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5525.000000 2021-02-19 04:54:20,677 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4826.600000 2021-02-19 04:54:20,901 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5582.800000 2021-02-19 04:54:21,345 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5564.900000 2021-02-19 04:54:21,721 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5591.900000 2021-02-19 04:54:21,747 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6071.700000 2021-02-19 04:54:22,020 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2855.300000 2021-02-19 04:54:22,068 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:22,194 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2668.200000 2021-02-19 04:54:22,299 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1980.000000 2021-02-19 04:54:22,312 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5525.000000 2021-02-19 04:54:22,341 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4802.600000 2021-02-19 04:54:22,536 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5515.600000 2021-02-19 04:54:22,970 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5519.500000 2021-02-19 04:54:23,407 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5531.900000 2021-02-19 04:54:23,408 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6062.800000 2021-02-19 04:54:23,681 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2902.600000 2021-02-19 04:54:23,721 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:23,851 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2639.100000 2021-02-19 04:54:23,974 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1990.600000 2021-02-19 04:54:24,006 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5471.400000 2021-02-19 04:54:24,029 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4802.600000 2021-02-19 04:54:24,196 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5515.600000 2021-02-19 04:54:24,611 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5521.700000 2021-02-19 04:54:25,078 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5525.400000 2021-02-19 04:54:25,111 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6081.500000 2021-02-19 04:54:25,128 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 99.68 % 2021-02-19 04:54:25,128 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 99.6824310392 2021-02-19 04:54:25,325 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2973.600000 2021-02-19 04:54:25,359 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:25,517 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2609.300000 2021-02-19 04:54:25,686 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2072.800000 2021-02-19 04:54:25,694 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5465.000000 2021-02-19 04:54:25,733 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4812.400000 2021-02-19 04:54:25,862 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5484.700000 2021-02-19 04:54:26,256 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5521.700000 2021-02-19 04:54:26,720 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5525.400000 2021-02-19 04:54:26,779 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6081.500000 2021-02-19 04:54:26,979 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2973.600000 2021-02-19 04:54:26,997 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:27,216 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2609.300000 2021-02-19 04:54:27,345 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2072.800000 2021-02-19 04:54:27,415 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5465.000000 2021-02-19 04:54:27,417 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4812.400000 2021-02-19 04:54:27,529 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5484.700000 2021-02-19 04:54:27,915 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5521.700000 2021-02-19 04:54:28,433 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5525.400000 2021-02-19 04:54:28,463 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6081.500000 2021-02-19 04:54:28,657 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2973.600000 2021-02-19 04:54:28,661 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:28,884 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2609.300000 2021-02-19 04:54:29,092 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4812.400000 2021-02-19 04:54:29,138 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5465.000000 2021-02-19 04:54:29,141 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2072.800000 2021-02-19 04:54:29,177 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5484.700000 2021-02-19 04:54:29,546 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5594.300000 2021-02-19 04:54:30,081 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5583.600000 2021-02-19 04:54:30,142 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6106.700000 2021-02-19 04:54:30,174 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 99.89 % 2021-02-19 04:54:30,174 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 99.8900722828 2021-02-19 04:54:30,318 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:30,365 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2954.700000 2021-02-19 04:54:30,555 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2611.900000 2021-02-19 04:54:30,773 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4764.400000 2021-02-19 04:54:30,836 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5512.400000 2021-02-19 04:54:30,872 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5523.700000 2021-02-19 04:54:30,908 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2374.100000 2021-02-19 04:54:31,220 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5594.300000 2021-02-19 04:54:31,736 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5583.600000 2021-02-19 04:54:31,832 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6106.700000 2021-02-19 04:54:32,023 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2954.700000 2021-02-19 04:54:32,032 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:32,206 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2611.900000 2021-02-19 04:54:32,476 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4750.400000 2021-02-19 04:54:32,512 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5631.900000 2021-02-19 04:54:32,553 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2772.200000 2021-02-19 04:54:32,592 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5652.700000 2021-02-19 04:54:32,901 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5705.500000 2021-02-19 04:54:33,384 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5677.700000 2021-02-19 04:54:33,496 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6181.800000 2021-02-19 04:54:33,691 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2922.500000 2021-02-19 04:54:33,721 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:33,857 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2642.300000 2021-02-19 04:54:34,161 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4750.400000 2021-02-19 04:54:34,187 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5631.900000 2021-02-19 04:54:34,203 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2772.200000 2021-02-19 04:54:34,246 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5707.000000 2021-02-19 04:54:34,582 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5746.700000 2021-02-19 04:54:35,010 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5688.300000 2021-02-19 04:54:35,148 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6191.100000 2021-02-19 04:54:35,247 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 100.00 % 2021-02-19 04:54:35,249 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 100 2021-02-19 04:54:35,407 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:35,413 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2857.400000 2021-02-19 04:54:35,492 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2662.200000 2021-02-19 04:54:35,816 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4677.600000 2021-02-19 04:54:35,905 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5679.400000 2021-02-19 04:54:35,911 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3100.500000 2021-02-19 04:54:35,964 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5707.000000 2021-02-19 04:54:36,210 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5746.700000 2021-02-19 04:54:36,717 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5688.300000 2021-02-19 04:54:36,802 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6191.100000 2021-02-19 04:54:37,063 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:37,066 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2857.400000 2021-02-19 04:54:37,151 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2662.200000 2021-02-19 04:54:37,529 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4677.600000 2021-02-19 04:54:37,598 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5679.400000 2021-02-19 04:54:37,654 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3050.700000 2021-02-19 04:54:37,663 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5707.000000 2021-02-19 04:54:37,851 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5746.700000 2021-02-19 04:54:38,397 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5688.300000 2021-02-19 04:54:38,464 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6191.100000 2021-02-19 04:54:38,736 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:38,747 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2857.400000 2021-02-19 04:54:38,789 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2662.200000 2021-02-19 04:54:39,188 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4677.600000 2021-02-19 04:54:39,269 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5679.400000 2021-02-19 04:54:39,334 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3050.700000 2021-02-19 04:54:39,367 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5707.000000 2021-02-19 04:54:39,497 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5648.600000 2021-02-19 04:54:40,091 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5592.800000 2021-02-19 04:54:40,157 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6072.800000 2021-02-19 04:54:40,305 | test | DEBUG | pool-1-thread-4 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 100.00 % 2021-02-19 04:54:40,305 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: running, progress: 100 2021-02-19 04:54:40,368 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:40,424 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2847.500000 2021-02-19 04:54:40,463 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2634.500000 2021-02-19 04:54:40,835 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4703.300000 2021-02-19 04:54:41,009 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5615.900000 2021-02-19 04:54:41,071 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3286.100000 2021-02-19 04:54:41,082 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5622.500000 2021-02-19 04:54:41,161 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5648.600000 2021-02-19 04:54:41,720 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5592.800000 2021-02-19 04:54:41,813 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6072.800000 2021-02-19 04:54:42,036 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:42,105 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2847.500000 2021-02-19 04:54:42,173 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2634.500000 2021-02-19 04:54:42,529 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4664.600000 2021-02-19 04:54:42,668 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5468.400000 2021-02-19 04:54:42,711 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3323.100000 2021-02-19 04:54:42,720 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5439.100000 2021-02-19 04:54:42,871 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5484.700000 2021-02-19 04:54:43,368 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5454.300000 2021-02-19 04:54:43,467 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5898.300000 2021-02-19 04:54:43,717 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:43,760 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2804.400000 2021-02-19 04:54:43,828 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2594.300000 2021-02-19 04:54:44,177 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4664.600000 2021-02-19 04:54:44,331 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5424.300000 2021-02-19 04:54:44,410 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5357.900000 2021-02-19 04:54:44,448 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3298.300000 2021-02-19 04:54:44,549 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5414.600000 2021-02-19 04:54:45,052 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5407.400000 2021-02-19 04:54:45,154 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5805.300000 2021-02-19 04:54:45,377 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:45,430 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2782.200000 2021-02-19 04:54:45,513 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2554.300000 2021-02-19 04:54:45,805 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4684.100000 2021-02-19 04:54:45,979 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5424.300000 2021-02-19 04:54:46,085 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5357.900000 2021-02-19 04:54:46,138 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3298.300000 2021-02-19 04:54:46,194 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5414.600000 2021-02-19 04:54:46,717 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5407.400000 2021-02-19 04:54:46,778 | infra | INFO | pool-2-thread-24 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8__default_VolumeCollection0_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:54:46,778 | infra | INFO | pool-2-thread-24 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers3_VolumeScope1_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.43' started 2021-02-19 04:54:46,838 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5805.300000 2021-02-19 04:54:47,019 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:47,108 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2782.200000 2021-02-19 04:54:47,183 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2554.300000 2021-02-19 04:54:47,460 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4684.100000 2021-02-19 04:54:47,631 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5424.300000 2021-02-19 04:54:47,770 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5357.900000 2021-02-19 04:54:47,806 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3298.300000 2021-02-19 04:54:47,855 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5414.600000 2021-02-19 04:54:48,368 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5407.400000 2021-02-19 04:54:48,506 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5805.300000 2021-02-19 04:54:48,688 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:54:48,828 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2782.200000 2021-02-19 04:54:48,875 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2554.300000 2021-02-19 04:54:49,203 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4684.100000 2021-02-19 04:54:49,283 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5424.300000 2021-02-19 04:54:49,483 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5245.900000 2021-02-19 04:54:49,505 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3257.200000 2021-02-19 04:54:49,543 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5368.600000 2021-02-19 04:54:50,058 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5400.400000 2021-02-19 04:54:50,203 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5740.300000 2021-02-19 04:54:50,335 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 71.600000 2021-02-19 04:54:50,400 | test | INFO | pool-1-thread-4 | [task:check:330] Rebalance - status: none, progress: 100 2021-02-19 04:54:50,540 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2717.000000 2021-02-19 04:54:50,551 | test | INFO | pool-1-thread-4 | [task:check:389] Rebalance completed with progress: 100% in 435.161000013 sec 2021-02-19 04:54:50,551 | infra | INFO | pool-1-thread-4 | [task:complete_task:99] Thread 'Rebalance_task_IN=[]_OUT=[172.23.110.65]_1613738855.24' completed 2021-02-19 04:54:50,552 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2567.900000 2021-02-19 04:54:50,739 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 4603.2, u'diskFetches': 0, u'dataUsed': 5603523312L, u'itemCount': 6271714, u'quotaPercentUsed': 7.900396608677315, u'storageTotals': {u'hdd': {u'usedByData': 143685349438L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 39922733832L, u'used': 209300623360L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 15577661582L, u'vbActiveNumNonResident': 0, u'memUsed': 4603179832L} 2021-02-19 04:54:50,742 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 2567.9, u'diskFetches': 0, u'dataUsed': 4667528506L, u'itemCount': 4374943, u'quotaPercentUsed': 5.714577766618645, u'storageTotals': {u'hdd': {u'usedByData': 143685349438L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 39922733832L, u'used': 209300623360L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 25236173943L, u'vbActiveNumNonResident': 0, u'memUsed': 3329608680L} 2021-02-19 04:54:50,744 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 2717, u'diskFetches': 0, u'dataUsed': 6901590863L, u'itemCount': 7650148, u'quotaPercentUsed': 9.48181139986454, u'storageTotals': {u'hdd': {u'usedByData': 143685349438L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 39922733832L, u'used': 209300623360L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 25446506330L, u'vbActiveNumNonResident': 0, u'memUsed': 5524593912L} 2021-02-19 04:54:50,747 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 71.6, u'diskFetches': 0, u'dataUsed': 6199427694L, u'itemCount': 6559902, u'quotaPercentUsed': 8.408778455985724, u'storageTotals': {u'hdd': {u'usedByData': 143685349438L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 39922733832L, u'used': 209300623360L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 11536546056L, u'vbActiveNumNonResident': 0, u'memUsed': 4899389400L} 2021-02-19 04:54:50,750 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 5368.6, u'diskFetches': 0, u'dataUsed': 4230664310L, u'itemCount': 4068699, u'quotaPercentUsed': 5.244950568860925, u'storageTotals': {u'hdd': {u'usedByData': 143685349438L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 39922733832L, u'used': 209300623360L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 9361747589L, u'vbActiveNumNonResident': 0, u'memUsed': 3055979576L} 2021-02-19 04:54:50,753 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 5400.4, u'diskFetches': 0, u'dataUsed': 6128470916L, u'itemCount': 6597166, u'quotaPercentUsed': 8.23992192434131, u'storageTotals': {u'hdd': {u'usedByData': 143685349438L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 39922733832L, u'used': 209300623360L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 11542194513L, u'vbActiveNumNonResident': 0, u'memUsed': 4801004848L} 2021-02-19 04:54:50,756 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 5422.1, u'diskFetches': 0, u'dataUsed': 6373190035L, u'itemCount': 7272648, u'quotaPercentUsed': 8.99353950021849, u'storageTotals': {u'hdd': {u'usedByData': 143685349438L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 39922733832L, u'used': 209300623360L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 14755213292L, u'vbActiveNumNonResident': 0, u'memUsed': 5240101440L} 2021-02-19 04:54:50,757 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 5740.3, u'diskFetches': 0, u'dataUsed': 4653524387L, u'itemCount': 4859641, u'quotaPercentUsed': 6.150429014450264, u'storageTotals': {u'hdd': {u'usedByData': 143685349438L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 39922733832L, u'used': 209300623360L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 10881503821L, u'vbActiveNumNonResident': 0, u'memUsed': 3583558168L} 2021-02-19 04:54:50,759 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 5245.9, u'diskFetches': 0, u'dataUsed': 4283765997L, u'itemCount': 3597094, u'quotaPercentUsed': 4.72256931944353, u'storageTotals': {u'hdd': {u'usedByData': 143685349438L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 39922733832L, u'used': 209300623360L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 13195592386L, u'vbActiveNumNonResident': 0, u'memUsed': 2751613232L} 2021-02-19 04:54:50,763 | test | DEBUG | MainThread | [bucket_ready_functions:parse_get_bucket_json:3719] Stats: {u'opsPerSec': 3257.2, u'diskFetches': 0, u'dataUsed': 3416873699L, u'itemCount': 2686341, u'quotaPercentUsed': 3.662058476670937, u'storageTotals': {u'hdd': {u'usedByData': 143685349438L, u'used': 373924571379L, u'quotaTotal': 35975809990656L, u'total': 35975809990656L, u'free': 35601885419277L}, u'ram': {u'usedByData': 39922733832L, u'used': 209300623360L, u'quotaTotal': 582994624512L, u'total': 810112991232L, u'quotaUsed': 582651740160L, u'quotaUsedPerNode': 194217246720L, u'quotaTotalPerNode': 194331541504L}}, u'diskUsed': 6152209926L, u'vbActiveNumNonResident': 0, u'memUsed': 2133704744} 2021-02-19 04:54:50,763 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +-----------------+-----------+----------+------------+-----+---------+-------------+------------+-------------+ | Bucket | Type | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | +-----------------+-----------+----------+------------+-----+---------+-------------+------------+-------------+ | GleamBookUsers0 | couchbase | 1 | none | 0 | 6271714 | 58265174016 | 4603179832 | 15577661582 | | GleamBookUsers1 | couchbase | 1 | none | 0 | 4374943 | 58265174016 | 3329608680 | 25236173943 | | GleamBookUsers2 | couchbase | 1 | none | 0 | 7650148 | 58265174016 | 5524593912 | 25446506330 | | GleamBookUsers3 | couchbase | 1 | none | 0 | 6559902 | 58265174016 | 4899389400 | 11536546056 | | GleamBookUsers4 | couchbase | 1 | none | 0 | 4068699 | 58265174016 | 3055979576 | 9361747589 | | GleamBookUsers5 | couchbase | 1 | none | 0 | 6597166 | 58265174016 | 4801004848 | 11542194513 | | GleamBookUsers6 | couchbase | 1 | none | 0 | 7272648 | 58265174016 | 5240101440 | 14755213292 | | GleamBookUsers7 | couchbase | 1 | none | 0 | 4859641 | 58265174016 | 3583558168 | 10881503821 | | GleamBookUsers8 | couchbase | 1 | none | 0 | 3597094 | 58265174016 | 2751613232 | 13195592386 | | GleamBookUsers9 | couchbase | 1 | none | 0 | 2686341 | 58265174016 | 2133704744 | 6152209926 | +-----------------+-----------+----------+------------+-----+---------+-------------+------------+-------------+ 2021-02-19 04:54:50,765 | test | INFO | MainThread | [table_view:display:72] Docs statistics +---------------+---------------+-----------------+-----------------+---------------+---------------+ | Initial Items | Current Items | Items Updated | Items Created | Items Deleted | Items Expired | +---------------+---------------+-----------------+-----------------+---------------+---------------+ | 0 | -30000000 | 2000000-3000000 | 1000000-2000000 | 0-1000000 | 0-1000000 | +---------------+---------------+-----------------+-----------------+---------------+---------------+ 2021-02-19 04:54:50,872 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4603.200000 2021-02-19 04:54:50,936 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5422.100000 2021-02-19 04:54:51,177 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 5245.900000 2021-02-19 04:54:51,203 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5368.600000 2021-02-19 04:54:51,220 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3257.200000 2021-02-19 04:54:51,499 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers0 is 100 2021-02-19 04:54:51,716 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5400.400000 2021-02-19 04:54:51,885 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5740.300000 2021-02-19 04:54:52,012 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 71.600000 2021-02-19 04:54:52,249 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers1 is 100 2021-02-19 04:54:52,295 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2717.000000 2021-02-19 04:54:52,555 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2558.500000 2021-02-19 04:54:52,569 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4566.600000 2021-02-19 04:54:52,625 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5415.500000 2021-02-19 04:54:52,865 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4945.900000 2021-02-19 04:54:52,900 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3186.800000 2021-02-19 04:54:52,927 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5331.600000 2021-02-19 04:54:52,986 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers2 is 100 2021-02-19 04:54:53,411 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5386.300000 2021-02-19 04:54:53,548 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5696.300000 2021-02-19 04:54:53,687 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 378.800000 2021-02-19 04:54:53,969 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2717.300000 2021-02-19 04:54:53,980 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers3 is 100 2021-02-19 04:54:54,223 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2558.500000 2021-02-19 04:54:54,278 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4487.500000 2021-02-19 04:54:54,305 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5324.400000 2021-02-19 04:54:54,520 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4395.300000 2021-02-19 04:54:54,581 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5223.200000 2021-02-19 04:54:54,605 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3082.400000 2021-02-19 04:54:54,895 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers4 is 100 2021-02-19 04:54:55,078 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5271.300000 2021-02-19 04:54:55,207 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5569.800000 2021-02-19 04:54:55,338 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 863.700000 2021-02-19 04:54:55,612 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers5 is 100 2021-02-19 04:54:55,645 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2719.700000 2021-02-19 04:54:55,924 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2540.600000 2021-02-19 04:54:56,000 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4487.500000 2021-02-19 04:54:56,019 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5324.400000 2021-02-19 04:54:56,204 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4395.300000 2021-02-19 04:54:56,249 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5223.200000 2021-02-19 04:54:56,289 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3082.400000 2021-02-19 04:54:56,372 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers6 is 100 2021-02-19 04:54:56,740 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5271.300000 2021-02-19 04:54:56,880 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5569.800000 2021-02-19 04:54:56,993 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 863.700000 2021-02-19 04:54:57,174 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers7 is 100 2021-02-19 04:54:57,323 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2719.700000 2021-02-19 04:54:57,595 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2540.600000 2021-02-19 04:54:57,687 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4487.500000 2021-02-19 04:54:57,706 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5324.400000 2021-02-19 04:54:57,894 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 4395.300000 2021-02-19 04:54:57,907 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5223.200000 2021-02-19 04:54:57,971 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3082.400000 2021-02-19 04:54:58,138 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers8 is 100 2021-02-19 04:54:58,408 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5271.300000 2021-02-19 04:54:58,585 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5569.800000 2021-02-19 04:54:58,661 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 863.700000 2021-02-19 04:54:58,836 | test | INFO | MainThread | [Magma:get_bucket_dgm:522] Active Resident Threshold of GleamBookUsers9 is 100 ############################################################ # # RAM FootPrint: 4392.5625 # ############################################################ 2021-02-19 04:54:58,887 | test | DEBUG | Thread-373 | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> crash_thread():L729 2021-02-19 04:54:58,887 | test | INFO | Thread-373 | [common_lib:sleep:22] Sleep 99 seconds. Reason: Iteration:0 waiting to kill memc on all nodes 2021-02-19 04:54:58,990 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2719.700000 2021-02-19 04:54:59,329 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2540.600000 2021-02-19 04:54:59,355 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4487.500000 2021-02-19 04:54:59,428 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5324.400000 2021-02-19 04:54:59,549 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3564.600000 2021-02-19 04:54:59,585 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5089.700000 2021-02-19 04:54:59,608 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3134.100000 2021-02-19 04:55:00,059 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5084.900000 2021-02-19 04:55:00,236 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5492.500000 2021-02-19 04:55:00,299 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1617.100000 2021-02-19 04:55:00,640 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2817.400000 2021-02-19 04:55:01,013 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2564.800000 2021-02-19 04:55:01,022 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4464.000000 2021-02-19 04:55:01,104 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5167.100000 2021-02-19 04:55:01,244 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3564.600000 2021-02-19 04:55:01,269 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5089.700000 2021-02-19 04:55:01,296 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3134.100000 2021-02-19 04:55:01,713 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5084.900000 2021-02-19 04:55:01,882 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5492.500000 2021-02-19 04:55:01,944 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1617.100000 2021-02-19 04:55:02,276 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2817.400000 2021-02-19 04:55:02,700 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2622.600000 2021-02-19 04:55:02,756 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4442.800000 2021-02-19 04:55:02,776 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5028.300000 2021-02-19 04:55:02,911 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2938.100000 2021-02-19 04:55:02,947 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4969.600000 2021-02-19 04:55:02,960 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3218.300000 2021-02-19 04:55:03,351 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4906.700000 2021-02-19 04:55:03,513 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5424.000000 2021-02-19 04:55:03,596 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2131.300000 2021-02-19 04:55:03,923 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2895.500000 2021-02-19 04:55:04,355 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2697.327641 2021-02-19 04:55:04,438 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4467.598602 2021-02-19 04:55:04,467 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4969.454923 2021-02-19 04:55:04,581 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2552.398242 2021-02-19 04:55:04,604 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3345.211963 2021-02-19 04:55:04,628 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4917.683024 2021-02-19 04:55:05,003 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4906.700000 2021-02-19 04:55:05,190 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5460.708868 2021-02-19 04:55:05,237 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2486.923267 2021-02-19 04:55:05,595 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2943.945856 2021-02-19 04:55:05,997 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2697.327641 2021-02-19 04:55:06,114 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4467.598602 2021-02-19 04:55:06,153 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4969.454923 2021-02-19 04:55:06,305 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2552.398242 2021-02-19 04:55:06,322 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4917.683024 2021-02-19 04:55:06,325 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3345.211963 2021-02-19 04:55:06,648 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4843.903156 2021-02-19 04:55:06,854 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5460.708868 2021-02-19 04:55:06,918 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2486.923267 2021-02-19 04:55:07,250 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2943.945856 2021-02-19 04:55:07,661 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2697.327641 2021-02-19 04:55:07,769 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4467.598602 2021-02-19 04:55:07,821 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4969.454923 2021-02-19 04:55:07,990 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2552.398242 2021-02-19 04:55:08,023 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3345.211963 2021-02-19 04:55:08,030 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4917.683024 2021-02-19 04:55:08,275 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4843.903156 2021-02-19 04:55:08,471 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5460.708868 2021-02-19 04:55:08,591 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2486.923267 2021-02-19 04:55:08,903 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2943.945856 2021-02-19 04:55:09,309 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2697.327641 2021-02-19 04:55:09,428 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4506.998602 2021-02-19 04:55:09,490 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5027.054923 2021-02-19 04:55:09,640 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2564.598242 2021-02-19 04:55:09,696 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3384.011963 2021-02-19 04:55:09,706 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5005.683024 2021-02-19 04:55:09,914 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4843.903156 2021-02-19 04:55:10,157 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5517.908868 2021-02-19 04:55:10,240 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2520.523267 2021-02-19 04:55:10,569 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2910.645856 2021-02-19 04:55:10,947 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2688.727641 2021-02-19 04:55:11,082 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4506.998602 2021-02-19 04:55:11,187 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5027.054923 2021-02-19 04:55:11,378 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3384.011963 2021-02-19 04:55:11,407 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2564.598242 2021-02-19 04:55:11,437 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5005.683024 2021-02-19 04:55:11,566 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4954.503156 2021-02-19 04:55:11,808 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5517.908868 2021-02-19 04:55:11,904 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2520.523267 2021-02-19 04:55:12,243 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2910.645856 2021-02-19 04:55:12,584 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2677.027641 2021-02-19 04:55:12,763 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4576.098602 2021-02-19 04:55:12,842 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5144.354923 2021-02-19 04:55:13,062 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3399.111963 2021-02-19 04:55:13,088 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2615.998242 2021-02-19 04:55:13,125 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5138.783024 2021-02-19 04:55:13,230 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5121.803156 2021-02-19 04:55:13,469 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5583.908868 2021-02-19 04:55:13,572 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2571.923267 2021-02-19 04:55:13,910 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2870.645856 2021-02-19 04:55:14,223 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2664.000000 2021-02-19 04:55:14,423 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4616.300000 2021-02-19 04:55:14,484 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5199.000000 2021-02-19 04:55:14,743 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3385.700000 2021-02-19 04:55:14,755 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2627.600000 2021-02-19 04:55:14,801 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5138.783024 2021-02-19 04:55:14,900 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5121.803156 2021-02-19 04:55:15,098 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5594.900000 2021-02-19 04:55:15,209 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2590.800000 2021-02-19 04:55:15,558 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2866.100000 2021-02-19 04:55:15,894 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2664.000000 2021-02-19 04:55:16,144 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4616.300000 2021-02-19 04:55:16,161 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5199.000000 2021-02-19 04:55:16,434 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2627.600000 2021-02-19 04:55:16,470 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3385.700000 2021-02-19 04:55:16,492 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5217.900000 2021-02-19 04:55:16,563 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5230.600000 2021-02-19 04:55:16,753 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5594.900000 2021-02-19 04:55:16,858 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2590.800000 2021-02-19 04:55:17,217 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2866.100000 2021-02-19 04:55:17,572 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2664.000000 2021-02-19 04:55:17,846 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4616.300000 2021-02-19 04:55:17,888 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5199.000000 2021-02-19 04:55:18,086 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2627.600000 2021-02-19 04:55:18,142 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3385.700000 2021-02-19 04:55:18,154 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5217.900000 2021-02-19 04:55:18,214 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5230.600000 2021-02-19 04:55:18,414 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5594.900000 2021-02-19 04:55:18,496 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2590.800000 2021-02-19 04:55:18,832 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2866.100000 2021-02-19 04:55:19,203 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2664.000000 2021-02-19 04:55:19,483 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4672.000000 2021-02-19 04:55:19,584 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5233.400000 2021-02-19 04:55:19,793 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3385.700000 2021-02-19 04:55:19,816 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2636.900000 2021-02-19 04:55:19,859 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5217.900000 2021-02-19 04:55:19,901 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5230.600000 2021-02-19 04:55:20,052 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5625.600000 2021-02-19 04:55:20,142 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2612.000000 2021-02-19 04:55:20,476 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2878.800000 2021-02-19 04:55:20,864 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2701.200000 2021-02-19 04:55:21,180 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4672.000000 2021-02-19 04:55:21,234 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5233.400000 2021-02-19 04:55:21,457 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3375.600000 2021-02-19 04:55:21,506 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2636.900000 2021-02-19 04:55:21,540 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5210.000000 2021-02-19 04:55:21,552 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5263.000000 2021-02-19 04:55:21,690 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5625.600000 2021-02-19 04:55:21,786 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2612.000000 2021-02-19 04:55:22,132 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2878.800000 2021-02-19 04:55:22,525 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2720.700000 2021-02-19 04:55:22,815 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4657.500000 2021-02-19 04:55:22,911 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5266.100000 2021-02-19 04:55:23,142 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3342.400000 2021-02-19 04:55:23,183 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2654.300000 2021-02-19 04:55:23,221 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5279.300000 2021-02-19 04:55:23,253 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5233.400000 2021-02-19 04:55:23,358 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5693.900000 2021-02-19 04:55:23,467 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2643.000000 2021-02-19 04:55:23,769 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2877.700000 2021-02-19 04:55:24,229 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2720.700000 2021-02-19 04:55:24,490 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4673.967300 2021-02-19 04:55:24,581 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5346.643073 2021-02-19 04:55:24,868 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3342.400000 2021-02-19 04:55:24,887 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2654.300000 2021-02-19 04:55:24,938 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5233.400000 2021-02-19 04:55:24,953 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5279.300000 2021-02-19 04:55:25,051 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5693.900000 2021-02-19 04:55:25,124 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2691.072242 2021-02-19 04:55:25,400 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2880.789737 2021-02-19 04:55:25,872 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2723.669631 2021-02-19 04:55:26,161 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4673.967300 2021-02-19 04:55:26,224 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5346.643073 2021-02-19 04:55:26,526 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3298.323047 2021-02-19 04:55:26,559 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2694.973202 2021-02-19 04:55:26,624 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5289.337011 2021-02-19 04:55:26,645 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5317.136171 2021-02-19 04:55:26,719 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5776.783405 2021-02-19 04:55:26,762 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2691.072242 2021-02-19 04:55:27,042 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2880.789737 2021-02-19 04:55:27,536 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2723.669631 2021-02-19 04:55:27,821 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4673.967300 2021-02-19 04:55:27,881 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5346.643073 2021-02-19 04:55:28,210 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3298.323047 2021-02-19 04:55:28,256 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2694.973202 2021-02-19 04:55:28,328 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5289.337011 2021-02-19 04:55:28,335 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5317.136171 2021-02-19 04:55:28,398 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5776.783405 2021-02-19 04:55:28,424 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2691.072242 2021-02-19 04:55:28,687 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2880.789737 2021-02-19 04:55:29,168 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2723.669631 2021-02-19 04:55:29,569 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4637.267300 2021-02-19 04:55:29,588 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5437.543073 2021-02-19 04:55:29,890 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3298.323047 2021-02-19 04:55:29,924 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2694.973202 2021-02-19 04:55:30,032 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5317.136171 2021-02-19 04:55:30,059 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5289.337011 2021-02-19 04:55:30,101 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5872.083405 2021-02-19 04:55:30,128 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2720.872242 2021-02-19 04:55:30,342 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2909.989737 2021-02-19 04:55:30,855 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2704.569631 2021-02-19 04:55:31,256 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4637.267300 2021-02-19 04:55:31,273 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5437.543073 2021-02-19 04:55:31,542 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3223.823047 2021-02-19 04:55:31,644 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2738.273202 2021-02-19 04:55:31,693 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5412.536171 2021-02-19 04:55:31,799 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5403.437011 2021-02-19 04:55:31,809 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5872.083405 2021-02-19 04:55:31,819 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2720.872242 2021-02-19 04:55:31,967 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2909.989737 2021-02-19 04:55:32,535 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2694.469631 2021-02-19 04:55:32,908 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4667.667300 2021-02-19 04:55:32,918 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5460.943073 2021-02-19 04:55:33,200 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3168.123047 2021-02-19 04:55:33,296 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2756.473202 2021-02-19 04:55:33,325 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5465.136171 2021-02-19 04:55:33,480 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5401.337011 2021-02-19 04:55:33,496 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5886.483405 2021-02-19 04:55:33,515 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2719.972242 2021-02-19 04:55:33,605 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2947.189737 2021-02-19 04:55:34,210 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2688.482060 2021-02-19 04:55:34,558 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5468.599690 2021-02-19 04:55:34,602 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4662.307538 2021-02-19 04:55:34,838 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3168.123047 2021-02-19 04:55:34,976 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2756.473202 2021-02-19 04:55:35,009 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5465.136171 2021-02-19 04:55:35,151 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5415.885044 2021-02-19 04:55:35,180 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5899.153088 2021-02-19 04:55:35,226 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2725.804635 2021-02-19 04:55:35,259 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2950.966523 2021-02-19 04:55:35,881 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2688.482060 2021-02-19 04:55:36,266 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5468.599690 2021-02-19 04:55:36,269 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4662.307538 2021-02-19 04:55:36,489 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3151.265963 2021-02-19 04:55:36,634 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2781.028752 2021-02-19 04:55:36,677 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5520.126449 2021-02-19 04:55:36,839 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5415.885044 2021-02-19 04:55:36,878 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5899.153088 2021-02-19 04:55:36,890 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2725.804635 2021-02-19 04:55:36,933 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2950.966523 2021-02-19 04:55:37,565 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2688.482060 2021-02-19 04:55:37,997 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5468.599690 2021-02-19 04:55:37,997 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4662.307538 2021-02-19 04:55:38,144 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3151.265963 2021-02-19 04:55:38,301 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2781.028752 2021-02-19 04:55:38,388 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5520.126449 2021-02-19 04:55:38,522 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5415.885044 2021-02-19 04:55:38,555 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5899.153088 2021-02-19 04:55:38,572 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2725.804635 2021-02-19 04:55:38,621 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2950.966523 2021-02-19 04:55:39,237 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2688.482060 2021-02-19 04:55:39,677 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4671.007538 2021-02-19 04:55:39,680 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5404.099690 2021-02-19 04:55:39,809 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3151.265963 2021-02-19 04:55:39,960 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2781.028752 2021-02-19 04:55:40,111 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5465.926449 2021-02-19 04:55:40,168 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5353.885044 2021-02-19 04:55:40,220 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2719.104635 2021-02-19 04:55:40,266 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5830.253088 2021-02-19 04:55:40,303 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2922.866523 2021-02-19 04:55:40,875 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2670.682060 2021-02-19 04:55:41,368 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5404.099690 2021-02-19 04:55:41,374 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4671.007538 2021-02-19 04:55:41,477 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3170.965963 2021-02-19 04:55:41,676 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2767.028752 2021-02-19 04:55:41,773 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5465.926449 2021-02-19 04:55:41,845 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5353.885044 2021-02-19 04:55:41,907 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2719.104635 2021-02-19 04:55:41,948 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5830.253088 2021-02-19 04:55:41,976 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2922.866523 2021-02-19 04:55:42,573 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2649.182060 2021-02-19 04:55:43,040 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5324.999690 2021-02-19 04:55:43,055 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4656.407538 2021-02-19 04:55:43,167 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3213.065963 2021-02-19 04:55:43,342 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2737.828752 2021-02-19 04:55:43,463 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5386.926449 2021-02-19 04:55:43,507 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5319.185044 2021-02-19 04:55:43,614 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2701.004635 2021-02-19 04:55:43,671 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2902.766523 2021-02-19 04:55:43,680 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5774.853088 2021-02-19 04:55:44,227 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2647.700000 2021-02-19 04:55:44,714 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5185.700000 2021-02-19 04:55:44,733 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4650.900000 2021-02-19 04:55:44,819 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3213.065963 2021-02-19 04:55:45,062 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2737.828752 2021-02-19 04:55:45,151 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5246.500000 2021-02-19 04:55:45,210 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5194.900000 2021-02-19 04:55:45,292 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2643.100000 2021-02-19 04:55:45,365 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2913.000000 2021-02-19 04:55:45,375 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5674.100000 2021-02-19 04:55:45,894 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2647.700000 2021-02-19 04:55:46,400 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5185.700000 2021-02-19 04:55:46,403 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4650.900000 2021-02-19 04:55:46,479 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3232.400000 2021-02-19 04:55:46,746 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2660.000000 2021-02-19 04:55:46,851 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5246.500000 2021-02-19 04:55:46,930 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5194.900000 2021-02-19 04:55:46,973 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2643.100000 2021-02-19 04:55:47,038 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5674.100000 2021-02-19 04:55:47,065 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2913.000000 2021-02-19 04:55:47,559 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2647.700000 2021-02-19 04:55:48,105 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4650.900000 2021-02-19 04:55:48,109 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5185.700000 2021-02-19 04:55:48,151 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3232.400000 2021-02-19 04:55:48,424 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2660.000000 2021-02-19 04:55:48,540 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5246.500000 2021-02-19 04:55:48,647 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5194.900000 2021-02-19 04:55:48,647 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2643.100000 2021-02-19 04:55:48,723 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5674.100000 2021-02-19 04:55:48,773 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2913.000000 2021-02-19 04:55:49,211 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2647.700000 2021-02-19 04:55:49,775 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4655.100000 2021-02-19 04:55:49,805 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5061.800000 2021-02-19 04:55:49,821 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3232.400000 2021-02-19 04:55:50,084 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2588.600000 2021-02-19 04:55:50,219 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5112.500000 2021-02-19 04:55:50,312 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2584.700000 2021-02-19 04:55:50,332 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5071.300000 2021-02-19 04:55:50,392 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5584.200000 2021-02-19 04:55:50,480 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2936.600000 2021-02-19 04:55:50,848 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2653.600000 2021-02-19 04:55:51,457 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4655.100000 2021-02-19 04:55:51,528 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5061.800000 2021-02-19 04:55:51,556 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3243.400000 2021-02-19 04:55:51,740 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2588.600000 2021-02-19 04:55:51,885 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5112.500000 2021-02-19 04:55:52,030 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5071.300000 2021-02-19 04:55:52,046 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2584.700000 2021-02-19 04:55:52,061 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5584.200000 2021-02-19 04:55:52,151 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2936.600000 2021-02-19 04:55:52,492 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2684.100000 2021-02-19 04:55:53,111 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4628.000000 2021-02-19 04:55:53,230 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4986.200000 2021-02-19 04:55:53,272 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3242.800000 2021-02-19 04:55:53,390 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2530.100000 2021-02-19 04:55:53,529 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5021.200000 2021-02-19 04:55:53,727 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5533.000000 2021-02-19 04:55:53,729 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2537.500000 2021-02-19 04:55:53,746 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4966.500000 2021-02-19 04:55:53,782 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2952.700000 2021-02-19 04:55:54,151 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2684.100000 2021-02-19 04:55:54,767 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4618.100000 2021-02-19 04:55:54,887 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4986.200000 2021-02-19 04:55:54,921 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3242.800000 2021-02-19 04:55:55,058 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2530.100000 2021-02-19 04:55:55,204 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4835.100000 2021-02-19 04:55:55,391 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5536.400000 2021-02-19 04:55:55,410 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2517.500000 2021-02-19 04:55:55,446 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4966.500000 2021-02-19 04:55:55,453 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2951.400000 2021-02-19 04:55:55,799 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2701.300000 2021-02-19 04:55:56,411 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4618.100000 2021-02-19 04:55:56,552 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5007.000000 2021-02-19 04:55:56,569 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3287.800000 2021-02-19 04:55:56,727 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2509.500000 2021-02-19 04:55:56,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4835.100000 2021-02-19 04:55:57,065 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2517.500000 2021-02-19 04:55:57,125 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4966.500000 2021-02-19 04:55:57,130 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5536.400000 2021-02-19 04:55:57,170 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2951.400000 2021-02-19 04:55:57,463 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2701.300000 2021-02-19 04:55:58,082 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4618.100000 2021-02-19 04:55:58,233 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5007.000000 2021-02-19 04:55:58,237 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3287.800000 2021-02-19 04:55:58,407 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2509.500000 2021-02-19 04:55:58,602 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4835.100000 2021-02-19 04:55:58,759 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2517.500000 2021-02-19 04:55:58,782 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4966.500000 2021-02-19 04:55:58,811 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5536.400000 2021-02-19 04:55:58,828 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2951.400000 2021-02-19 04:55:59,092 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2701.300000 2021-02-19 04:55:59,743 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4665.400000 2021-02-19 04:55:59,895 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3287.800000 2021-02-19 04:55:59,895 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5007.000000 2021-02-19 04:56:00,079 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2509.500000 2021-02-19 04:56:00,252 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4461.900000 2021-02-19 04:56:00,441 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5190.200000 2021-02-19 04:56:00,443 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2553.500000 2021-02-19 04:56:00,507 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2955.400000 2021-02-19 04:56:00,515 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5687.200000 2021-02-19 04:56:00,724 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2733.200000 2021-02-19 04:56:01,394 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4665.400000 2021-02-19 04:56:01,592 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3386.300000 2021-02-19 04:56:01,612 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5208.900000 2021-02-19 04:56:01,756 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2601.800000 2021-02-19 04:56:01,923 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4461.900000 2021-02-19 04:56:02,145 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2553.500000 2021-02-19 04:56:02,154 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5190.200000 2021-02-19 04:56:02,174 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5687.200000 2021-02-19 04:56:02,197 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2955.400000 2021-02-19 04:56:02,400 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2740.100000 2021-02-19 04:56:03,075 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4763.100000 2021-02-19 04:56:03,260 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5463.100000 2021-02-19 04:56:03,288 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3473.700000 2021-02-19 04:56:03,440 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2748.200000 2021-02-19 04:56:03,598 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4184.500000 2021-02-19 04:56:03,812 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2652.700000 2021-02-19 04:56:03,829 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5896.300000 2021-02-19 04:56:03,842 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5505.400000 2021-02-19 04:56:03,917 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2949.900000 2021-02-19 04:56:04,084 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2740.100000 2021-02-19 04:56:04,724 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4832.800000 2021-02-19 04:56:04,959 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3473.700000 2021-02-19 04:56:04,960 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5463.100000 2021-02-19 04:56:05,118 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2885.700000 2021-02-19 04:56:05,249 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4190.400000 2021-02-19 04:56:05,509 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2753.500000 2021-02-19 04:56:05,558 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5739.700000 2021-02-19 04:56:05,566 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6057.100000 2021-02-19 04:56:05,612 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2942.200000 2021-02-19 04:56:05,759 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2728.500000 2021-02-19 04:56:06,365 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4832.800000 2021-02-19 04:56:06,657 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5644.900000 2021-02-19 04:56:06,661 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3499.900000 2021-02-19 04:56:06,811 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2885.700000 2021-02-19 04:56:06,911 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4190.400000 2021-02-19 04:56:07,194 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2753.500000 2021-02-19 04:56:07,250 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6057.100000 2021-02-19 04:56:07,298 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5739.700000 2021-02-19 04:56:07,305 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2942.200000 2021-02-19 04:56:07,430 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2728.500000 2021-02-19 04:56:08,013 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4832.800000 2021-02-19 04:56:08,319 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5644.900000 2021-02-19 04:56:08,345 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3499.900000 2021-02-19 04:56:08,487 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2885.700000 2021-02-19 04:56:08,571 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4190.400000 2021-02-19 04:56:08,921 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2753.500000 2021-02-19 04:56:08,970 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5739.700000 2021-02-19 04:56:09,003 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 6057.100000 2021-02-19 04:56:09,009 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2942.200000 2021-02-19 04:56:09,127 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2728.500000 2021-02-19 04:56:09,684 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4743.300000 2021-02-19 04:56:10,010 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5644.900000 2021-02-19 04:56:10,048 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3499.900000 2021-02-19 04:56:10,153 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2821.900000 2021-02-19 04:56:10,242 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4642.900000 2021-02-19 04:56:10,585 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2757.900000 2021-02-19 04:56:10,690 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5605.200000 2021-02-19 04:56:10,730 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5946.900000 2021-02-19 04:56:10,753 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2906.000000 2021-02-19 04:56:10,788 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2723.100000 2021-02-19 04:56:11,387 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4743.300000 2021-02-19 04:56:11,637 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5538.900000 2021-02-19 04:56:11,719 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3427.300000 2021-02-19 04:56:11,829 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2821.900000 2021-02-19 04:56:11,934 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4642.900000 2021-02-19 04:56:12,257 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2757.900000 2021-02-19 04:56:12,427 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5311.900000 2021-02-19 04:56:12,444 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5701.700000 2021-02-19 04:56:12,483 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2891.800000 2021-02-19 04:56:12,493 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2704.100000 2021-02-19 04:56:13,030 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4611.200000 2021-02-19 04:56:13,315 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5311.700000 2021-02-19 04:56:13,394 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3389.500000 2021-02-19 04:56:13,480 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2679.500000 2021-02-19 04:56:13,608 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4927.200000 2021-02-19 04:56:13,920 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2676.800000 2021-02-19 04:56:14,138 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5311.900000 2021-02-19 04:56:14,142 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5701.700000 2021-02-19 04:56:14,197 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2704.100000 2021-02-19 04:56:14,203 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2891.800000 2021-02-19 04:56:14,657 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4496.800000 2021-02-19 04:56:14,973 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5311.700000 2021-02-19 04:56:15,025 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3389.500000 2021-02-19 04:56:15,141 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2535.200000 2021-02-19 04:56:15,270 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5051.700000 2021-02-19 04:56:15,582 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2585.600000 2021-02-19 04:56:15,839 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5491.400000 2021-02-19 04:56:15,842 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5027.600000 2021-02-19 04:56:15,911 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2697.800000 2021-02-19 04:56:15,911 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2880.200000 2021-02-19 04:56:16,313 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4496.800000 2021-02-19 04:56:16,687 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5106.800000 2021-02-19 04:56:16,747 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3352.800000 2021-02-19 04:56:16,806 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2535.200000 2021-02-19 04:56:16,920 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5051.700000 2021-02-19 04:56:17,236 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2585.600000 2021-02-19 04:56:17,279 | infra | INFO | pool-2-thread-33 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers6_VolumeScope0_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:56:17,279 | infra | INFO | pool-2-thread-33 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers0_VolumeScope3_VolumeCollection3_ttl=1200_update_MAJORITY_0_1000000_1613733368.43' started 2021-02-19 04:56:17,480 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5491.400000 2021-02-19 04:56:17,562 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5027.600000 2021-02-19 04:56:17,575 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2880.200000 2021-02-19 04:56:17,589 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2697.800000 2021-02-19 04:56:17,946 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4496.800000 2021-02-19 04:56:18,388 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5106.800000 2021-02-19 04:56:18,407 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3352.800000 2021-02-19 04:56:18,466 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2535.200000 2021-02-19 04:56:18,569 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5051.700000 2021-02-19 04:56:18,904 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2585.600000 2021-02-19 04:56:19,164 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5491.400000 2021-02-19 04:56:19,243 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5027.600000 2021-02-19 04:56:19,276 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2880.200000 2021-02-19 04:56:19,280 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2697.800000 2021-02-19 04:56:19,592 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4488.100000 2021-02-19 04:56:20,033 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 5106.800000 2021-02-19 04:56:20,053 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3352.800000 2021-02-19 04:56:20,131 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2512.800000 2021-02-19 04:56:20,221 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4959.500000 2021-02-19 04:56:20,526 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2518.100000 2021-02-19 04:56:20,855 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5437.900000 2021-02-19 04:56:20,937 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4891.100000 2021-02-19 04:56:20,986 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2876.600000 2021-02-19 04:56:20,992 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2686.600000 2021-02-19 04:56:21,230 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4488.100000 2021-02-19 04:56:21,707 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3334.300000 2021-02-19 04:56:21,729 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4990.900000 2021-02-19 04:56:21,789 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2512.800000 2021-02-19 04:56:21,907 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4959.500000 2021-02-19 04:56:22,193 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2518.100000 2021-02-19 04:56:22,512 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5522.300000 2021-02-19 04:56:22,608 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4919.600000 2021-02-19 04:56:22,651 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2871.000000 2021-02-19 04:56:22,670 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2702.400000 2021-02-19 04:56:22,858 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4516.700000 2021-02-19 04:56:23,388 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4751.900000 2021-02-19 04:56:23,408 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3265.800000 2021-02-19 04:56:23,502 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2550.800000 2021-02-19 04:56:23,595 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5030.700000 2021-02-19 04:56:23,839 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2540.700000 2021-02-19 04:56:24,144 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5522.300000 2021-02-19 04:56:24,233 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5083.400000 2021-02-19 04:56:24,290 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2888.400000 2021-02-19 04:56:24,312 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2718.000000 2021-02-19 04:56:24,470 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4542.400000 2021-02-19 04:56:24,997 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4751.900000 2021-02-19 04:56:25,052 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3265.800000 2021-02-19 04:56:25,148 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2655.100000 2021-02-19 04:56:25,194 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5225.100000 2021-02-19 04:56:25,430 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2626.500000 2021-02-19 04:56:25,783 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5684.600000 2021-02-19 04:56:25,892 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5083.400000 2021-02-19 04:56:25,907 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2888.400000 2021-02-19 04:56:25,947 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2718.000000 2021-02-19 04:56:26,062 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4542.400000 2021-02-19 04:56:26,619 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4385.000000 2021-02-19 04:56:26,697 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3225.000000 2021-02-19 04:56:26,809 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2655.100000 2021-02-19 04:56:26,832 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5225.100000 2021-02-19 04:56:27,029 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2626.500000 2021-02-19 04:56:27,380 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5684.600000 2021-02-19 04:56:27,540 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5083.400000 2021-02-19 04:56:27,561 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2718.000000 2021-02-19 04:56:27,585 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2888.400000 2021-02-19 04:56:27,678 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4542.400000 2021-02-19 04:56:28,305 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4385.000000 2021-02-19 04:56:28,328 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3225.000000 2021-02-19 04:56:28,441 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2655.100000 2021-02-19 04:56:28,463 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 5225.100000 2021-02-19 04:56:28,650 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2626.500000 2021-02-19 04:56:28,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5684.600000 2021-02-19 04:56:29,236 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2718.000000 2021-02-19 04:56:29,250 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 5083.400000 2021-02-19 04:56:29,266 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2888.400000 2021-02-19 04:56:29,361 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4542.400000 2021-02-19 04:56:29,973 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3225.000000 2021-02-19 04:56:30,002 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4385.000000 2021-02-19 04:56:30,114 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2461.700000 2021-02-19 04:56:30,127 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4844.800000 2021-02-19 04:56:30,302 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2460.200000 2021-02-19 04:56:30,621 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5221.300000 2021-02-19 04:56:30,894 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4734.900000 2021-02-19 04:56:30,914 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2388.600000 2021-02-19 04:56:30,944 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2562.000000 2021-02-19 04:56:31,013 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3982.300000 2021-02-19 04:56:31,641 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3395.700000 2021-02-19 04:56:31,655 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2837.200000 2021-02-19 04:56:31,775 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4844.800000 2021-02-19 04:56:31,790 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2461.700000 2021-02-19 04:56:31,931 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2460.200000 2021-02-19 04:56:32,267 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5221.300000 2021-02-19 04:56:32,542 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 3750.358588 2021-02-19 04:56:32,549 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1787.237552 2021-02-19 04:56:32,598 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1956.429054 2021-02-19 04:56:32,648 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2972.597461 2021-02-19 04:56:33,299 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2178.118456 2021-02-19 04:56:33,311 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2313.926855 2021-02-19 04:56:33,460 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3829.755249 2021-02-19 04:56:33,463 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1998.417417 2021-02-19 04:56:33,601 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1940.928194 2021-02-19 04:56:33,900 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4135.937852 2021-02-19 04:56:34,253 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2225.558588 2021-02-19 04:56:34,299 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1007.337552 2021-02-19 04:56:34,319 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1114.729054 2021-02-19 04:56:34,344 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1911.197461 2021-02-19 04:56:34,944 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2178.118456 2021-02-19 04:56:34,971 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2313.926855 2021-02-19 04:56:35,121 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1413.117417 2021-02-19 04:56:35,157 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2274.255249 2021-02-19 04:56:35,259 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1275.428194 2021-02-19 04:56:35,526 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2833.937852 2021-02-19 04:56:35,913 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2225.558588 2021-02-19 04:56:35,961 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1007.337552 2021-02-19 04:56:35,977 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1114.729054 2021-02-19 04:56:36,007 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1911.197461 2021-02-19 04:56:36,611 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1505.418456 2021-02-19 04:56:36,648 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1237.926855 2021-02-19 04:56:36,806 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1413.117417 2021-02-19 04:56:36,809 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2274.255249 2021-02-19 04:56:36,881 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1275.428194 2021-02-19 04:56:37,157 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2833.937852 2021-02-19 04:56:37,602 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2225.558588 2021-02-19 04:56:37,618 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1007.337552 2021-02-19 04:56:37,693 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1114.729054 2021-02-19 04:56:37,698 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1911.197461 2021-02-19 04:56:37,898 | test | DEBUG | Thread-373 | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> kill_memcached():L745 2021-02-19 04:56:37,898 | test | INFO | Thread-373 | [common_lib:sleep:22] Sleep 5 seconds. Reason: Sleep for 5 seconds between continuous memc kill 2021-02-19 04:56:38,296 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1505.418456 2021-02-19 04:56:38,309 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1237.926855 2021-02-19 04:56:38,480 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2274.255249 2021-02-19 04:56:38,496 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1413.117417 2021-02-19 04:56:38,539 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1275.428194 2021-02-19 04:56:38,805 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2833.937852 2021-02-19 04:56:39,257 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2225.558588 2021-02-19 04:56:39,279 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1007.337552 2021-02-19 04:56:39,367 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1911.197461 2021-02-19 04:56:39,377 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1114.729054 2021-02-19 04:56:39,951 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1505.418456 2021-02-19 04:56:39,970 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1237.926855 2021-02-19 04:56:40,132 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1852.155249 2021-02-19 04:56:40,186 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1553.717417 2021-02-19 04:56:40,210 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1336.128194 2021-02-19 04:56:40,460 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3047.037852 2021-02-19 04:56:40,913 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1431.858588 2021-02-19 04:56:40,947 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 881.437552 2021-02-19 04:56:41,052 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2119.597461 2021-02-19 04:56:41,053 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 848.129054 2021-02-19 04:56:41,595 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1704.118456 2021-02-19 04:56:41,642 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1272.626855 2021-02-19 04:56:41,788 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1852.155249 2021-02-19 04:56:41,864 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1553.717417 2021-02-19 04:56:41,901 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1336.128194 2021-02-19 04:56:42,118 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 3047.037852 2021-02-19 04:56:42,581 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1629.280896 2021-02-19 04:56:42,615 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1288.943949 2021-02-19 04:56:42,743 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3207.620144 2021-02-19 04:56:42,756 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1057.112743 2021-02-19 04:56:43,263 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2544.649650 2021-02-19 04:56:43,313 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1877.894199 2021-02-19 04:56:43,427 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2534.881296 2021-02-19 04:56:43,476 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2204.312703 2021-02-19 04:56:43,530 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1972.599100 2021-02-19 04:56:43,719 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4359.824705 2021-02-19 04:56:44,197 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2717.280896 2021-02-19 04:56:44,214 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2073.443949 2021-02-19 04:56:44,358 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1674.812743 2021-02-19 04:56:44,368 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4412.820144 2021-02-19 04:56:44,602 | test | DEBUG | Thread-373 | [basetestcase:check_coredump_exist:727] 172.23.110.69: No crash files found 2021-02-19 04:56:44,862 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2544.649650 2021-02-19 04:56:44,927 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1877.894199 2021-02-19 04:56:45,061 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 2534.881296 2021-02-19 04:56:45,084 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2975.512703 2021-02-19 04:56:45,141 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2797.899100 2021-02-19 04:56:45,355 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5969.324705 2021-02-19 04:56:46,026 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2717.280896 2021-02-19 04:56:46,029 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2073.443949 2021-02-19 04:56:46,052 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4412.820144 2021-02-19 04:56:46,062 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1674.812743 2021-02-19 04:56:46,582 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3401.749650 2021-02-19 04:56:46,732 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2741.394199 2021-02-19 04:56:46,755 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2975.512703 2021-02-19 04:56:46,796 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4090.081296 2021-02-19 04:56:46,941 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2797.899100 2021-02-19 04:56:47,197 | test | DEBUG | Thread-373 | [basetestcase:check_coredump_exist:746] 172.23.110.69: No 'sanitizers.log.*' files found 2021-02-19 04:56:47,674 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2717.280896 2021-02-19 04:56:47,770 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 5969.324705 2021-02-19 04:56:47,775 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2073.443949 2021-02-19 04:56:47,776 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1674.812743 2021-02-19 04:56:47,790 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 4412.820144 2021-02-19 04:56:47,852 | test | DEBUG | Thread-373 | [basetestcase:check_coredump_exist:727] 172.23.110.64: No crash files found 2021-02-19 04:56:48,273 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3401.749650 2021-02-19 04:56:48,400 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2741.394199 2021-02-19 04:56:48,443 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 4090.081296 2021-02-19 04:56:48,490 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2975.512703 2021-02-19 04:56:49,217 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2797.899100 2021-02-19 04:56:49,390 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2717.280896 2021-02-19 04:56:49,515 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4403.824705 2021-02-19 04:56:49,525 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1316.312743 2021-02-19 04:56:49,546 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3262.420144 2021-02-19 04:56:49,556 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1630.543949 2021-02-19 04:56:49,895 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 3401.749650 2021-02-19 04:56:50,062 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2741.394199 2021-02-19 04:56:50,173 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2183.712703 2021-02-19 04:56:50,229 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3246.681296 2021-02-19 04:56:50,427 | test | DEBUG | Thread-373 | [basetestcase:check_coredump_exist:746] 172.23.110.64: No 'sanitizers.log.*' files found 2021-02-19 04:56:50,844 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 2086.099100 2021-02-19 04:56:50,961 | test | CRITICAL | Thread-373 | [basetestcase:check_coredump_exist:718] 172.23.110.68: 1 core dump seen 2021-02-19 04:56:51,013 | test | CRITICAL | Thread-373 | [basetestcase:check_coredump_exist:719] 172.23.110.68: Stack Trace of first crash - 6416790e-4e6b-4af6-93a4a18b-9301eab5.dmp 2021-02-19 04:56:51,035 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 2261.780896 2021-02-19 04:56:51,180 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3262.420144 2021-02-19 04:56:51,207 | test | DEBUG | Thread-373 | [basetestcase:check_coredump_exist:746] 172.23.110.68: No 'sanitizers.log.*' files found Exception in thread Thread-373:Traceback (most recent call last): File "/opt/jython/Lib/threading.py", line 222, in _Thread__bootstrap self.run() 2021-02-19 04:56:51,207 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4403.824705 File "/opt/jython/Lib/threading.py", line 213, in run self._target(*self._args, **self._kwargs) File "pytests/volumetests/Magma.py", line 732, in crash_thread self.kill_memcached(nodes, num_kills=num_kills, File "pytests/volumetests/Magma.py", line 760, in kill_memcached self.assertFalse( File "/opt/jython/Lib/unittest/case.py", line 419, in assertFalse raise self.failureException(msg) AssertionError: CRASH | CRITICAL | WARN messages found in cb_logs ############################################################ # # Step 7: Swap with Loading of docs # ############################################################ 2021-02-19 04:56:51,224 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1630.543949 2021-02-19 04:56:51,246 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1316.312743 2021-02-19 04:56:51,256 | infra | INFO | MainThread | [task_manager:add_new_task:23] Added new task: Rebalance_task_IN=[172.23.110.65]_OUT=[172.23.110.69]_1613739411.21 2021-02-19 04:56:51,256 | infra | INFO | pool-1-thread-5 | [task:start_task:84] Thread 'Rebalance_task_IN=[172.23.110.65]_OUT=[172.23.110.69]_1613739411.21' started 2021-02-19 04:56:51,276 | test | DEBUG | MainThread | [common_lib:sleep:17] Sleep is called from pytests/volumetests/Magma.py -> abort_rebalance():L899 2021-02-19 04:56:51,276 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 30 seconds. Reason: Let the rebalance begin! 2021-02-19 04:56:51,282 | test | DEBUG | pool-1-thread-5 | [rest_client:add_node:1103] Adding remote node 172.23.110.65:8091 to cluster 172.23.110.64:8091 2021-02-19 04:56:51,532 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 2505.649650 2021-02-19 04:56:51,710 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 2067.894199 2021-02-19 04:56:51,806 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 2183.712703 2021-02-19 04:56:51,878 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3246.681296 2021-02-19 04:56:52,476 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1090.600000 2021-02-19 04:56:52,687 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1357.300000 2021-02-19 04:56:52,864 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1661.700000 2021-02-19 04:56:52,897 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 2280.300000 2021-02-19 04:56:52,914 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 752.600000 2021-02-19 04:56:52,937 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 910.800000 2021-02-19 04:56:53,142 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1257.400000 2021-02-19 04:56:53,338 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1096.900000 2021-02-19 04:56:53,420 | test | DEBUG | pool-1-thread-5 | [task:start_rebalance:301] Removing node 172.23.110.69:8091 from cluster 2021-02-19 04:56:53,420 | test | DEBUG | pool-1-thread-5 | [rest_client:rebalance:1341] Rebalance params: {'password': 'password', 'knownNodes': u'ns_1@172.23.110.64,ns_1@172.23.110.68,ns_1@172.23.110.69,ns_1@172.23.110.65', 'ejectedNodes': u'ns_1@172.23.110.69', 'user': 'Administrator'} 2021-02-19 04:56:53,470 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1120.200000 2021-02-19 04:56:53,542 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1840.200000 2021-02-19 04:56:54,099 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 1090.600000 2021-02-19 04:56:54,328 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.299820 2021-02-19 04:56:54,523 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:56:54,546 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1.599041 2021-02-19 04:56:54,552 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.699580 2021-02-19 04:56:54,582 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.499101 2021-02-19 04:56:54,747 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.499101 2021-02-19 04:56:54,954 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 1096.900000 2021-02-19 04:56:55,091 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.699580 2021-02-19 04:56:55,180 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3.098141 2021-02-19 04:56:55,687 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.599640 2021-02-19 04:56:55,957 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.299820 2021-02-19 04:56:56,096 | test | DEBUG | pool-1-thread-5 | [rest_client:rebalance:1346] Rebalance operation started 2021-02-19 04:56:56,101 | test | INFO | pool-1-thread-5 | [table_view:display:72] Rebalance Overview +---------------+----------+-----------------------+---------------+--------------+ | Nodes | Services | Version | CPU | Status | +---------------+----------+-----------------------+---------------+--------------+ | 172.23.110.64 | kv | 7.0.0-4498-enterprise | 24.2986196835 | Cluster node | | 172.23.110.68 | kv | 7.0.0-4498-enterprise | 16.1263252119 | Cluster node | | 172.23.110.69 | kv | 7.0.0-4498-enterprise | 23.3611274881 | --- OUT ---> | | 172.23.110.65 | None | | | <--- IN --- | +---------------+----------+-----------------------+---------------+--------------+ 2021-02-19 04:56:56,109 | test | DEBUG | pool-1-thread-5 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 04:56:56,109 | test | INFO | pool-1-thread-5 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 04:56:56,176 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:56:56,188 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1.599041 2021-02-19 04:56:56,213 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.699580 2021-02-19 04:56:56,243 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.499101 2021-02-19 04:56:56,387 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.499101 2021-02-19 04:56:56,608 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.499700 2021-02-19 04:56:56,730 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.699580 2021-02-19 04:56:56,821 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3.098141 2021-02-19 04:56:57,293 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.599640 2021-02-19 04:56:57,604 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.299820 2021-02-19 04:56:57,834 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:56:57,848 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1.599041 2021-02-19 04:56:57,874 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.699580 2021-02-19 04:56:57,901 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1.499101 2021-02-19 04:56:58,019 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 1.499101 2021-02-19 04:56:58,266 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.499700 2021-02-19 04:56:58,355 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.699580 2021-02-19 04:56:58,469 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3.098141 2021-02-19 04:56:58,891 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.599640 2021-02-19 04:56:59,246 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.299820 2021-02-19 04:56:59,474 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3.647811 2021-02-19 04:56:59,493 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4.247452 2021-02-19 04:56:59,522 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 6.695982 2021-02-19 04:56:59,549 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6.646012 2021-02-19 04:56:59,657 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6.845892 2021-02-19 04:56:59,900 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.499700 2021-02-19 04:57:00,006 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.699580 2021-02-19 04:57:00,101 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 3.098141 2021-02-19 04:57:00,507 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3.947631 2021-02-19 04:57:00,859 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 4.947032 2021-02-19 04:57:01,140 | test | DEBUG | pool-1-thread-5 | [rest_client:_rebalance_status_and_progress:1510] Rebalance percentage: 0.00 % 2021-02-19 04:57:01,141 | test | INFO | pool-1-thread-5 | [task:check:330] Rebalance - status: running, progress: 0 2021-02-19 04:57:01,147 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4.247452 2021-02-19 04:57:01,167 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 6.646012 2021-02-19 04:57:01,184 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3.647811 2021-02-19 04:57:01,270 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 6.695982 2021-02-19 04:57:01,345 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 6.845892 2021-02-19 04:57:01,509 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 3.048171 2021-02-19 04:57:01,664 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1.948831 2021-02-19 04:57:01,759 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 7.845293 2021-02-19 04:57:02,091 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 3.947631 2021-02-19 04:57:02,457 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 10.447032 2021-02-19 04:57:02,750 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 7.947452 2021-02-19 04:57:02,776 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 9.146012 2021-02-19 04:57:02,803 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3.647811 2021-02-19 04:57:02,894 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 19.395982 2021-02-19 04:57:02,944 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 8.545892 2021-02-19 04:57:03,114 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 8.448171 2021-02-19 04:57:03,292 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 10.548831 2021-02-19 04:57:03,398 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 16.345293 2021-02-19 04:57:03,661 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 6.447631 2021-02-19 04:57:04,052 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 10.447032 2021-02-19 04:57:04,339 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 14.353214 2021-02-19 04:57:04,391 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3.647811 2021-02-19 04:57:04,414 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 12.448834 2021-02-19 04:57:04,506 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 25.901685 2021-02-19 04:57:04,529 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 15.051595 2021-02-19 04:57:04,736 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 13.952073 2021-02-19 04:57:04,894 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 10.548831 2021-02-19 04:57:04,993 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 16.345293 2021-02-19 04:57:05,233 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9.850393 2021-02-19 04:57:05,635 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 14.149613 2021-02-19 04:57:05,921 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 14.353214 2021-02-19 04:57:05,969 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3.647811 2021-02-19 04:57:05,986 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 12.448834 2021-02-19 04:57:06,118 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 25.901685 2021-02-19 04:57:06,130 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 15.051595 2021-02-19 04:57:06,170 | test | ERROR | pool-1-thread-5 | [rest_client:_rebalance_status_and_progress:1494] {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 04:57:06,197 | test | INFO | pool-1-thread-5 | [rest_client:print_UI_logs:2599] Latest logs from UI on 172.23.110.64: 2021-02-19 04:57:06,197 | test | ERROR | pool-1-thread-5 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_orchestrator', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613739425457L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:05.457Z', u'text': u'Rebalance exited with reason {pre_rebalance_janitor_run_failed,\n "GleamBookUsers0",\n {error,wait_for_memcached_failed,\n [\'ns_1@172.23.110.64\']}}.\nRebalance Operation Id = 696ecc45e6947ed9311bea8d7db16b69'} 2021-02-19 04:57:06,197 | test | ERROR | pool-1-thread-5 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613739425193L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:05.193Z', u'text': u'Bucket "GleamBookUsers0" loaded on node \'ns_1@172.23.110.64\' in 4 seconds.'} 2021-02-19 04:57:06,197 | test | ERROR | pool-1-thread-5 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613739425034L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:05.034Z', u'text': u'Bucket "GleamBookUsers2" loaded on node \'ns_1@172.23.110.64\' in 7 seconds.'} 2021-02-19 04:57:06,197 | test | ERROR | pool-1-thread-5 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613739423809L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:03.809Z', u'text': u'Bucket "GleamBookUsers8" loaded on node \'ns_1@172.23.110.69\' in 10 seconds.'} 2021-02-19 04:57:06,197 | test | ERROR | pool-1-thread-5 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613739423656L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:03.656Z', u'text': u'Bucket "GleamBookUsers1" loaded on node \'ns_1@172.23.110.64\' in 8 seconds.'} 2021-02-19 04:57:06,197 | test | ERROR | pool-1-thread-5 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613739423607L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:03.607Z', u'text': u'Bucket "GleamBookUsers3" loaded on node \'ns_1@172.23.110.64\' in 7 seconds.'} 2021-02-19 04:57:06,197 | test | ERROR | pool-1-thread-5 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613739423602L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:03.602Z', u'text': u'Bucket "GleamBookUsers9" loaded on node \'ns_1@172.23.110.64\' in 7 seconds.'} 2021-02-19 04:57:06,197 | test | ERROR | pool-1-thread-5 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613739423525L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:03.525Z', u'text': u'Bucket "GleamBookUsers7" loaded on node \'ns_1@172.23.110.64\' in 6 seconds.'} 2021-02-19 04:57:06,197 | test | ERROR | pool-1-thread-5 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613739423301L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:03.301Z', u'text': u'Bucket "GleamBookUsers0" loaded on node \'ns_1@172.23.110.69\' in 10 seconds.'} 2021-02-19 04:57:06,197 | test | ERROR | pool-1-thread-5 | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613739423298L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:03.298Z', u'text': u'Bucket "GleamBookUsers9" loaded on node \'ns_1@172.23.110.69\' in 10 seconds.'} 2021-02-19 04:57:06,198 | test | ERROR | pool-1-thread-5 | [task:call:242] Rebalance Failed: {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 04:57:06,345 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 13.952073 2021-02-19 04:57:06,483 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 13.851652 2021-02-19 04:57:06,584 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 29.256757 2021-02-19 04:57:06,790 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9.850393 2021-02-19 04:57:07,232 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 14.149613 2021-02-19 04:57:07,499 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 14.353214 2021-02-19 04:57:07,546 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3.647811 2021-02-19 04:57:07,566 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 12.448834 2021-02-19 04:57:07,709 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 25.901685 2021-02-19 04:57:07,720 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 15.051595 2021-02-19 04:57:07,938 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 13.952073 2021-02-19 04:57:08,072 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 13.851652 2021-02-19 04:57:08,165 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 29.256757 2021-02-19 04:57:08,348 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9.850393 2021-02-19 04:57:08,819 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 14.149613 2021-02-19 04:57:09,079 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 14.353214 2021-02-19 04:57:09,122 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3.647811 2021-02-19 04:57:09,141 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 12.448834 2021-02-19 04:57:09,299 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 15.051595 2021-02-19 04:57:09,312 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 25.901685 2021-02-19 04:57:09,536 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 19.408405 2021-02-19 04:57:09,664 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 16.404683 2021-02-19 04:57:09,762 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 38.117771 2021-02-19 04:57:09,913 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 9.850393 2021-02-19 04:57:10,407 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 22.810386 2021-02-19 04:57:10,664 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 19.609546 2021-02-19 04:57:10,700 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 12.007204 2021-02-19 04:57:10,723 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 24.513208 2021-02-19 04:57:10,882 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 25.714409 2021-02-19 04:57:10,907 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 36.714409 2021-02-19 04:57:11,127 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 19.408405 2021-02-19 04:57:11,257 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 16.404683 2021-02-19 04:57:11,351 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 38.117771 2021-02-19 04:57:11,477 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 16.008105 2021-02-19 04:57:12,005 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 22.810386 2021-02-19 04:57:12,246 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 23.909546 2021-02-19 04:57:12,278 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 12.007204 2021-02-19 04:57:12,306 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 28.013208 2021-02-19 04:57:12,484 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 28.014409 2021-02-19 04:57:12,507 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 37.614409 2021-02-19 04:57:12,717 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 19.708405 2021-02-19 04:57:12,851 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 17.804683 2021-02-19 04:57:12,950 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 39.617771 2021-02-19 04:57:13,042 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 19.508105 2021-02-19 04:57:13,592 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 23.310386 2021-02-19 04:57:13,823 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 23.909546 2021-02-19 04:57:13,855 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 12.007204 2021-02-19 04:57:13,874 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 28.013208 2021-02-19 04:57:14,051 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 28.014409 2021-02-19 04:57:14,115 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 37.614409 2021-02-19 04:57:14,312 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 19.704803 2021-02-19 04:57:14,441 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 17.602281 2021-02-19 04:57:14,536 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 38.808165 2021-02-19 04:57:14,607 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 19.305703 2021-02-19 04:57:15,176 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 23.107985 2021-02-19 04:57:15,420 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 23.504743 2021-02-19 04:57:15,437 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 12.007204 2021-02-19 04:57:15,459 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 27.810806 2021-02-19 04:57:15,654 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 27.609606 2021-02-19 04:57:15,717 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 37.209606 2021-02-19 04:57:15,911 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 19.704803 2021-02-19 04:57:16,036 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 17.602281 2021-02-19 04:57:16,140 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 38.808165 2021-02-19 04:57:16,180 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 19.305703 2021-02-19 04:57:16,772 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 23.107985 2021-02-19 04:57:17,002 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 23.504743 2021-02-19 04:57:17,048 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 12.007204 2021-02-19 04:57:17,066 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 27.810806 2021-02-19 04:57:17,236 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 27.609606 2021-02-19 04:57:17,338 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 37.209606 2021-02-19 04:57:17,506 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 19.704803 2021-02-19 04:57:17,642 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 17.602281 2021-02-19 04:57:17,746 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 19.305703 2021-02-19 04:57:17,766 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 38.808165 2021-02-19 04:57:18,372 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 23.107985 2021-02-19 04:57:18,585 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 23.504743 2021-02-19 04:57:18,648 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 12.007204 2021-02-19 04:57:18,671 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 27.810806 2021-02-19 04:57:18,815 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 27.609606 2021-02-19 04:57:18,940 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 37.209606 2021-02-19 04:57:19,098 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 19.704803 2021-02-19 04:57:19,279 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 17.602281 2021-02-19 04:57:19,322 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 19.305703 2021-02-19 04:57:19,361 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 38.808165 2021-02-19 04:57:19,983 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 23.107985 2021-02-19 04:57:20,176 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 23.304623 2021-02-19 04:57:20,234 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 433.660196 2021-02-19 04:57:20,249 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 448.463198 2021-02-19 04:57:20,404 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 26.809125 2021-02-19 04:57:20,551 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 378.514389 2021-02-19 04:57:20,698 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 19.704803 2021-02-19 04:57:20,878 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 17.802401 2021-02-19 04:57:20,956 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 19.205643 2021-02-19 04:57:21,003 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 38.908225 2021-02-19 04:57:21,306 | test | ERROR | MainThread | [rest_client:_rebalance_status_and_progress:1494] {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed 2021-02-19 04:57:21,352 | test | INFO | MainThread | [rest_client:print_UI_logs:2599] Latest logs from UI on 172.23.110.64: 2021-02-19 04:57:21,352 | test | ERROR | MainThread | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613739431084L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:11.084Z', u'text': u"Control connection to memcached on 'ns_1@172.23.110.64' disconnected. Check logs for details. (repeated 9 times, last seen 26.469033 secs ago)"} 2021-02-19 04:57:21,354 | test | ERROR | MainThread | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_orchestrator', u'type': u'critical', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613739425457L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:05.457Z', u'text': u'Rebalance exited with reason {pre_rebalance_janitor_run_failed,\n "GleamBookUsers0",\n {error,wait_for_memcached_failed,\n [\'ns_1@172.23.110.64\']}}.\nRebalance Operation Id = 696ecc45e6947ed9311bea8d7db16b69'} 2021-02-19 04:57:21,354 | test | ERROR | MainThread | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613739425193L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:05.193Z', u'text': u'Bucket "GleamBookUsers0" loaded on node \'ns_1@172.23.110.64\' in 4 seconds.'} 2021-02-19 04:57:21,354 | test | ERROR | MainThread | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613739425034L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:05.034Z', u'text': u'Bucket "GleamBookUsers2" loaded on node \'ns_1@172.23.110.64\' in 7 seconds.'} 2021-02-19 04:57:21,354 | test | ERROR | MainThread | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613739423809L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:03.809Z', u'text': u'Bucket "GleamBookUsers8" loaded on node \'ns_1@172.23.110.69\' in 10 seconds.'} 2021-02-19 04:57:21,354 | test | ERROR | MainThread | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613739423656L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:03.656Z', u'text': u'Bucket "GleamBookUsers1" loaded on node \'ns_1@172.23.110.64\' in 8 seconds.'} 2021-02-19 04:57:21,355 | test | ERROR | MainThread | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613739423607L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:03.607Z', u'text': u'Bucket "GleamBookUsers3" loaded on node \'ns_1@172.23.110.64\' in 7 seconds.'} 2021-02-19 04:57:21,355 | test | ERROR | MainThread | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613739423602L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:03.602Z', u'text': u'Bucket "GleamBookUsers9" loaded on node \'ns_1@172.23.110.64\' in 7 seconds.'} 2021-02-19 04:57:21,355 | test | ERROR | MainThread | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.64', u'tstamp': 1613739423525L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:03.525Z', u'text': u'Bucket "GleamBookUsers7" loaded on node \'ns_1@172.23.110.64\' in 6 seconds.'} 2021-02-19 04:57:21,355 | test | ERROR | MainThread | [rest_client:print_UI_logs:2601] {u'code': 0, u'module': u'ns_memcached', u'type': u'info', u'node': u'ns_1@172.23.110.69', u'tstamp': 1613739423301L, u'shortText': u'message', u'serverTime': u'2021-02-19T04:57:03.301Z', u'text': u'Bucket "GleamBookUsers0" loaded on node \'ns_1@172.23.110.69\' in 10 seconds.'} ERROR2021-02-19 04:57:21,357 | infra | INFO | MainThread | [task_manager:shutdown:61] Running TaskManager shutdown 2021-02-19 04:57:21,361 | infra | INFO | MainThread | [task_manager:shutdown:61] Running TaskManager shutdown 2021-02-19 04:57:21,361 | infra | WARNING | MainThread | [cluster:shutdown:662] Cluster instance shutdown with force 2021-02-19 04:57:21,362 | infra | INFO | MainThread | [task_manager:abort_all_tasks:83] Stopping task Rebalance_task_IN=[172.23.110.65]_OUT=[172.23.110.69]_1613739411.21 2021-02-19 04:57:21,362 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers0' 2021-02-19 04:57:21,428 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:21,428 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers0' 2021-02-19 04:57:21,480 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:21,480 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers2' 2021-02-19 04:57:21,526 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:21,526 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers2' 2021-02-19 04:57:21,562 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:21,565 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers1' 2021-02-19 04:57:21,592 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 23.808405 2021-02-19 04:57:21,612 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:21,615 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers1' 2021-02-19 04:57:21,654 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:21,655 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers8' 2021-02-19 04:57:21,688 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:21,696 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers8' 2021-02-19 04:57:21,727 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:21,729 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers7' 2021-02-19 04:57:21,762 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 23.304623 2021-02-19 04:57:21,775 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:21,775 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers7' 2021-02-19 04:57:21,809 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:21,809 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers9' 2021-02-19 04:57:21,845 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:21,845 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers9' 2021-02-19 04:57:21,868 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 433.660196 2021-02-19 04:57:21,881 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 448.463198 2021-02-19 04:57:21,881 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:21,881 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers4' 2021-02-19 04:57:21,911 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:21,913 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers4' 2021-02-19 04:57:21,941 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:21,943 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers3' 2021-02-19 04:57:21,974 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:21,976 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers3' 2021-02-19 04:57:21,989 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 26.809125 2021-02-19 04:57:22,009 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:22,009 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers6' 2021-02-19 04:57:22,042 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:22,043 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers6' 2021-02-19 04:57:22,073 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:22,075 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers5' 2021-02-19 04:57:22,101 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:22,102 | test | DEBUG | MainThread | [sdk_client3:close:306] Closing SDK for bucket 'GleamBookUsers5' 2021-02-19 04:57:22,137 | test | DEBUG | MainThread | [sdk_client3:close:310] Cluster disconnected and env shutdown 2021-02-19 04:57:22,157 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 378.514389 2021-02-19 04:57:22,298 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 20.004803 2021-02-19 04:57:22,479 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 17.302401 2021-02-19 04:57:22,516 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:727] 172.23.110.64: No crash files found 2021-02-19 04:57:22,538 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 17.605643 2021-02-19 04:57:22,605 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 38.708225 2021-02-19 04:57:23,209 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 23.808405 2021-02-19 04:57:23,359 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 22.904623 2021-02-19 04:57:23,493 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1684.160196 2021-02-19 04:57:23,507 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 1396.963198 2021-02-19 04:57:23,563 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 26.809125 2021-02-19 04:57:23,805 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 1221.314389 2021-02-19 04:57:23,888 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 20.004803 2021-02-19 04:57:24,075 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 17.302401 2021-02-19 04:57:24,108 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 17.605643 2021-02-19 04:57:24,147 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:746] 172.23.110.64: No 'sanitizers.log.*' files found 2021-02-19 04:57:24,201 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 38.708225 2021-02-19 04:57:24,460 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:727] 172.23.110.65: No crash files found 2021-02-19 04:57:24,857 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 24.208405 2021-02-19 04:57:24,959 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 22.904623 2021-02-19 04:57:25,084 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1684.160196 2021-02-19 04:57:25,101 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2548.863198 2021-02-19 04:57:25,141 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 26.609125 2021-02-19 04:57:25,428 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2285.314389 2021-02-19 04:57:25,562 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 19.404803 2021-02-19 04:57:25,703 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 17.102401 2021-02-19 04:57:25,720 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 170.305643 2021-02-19 04:57:25,792 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 38.708225 2021-02-19 04:57:26,055 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:746] 172.23.110.65: No 'sanitizers.log.*' files found 2021-02-19 04:57:26,352 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:727] 172.23.110.66: No crash files found 2021-02-19 04:57:26,572 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:746] 172.23.110.66: No 'sanitizers.log.*' files found 2021-02-19 04:57:26,592 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 24.208405 2021-02-19 04:57:26,598 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 22.504623 2021-02-19 04:57:26,719 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2548.863198 2021-02-19 04:57:26,732 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3235.660196 2021-02-19 04:57:26,753 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 26.609125 2021-02-19 04:57:26,888 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:727] 172.23.110.67: No crash files found 2021-02-19 04:57:26,973 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:746] 172.23.110.67: No 'sanitizers.log.*' files found 2021-02-19 04:57:27,203 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 19.404803 2021-02-19 04:57:27,230 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2285.314389 2021-02-19 04:57:27,283 | test | CRITICAL | MainThread | [basetestcase:check_coredump_exist:718] 172.23.110.68: 1 core dump seen 2021-02-19 04:57:27,303 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 17.102401 2021-02-19 04:57:27,503 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 170.305643 2021-02-19 04:57:27,507 | test | CRITICAL | MainThread | [basetestcase:check_coredump_exist:719] 172.23.110.68: Stack Trace of first crash - 6416790e-4e6b-4af6-93a4a18b-9301eab5.dmp 2021-02-19 04:57:27,520 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 38.708225 2021-02-19 04:57:27,673 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:746] 172.23.110.68: No 'sanitizers.log.*' files found 2021-02-19 04:57:27,964 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:727] 172.23.110.69: No crash files found 2021-02-19 04:57:28,082 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:746] 172.23.110.69: No 'sanitizers.log.*' files found 2021-02-19 04:57:28,178 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 22.504623 2021-02-19 04:57:28,221 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 24.208405 2021-02-19 04:57:28,513 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 26.609125 2021-02-19 04:57:28,517 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2548.863198 2021-02-19 04:57:28,517 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3235.660196 2021-02-19 04:57:28,523 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:727] 172.23.110.70: No crash files found 2021-02-19 04:57:28,621 | test | DEBUG | MainThread | [basetestcase:check_coredump_exist:746] 172.23.110.70: No 'sanitizers.log.*' files found 2021-02-19 04:57:28,680 | test | WARNING | MainThread | [rest_client:get_nodes:1706] 172.23.110.65 - Node not part of cluster inactiveAdded 2021-02-19 04:57:28,698 | test | INFO | MainThread | [cluster_ready_functions:trigger_cb_collect_on_cluster:1079] Running cbcollect on node ns_1@172.23.110.64,ns_1@172.23.110.68,ns_1@172.23.110.69 2021-02-19 04:57:28,711 | test | DEBUG | MainThread | [rest_client:_http_request:728] {'date': 'Fri, 19 Feb 2021 12:57:27 GMT', 'content-length': '2', 'server': 'Couchbase Server', 'expires': 'Thu, 01 Jan 1970 00:00:00 GMT', 'x-frame-options': 'DENY', 'x-permitted-cross-domain-policies': 'none', 'pragma': 'no-cache', 'x-content-type-options': 'nosniff', 'x-xss-protection': '1; mode=block', 'connection': 'close', 'content-type': 'application/json', 'cache-control': 'no-cache,no-store,must-revalidate', 'status': '200'} 2021-02-19 04:57:28,711 | test | DEBUG | MainThread | [rest_client:_http_request:729] [] 2021-02-19 04:57:28,727 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: Wait for CB collect to start 2021-02-19 04:57:28,795 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 19.404803 2021-02-19 04:57:28,826 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2285.314389 2021-02-19 04:57:29,059 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 17.102401 2021-02-19 04:57:29,130 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 170.305643 2021-02-19 04:57:29,157 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 38.708225 2021-02-19 04:57:29,917 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 22.504623 2021-02-19 04:57:29,934 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 24.208405 2021-02-19 04:57:30,239 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2833.000000 2021-02-19 04:57:30,243 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 18.200000 2021-02-19 04:57:30,247 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3916.400000 2021-02-19 04:57:30,384 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 14.600000 2021-02-19 04:57:30,417 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2647.900000 2021-02-19 04:57:30,799 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 313.800000 2021-02-19 04:57:30,816 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 14.700000 2021-02-19 04:57:30,828 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 31.300000 2021-02-19 04:57:31,605 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 18.000000 2021-02-19 04:57:31,641 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 16.000000 2021-02-19 04:57:32,009 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 18.200000 2021-02-19 04:57:32,019 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 14.600000 2021-02-19 04:57:32,023 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2833.000000 2021-02-19 04:57:32,029 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 3916.400000 2021-02-19 04:57:32,046 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2647.900000 2021-02-19 04:57:32,572 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 464.400000 2021-02-19 04:57:32,584 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 23.200000 2021-02-19 04:57:32,602 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 6.700000 2021-02-19 04:57:33,177 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 11.600000 2021-02-19 04:57:33,270 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 11.300000 2021-02-19 04:57:33,661 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 14.800000 2021-02-19 04:57:33,663 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 2089.200000 2021-02-19 04:57:33,664 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 9.500000 2021-02-19 04:57:33,674 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 2971.700000 2021-02-19 04:57:33,684 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 2010.600000 2021-02-19 04:57:34,194 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 307.900000 2021-02-19 04:57:34,226 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8.000000 2021-02-19 04:57:34,236 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3.100000 2021-02-19 04:57:34,755 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4.400000 2021-02-19 04:57:34,875 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 11.300000 2021-02-19 04:57:35,308 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 7.400000 2021-02-19 04:57:35,312 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1420.200000 2021-02-19 04:57:35,315 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 933.500000 2021-02-19 04:57:35,316 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4.100000 2021-02-19 04:57:35,355 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 939.000000 2021-02-19 04:57:35,844 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 307.900000 2021-02-19 04:57:35,927 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8.000000 2021-02-19 04:57:35,947 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3.100000 2021-02-19 04:57:36,328 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4.400000 2021-02-19 04:57:36,464 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7.100000 2021-02-19 04:57:36,904 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 7.400000 2021-02-19 04:57:37,045 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 933.500000 2021-02-19 04:57:37,059 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4.100000 2021-02-19 04:57:37,072 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1420.200000 2021-02-19 04:57:37,073 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 939.000000 2021-02-19 04:57:37,426 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 307.900000 2021-02-19 04:57:37,631 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3.100000 2021-02-19 04:57:37,640 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8.000000 2021-02-19 04:57:37,915 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 4.400000 2021-02-19 04:57:38,055 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 7.100000 2021-02-19 04:57:38,474 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 7.400000 2021-02-19 04:57:38,746 | test | INFO | MainThread | [cluster_ready_functions:trigger_cb_collect_on_cluster:1082] ns_1@172.23.110.64,ns_1@172.23.110.68,ns_1@172.23.110.69 - cbcollect status: True 2021-02-19 04:57:38,746 | test | INFO | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1087] Polling active_tasks to check cbcollect status 2021-02-19 04:57:38,760 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 933.500000 2021-02-19 04:57:38,760 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 0 - running 2021-02-19 04:57:38,779 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 04:57:38,780 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 1420.200000 2021-02-19 04:57:38,782 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 939.000000 2021-02-19 04:57:38,783 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 4.100000 2021-02-19 04:57:38,986 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 307.900000 2021-02-19 04:57:39,348 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 8.000000 2021-02-19 04:57:39,354 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 3.100000 2021-02-19 04:57:39,592 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1.200000 2021-02-19 04:57:39,644 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1.300000 2021-02-19 04:57:40,148 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 04:57:40,450 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 210.700000 2021-02-19 04:57:40,466 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 305.800000 2021-02-19 04:57:40,470 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 219.100000 2021-02-19 04:57:40,480 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.900000 2021-02-19 04:57:40,592 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 155.000000 2021-02-19 04:57:41,051 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 1.700000 2021-02-19 04:57:41,052 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 1.500000 2021-02-19 04:57:41,168 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 1.200000 2021-02-19 04:57:41,322 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 1.300000 2021-02-19 04:57:41,713 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.600000 2021-02-19 04:57:42,167 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 210.700000 2021-02-19 04:57:42,167 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 219.100000 2021-02-19 04:57:42,176 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.900000 2021-02-19 04:57:42,178 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 305.800000 2021-02-19 04:57:42,194 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 155.000000 2021-02-19 04:57:42,742 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:57:42,750 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:57:42,750 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:57:42,999 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:57:43,278 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:57:43,572 | infra | INFO | pool-2-thread-20 | [task:complete_task:99] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers4_VolumeScope3_VolumeCollection2_ttl=1200_update_MAJORITY_0_1000000_1613733368.42' completed 2021-02-19 04:57:43,573 | infra | INFO | pool-2-thread-20 | [task:start_task:84] Thread 'LoadDocs_MutateDocsFromSpecTask_1613733368.03_GleamBookUsers8_VolumeScope2_VolumeCollection4_ttl=1200_update_MAJORITY_0_1000000_1613733368.43' started 2021-02-19 04:57:43,885 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:57:43,887 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:57:43,890 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:57:43,890 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:57:43,897 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:57:44,450 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:57:44,467 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:57:44,473 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:57:44,602 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:57:44,858 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:57:45,486 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:57:45,516 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:57:45,638 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:57:45,641 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:57:45,642 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:57:46,032 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:57:46,089 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:57:46,095 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:57:46,246 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:57:48,792 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 1 - running 2021-02-19 04:57:48,792 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:57:48,808 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 04:57:49,423 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:57:49,480 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:57:49,497 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:57:49,523 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:57:49,536 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:57:49,543 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:57:49,545 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:57:49,549 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:57:49,562 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:57:50,385 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:57:51,049 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:57:51,252 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:57:51,259 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:57:51,275 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:57:51,286 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:57:51,299 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:57:51,313 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:57:51,328 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:57:51,332 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:57:52,052 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:57:52,677 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:57:53,058 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:57:53,069 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:57:53,095 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:57:53,101 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:57:53,125 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:57:53,128 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:57:53,137 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:57:53,250 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:57:53,703 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:57:54,342 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:57:54,842 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:57:54,861 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:57:54,872 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:57:54,885 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:57:54,901 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:57:54,917 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:57:54,930 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:57:55,009 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:57:55,346 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:57:55,994 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:57:56,585 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:57:56,594 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:57:56,615 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:57:56,631 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:57:56,663 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:57:56,676 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:57:56,698 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:57:56,747 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:57:57,007 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:57:57,677 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:57:58,283 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:57:58,312 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:57:58,335 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:57:58,355 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:57:58,400 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:57:58,410 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:57:58,434 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:57:58,493 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:57:58,812 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:57:58,821 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 2 - running 2021-02-19 04:57:58,832 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 04:57:59,358 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:00,023 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:00,025 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:00,030 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:00,038 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:00,072 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:00,085 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:00,130 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:00,151 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:00,431 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:00,993 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:01,647 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:01,688 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:01,842 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:01,848 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:01,861 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:01,872 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:01,882 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:01,884 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:02,073 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:02,592 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:03,397 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:03,426 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:03,517 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:03,517 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:03,532 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:03,670 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:03,681 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:03,694 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:03,698 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:04,270 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:04,992 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:05,040 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:05,244 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:05,259 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:05,283 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:05,354 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:05,375 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:05,375 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:05,388 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:05,871 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:06,599 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:06,648 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:06,887 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:06,907 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:06,924 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:07,000 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:07,026 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:07,026 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:07,042 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:07,476 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:08,226 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:08,263 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:08,546 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:08,551 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:08,619 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:08,648 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:08,671 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:08,697 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:08,720 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:08,851 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 3 - running 2021-02-19 04:58:08,864 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 04:58:09,085 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:09,973 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:09,990 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:10,335 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:10,351 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:10,361 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:10,362 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:10,375 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:10,381 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:10,408 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:10,710 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:11,598 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:11,612 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:11,987 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:12,039 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:12,059 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:12,063 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:12,085 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:12,223 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:12,230 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:12,316 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:13,252 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:13,259 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:13,625 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:13,663 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:13,803 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:13,815 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:13,851 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:13,875 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:13,881 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:13,983 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:14,865 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:14,884 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:15,232 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:15,270 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:15,427 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:15,493 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:15,532 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:15,553 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:15,558 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:15,690 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:16,604 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:16,845 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:17,000 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:17,049 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:17,144 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:17,200 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:17,209 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:17,213 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:17,318 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:17,572 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:18,223 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:18,584 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:18,628 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:18,697 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:18,796 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:18,950 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 4 - running 2021-02-19 04:58:18,956 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:18,964 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:18,969 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 04:58:18,969 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:18,976 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:19,177 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:19,901 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:20,229 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:20,280 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:20,312 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:20,522 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:20,602 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:20,615 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:20,627 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:20,648 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:20,869 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:21,519 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:21,836 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:21,904 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:21,946 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:22,148 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:22,242 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:22,252 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:22,260 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:22,321 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:22,480 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:23,131 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:23,486 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:23,555 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:23,607 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:23,796 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:23,862 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:23,878 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:23,951 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:23,983 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:24,095 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:29,913 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 5 - running 2021-02-19 04:58:29,918 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:29,923 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:29,923 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:29,931 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 04:58:29,931 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:30,519 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:30,539 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:30,611 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:30,618 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:30,634 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:30,640 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:31,592 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:31,608 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:31,621 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:31,645 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:32,302 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:32,308 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:32,315 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:32,321 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:32,326 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:32,328 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:33,256 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:33,259 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:33,263 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:33,269 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:33,950 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:33,957 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:33,977 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:33,996 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:33,996 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:34,013 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:34,890 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:34,911 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:34,937 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:34,970 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:35,625 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:35,630 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:35,654 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:35,665 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:35,670 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:35,680 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:36,532 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:36,542 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:36,555 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:36,605 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:37,266 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:37,319 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:37,332 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:37,335 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:37,346 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:37,362 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:38,240 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:38,256 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:38,266 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:38,308 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:38,897 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:38,954 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:39,000 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:39,009 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:39,009 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:39,043 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:39,842 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:39,885 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:39,898 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:39,904 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:39,950 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 6 - running 2021-02-19 04:58:39,963 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 04:58:40,543 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:40,635 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:40,648 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:40,674 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:40,686 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:40,701 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:41,482 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:41,503 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:41,526 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:41,536 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:42,266 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:42,313 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:42,336 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:42,358 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:42,368 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:42,382 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:43,118 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:43,286 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:43,288 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:43,292 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:43,938 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:43,969 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:43,984 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:44,016 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:44,042 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:44,055 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:44,743 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:44,917 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:44,923 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:44,937 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:45,546 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:45,608 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:45,631 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:45,637 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:45,664 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:45,674 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:46,349 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:46,556 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:46,561 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:46,585 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:47,178 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:47,378 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:47,403 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:47,403 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:47,407 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:47,414 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:47,966 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:48,198 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:48,217 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:48,223 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:48,790 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:49,012 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:49,023 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:49,032 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:49,053 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:49,055 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:49,566 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:49,805 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:49,834 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:49,842 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:49,974 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 7 - running 2021-02-19 04:58:49,990 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 04:58:50,411 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:50,654 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:50,686 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:50,688 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:50,696 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:50,724 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:51,617 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:51,655 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:51,670 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:51,765 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:52,456 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:52,473 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:52,473 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:52,473 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:52,484 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:53,006 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:53,226 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:53,269 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:53,285 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:53,450 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:54,131 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:54,154 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:54,155 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:54,171 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:54,197 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:54,604 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:54,838 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:54,884 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:54,888 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:55,052 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:55,823 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:55,845 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:55,851 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:55,868 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:55,871 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:56,198 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:56,483 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:56,493 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:56,505 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:56,657 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:57,503 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:57,503 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:57,503 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:57,549 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:57,563 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:57,803 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:58,099 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:58,107 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:58,115 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:58,253 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:58:59,144 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:58:59,165 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:58:59,184 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:58:59,187 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:58:59,190 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:58:59,461 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:58:59,760 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:58:59,770 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:58:59,792 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:58:59,849 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:00,007 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 8 - running 2021-02-19 04:59:00,022 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 04:59:00,786 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:00,806 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:00,836 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:00,841 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:00,858 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:01,063 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:01,375 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:01,421 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:01,443 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:01,503 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:02,404 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:02,427 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:02,476 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:02,494 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:02,507 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:02,678 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:03,003 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:03,055 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:03,065 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:03,250 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:04,023 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:04,226 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:04,255 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:04,255 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:04,256 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:04,292 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:04,607 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:04,670 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:04,686 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:04,857 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:05,648 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:05,881 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:05,890 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:05,910 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:05,920 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:05,924 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:13,848 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 9 - running 2021-02-19 04:59:13,865 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 04:59:13,869 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:13,871 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:13,874 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:13,874 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:14,461 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:14,461 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:14,477 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:14,503 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:14,520 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:14,530 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:15,497 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:15,513 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:15,519 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:15,530 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:16,098 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:16,128 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:16,135 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:16,140 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:16,176 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:16,190 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:17,232 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:17,252 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:17,269 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:17,282 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:17,729 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:17,755 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:17,760 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:17,776 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:17,793 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:17,805 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:18,852 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:18,868 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:18,881 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:18,924 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:19,384 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:19,444 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:19,469 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:19,471 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:19,586 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:19,595 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:20,585 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:20,585 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:20,588 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:20,588 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:20,990 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:21,190 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:21,226 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:21,242 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:21,247 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:21,250 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:22,207 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:22,224 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:22,237 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:22,243 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:22,588 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:22,838 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:22,859 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:22,861 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:22,869 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:22,884 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:23,842 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:23,865 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:23,878 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 10 - running 2021-02-19 04:59:23,881 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:23,892 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 04:59:23,937 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:24,197 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:24,473 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:24,484 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:24,507 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:24,536 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:24,539 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:25,459 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:25,466 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:25,526 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:25,599 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:25,799 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:26,101 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:26,112 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:26,144 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:26,154 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:26,164 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:27,088 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:27,098 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:27,134 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:27,217 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:27,414 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:27,732 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:27,759 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:27,780 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:27,785 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:27,808 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:28,700 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:28,723 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:28,733 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:28,818 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:29,039 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:29,365 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:29,371 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:29,403 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:29,415 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:29,423 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:30,403 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:30,405 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:30,408 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:30,427 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:30,637 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:30,996 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:31,017 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:31,043 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:31,046 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:31,063 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:32,030 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:32,039 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:32,053 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:32,063 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:32,247 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:32,605 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:32,628 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:32,667 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:32,690 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:32,693 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:33,654 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:33,664 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:33,690 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:33,691 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:33,858 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:33,905 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 11 - running 2021-02-19 04:59:33,921 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 04:59:34,240 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:34,250 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:34,427 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:34,440 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:34,441 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:35,285 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:35,295 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:35,302 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:35,443 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:35,461 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:35,846 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:35,881 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:36,081 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:36,101 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:36,114 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:36,943 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:37,081 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:37,098 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:37,109 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:37,128 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:37,444 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:37,480 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:37,690 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:37,709 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:37,723 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:38,540 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:38,721 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:38,730 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:38,759 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:38,760 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:39,052 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:39,078 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:39,368 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:39,368 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:39,371 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:40,290 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:40,342 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:40,374 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:40,377 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:40,388 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:40,711 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:40,733 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:40,980 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:41,006 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:41,025 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:41,905 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:41,950 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:41,982 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:42,022 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:42,032 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:42,305 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:42,322 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:42,588 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:42,604 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:42,618 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:43,895 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:43,898 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:43,930 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:43,937 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 12 - running 2021-02-19 04:59:43,944 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:43,946 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:43,953 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 04:59:43,970 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:43,973 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:44,207 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:44,221 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:44,240 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:45,540 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:45,548 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:45,586 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:45,608 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:45,611 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:45,625 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:45,644 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:45,857 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:45,858 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:45,877 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:47,161 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:47,213 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:47,239 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:47,250 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:47,263 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:47,276 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:47,460 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:47,496 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:47,499 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 04:59:47,500 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:48,776 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 04:59:48,844 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 04:59:48,891 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 04:59:48,901 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 04:59:48,914 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 04:59:49,082 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 04:59:49,102 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 04:59:49,115 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 04:59:49,150 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 04:59:49,151 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:00:00,493 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 13 - running 2021-02-19 05:00:00,507 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 05:00:01,151 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:00:01,174 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:00:01,187 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:00:01,196 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:00:01,217 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:00:01,223 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:00:01,226 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:00:01,239 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:00:01,250 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:00:01,266 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:00:02,829 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:00:02,864 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:00:02,880 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:00:02,884 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:00:02,888 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:00:02,936 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:00:02,947 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:00:02,951 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:00:02,957 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:00:02,966 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:00:04,507 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:00:04,507 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:00:04,552 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:00:04,562 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:00:04,584 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:00:04,625 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:00:04,638 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:00:04,648 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:00:04,651 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:00:04,680 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:00:06,207 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:00:06,214 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:00:06,246 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:00:06,263 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:00:06,290 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:00:06,293 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:00:06,312 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:00:06,325 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:00:06,335 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:00:06,338 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:00:07,868 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:00:07,921 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:00:07,930 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:00:07,947 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:00:07,997 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:00:08,002 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:00:08,003 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:00:08,012 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:00:08,026 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:00:08,042 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:00:09,523 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:00:09,558 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:00:09,578 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:00:09,628 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:00:09,661 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:00:09,703 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:00:09,703 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:00:09,716 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:00:09,726 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:00:09,740 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:00:10,528 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 14 - running 2021-02-19 05:00:10,543 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 05:00:11,161 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:00:11,181 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:00:11,234 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:00:11,273 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:00:11,523 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:00:11,528 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:00:11,528 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:00:11,535 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:00:11,536 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:00:11,546 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:00:27,240 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 15 - running 2021-02-19 05:00:27,244 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:00:27,249 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:00:27,252 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:00:27,259 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 05:00:27,259 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:00:27,861 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:00:27,878 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:00:27,884 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:00:27,898 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:00:27,901 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:00:27,923 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:00:38,345 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 16 - running 2021-02-19 05:00:38,361 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 05:00:38,993 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:00:39,020 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:00:39,020 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:00:39,028 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:00:39,056 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:00:39,059 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:00:39,085 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:00:39,098 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:00:39,098 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:00:39,105 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:00:54,914 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 17 - running 2021-02-19 05:00:54,930 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 05:00:55,569 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:00:55,599 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:00:55,602 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:00:55,625 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:00:55,638 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:00:55,645 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:00:55,657 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:00:55,680 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:00:55,687 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:00:55,696 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:01:11,486 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 18 - running 2021-02-19 05:01:11,502 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 05:01:12,151 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:01:12,157 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:01:12,177 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:01:12,177 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:01:12,190 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:01:12,197 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:01:12,227 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:01:12,229 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:01:12,260 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:01:12,260 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:01:27,785 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 19 - running 2021-02-19 05:01:27,796 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 05:01:28,417 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:01:28,444 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:01:28,447 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:01:28,473 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:01:28,493 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:01:28,505 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:01:28,506 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:01:28,513 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:01:44,144 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 20 - running 2021-02-19 05:01:44,160 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 05:01:44,799 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:01:44,816 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:01:44,829 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:01:44,845 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:01:44,845 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:01:44,874 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:01:44,875 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:01:44,892 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:01:44,907 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:02:00,619 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:02:00,641 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 21 - running 2021-02-19 05:02:00,654 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 05:02:01,288 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:02:01,308 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:02:01,319 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:02:01,323 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:02:01,351 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:02:01,364 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:02:01,375 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:02:01,398 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:02:01,401 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:02:17,296 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 22 - running 2021-02-19 05:02:17,312 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 05:02:17,964 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:02:17,982 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:02:17,990 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:02:18,015 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:02:18,015 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:02:18,016 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:02:18,023 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:02:33,940 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 23 - running 2021-02-19 05:02:33,944 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:02:33,946 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:02:33,947 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:02:33,960 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 05:02:34,555 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:02:34,585 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:02:34,602 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:02:34,627 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:02:34,654 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:02:34,655 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:02:34,663 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:02:50,549 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 24 - running 2021-02-19 05:02:50,562 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 05:02:51,221 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:02:51,229 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:02:51,239 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:02:51,267 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:03:07,247 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:03:07,263 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:03:07,266 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:03:07,276 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:03:07,279 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 25 - running 2021-02-19 05:03:07,286 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:03:07,289 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:03:07,295 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 05:03:07,888 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:03:07,913 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:03:07,931 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:03:07,934 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:03:23,775 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 26 - running 2021-02-19 05:03:23,790 | infra | INFO | MainThread | [common_lib:sleep:22] Sleep 10 seconds. Reason: CB collect still running 2021-02-19 05:03:24,440 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:03:24,450 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:03:24,470 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:03:24,473 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:03:40,467 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:03:40,470 | test | DEBUG | MainThread | [cluster_ready_functions:wait_for_cb_collect_to_complete:1094] CBCollectInfo Iteration 27 - completed 2021-02-19 05:03:40,471 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:03:40,486 | test | DEBUG | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1110] {u'perNode': {u'ns_1@172.23.110.69': {u'path': u'/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-02-19T125728-ns_1@172.23.110.69.zip', u'status': u'collected'}, u'ns_1@172.23.110.68': {u'path': u'/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-02-19T125728-ns_1@172.23.110.68.zip', u'status': u'collected'}, u'ns_1@172.23.110.64': {u'path': u'/opt/couchbase/var/lib/couchbase/tmp/collectinfo-2021-02-19T125728-ns_1@172.23.110.64.zip', u'status': u'collected'}}, u'type': u'clusterLogsCollection', u'node': u'ns_1@172.23.110.64', u'progress': 100, u'ts': u'2021-02-19 12:57:28', u'status': u'completed'} 2021-02-19 05:03:40,486 | test | INFO | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1114] ns_1@172.23.110.64: Copying cbcollect ZIP file to Client 2021-02-19 05:03:40,489 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:03:40,494 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:03:40,500 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:03:40,507 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:03:41,078 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:03:41,092 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:03:57,198 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:03:57,213 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:03:57,848 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:03:57,869 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:03:57,882 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:03:57,898 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:04:14,069 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:04:14,073 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:04:14,102 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:04:14,111 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:04:14,545 | test | ERROR | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1135] 172.23.110.64 node cb collect zip copied on client : True 2021-02-19 05:04:14,546 | test | INFO | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1114] ns_1@172.23.110.68: Copying cbcollect ZIP file to Client 2021-02-19 05:04:14,703 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:04:14,711 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:04:14,730 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:04:14,740 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:04:14,750 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:04:47,976 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:04:47,986 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:04:48,016 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:04:48,019 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:04:48,023 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:04:48,029 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:04:48,032 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:04:48,035 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:04:48,038 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:04:48,043 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:04:48,164 | test | ERROR | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1135] 172.23.110.68 node cb collect zip copied on client : True 2021-02-19 05:04:48,164 | test | INFO | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1114] ns_1@172.23.110.69: Copying cbcollect ZIP file to Client 2021-02-19 05:05:21,937 | test | DEBUG | pool-2-thread-8 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers7': 0.000000 2021-02-19 05:05:21,947 | test | DEBUG | pool-2-thread-4 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers1': 0.000000 2021-02-19 05:05:21,953 | test | DEBUG | pool-2-thread-5 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers8': 0.000000 2021-02-19 05:05:21,957 | test | DEBUG | pool-2-thread-2 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers5': 0.000000 2021-02-19 05:05:21,963 | test | DEBUG | pool-2-thread-7 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers3': 0.000000 2021-02-19 05:05:21,969 | test | DEBUG | pool-2-thread-6 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers2': 0.000000 2021-02-19 05:05:21,971 | test | DEBUG | pool-2-thread-3 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers9': 0.000000 2021-02-19 05:05:21,973 | test | DEBUG | pool-2-thread-9 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers6': 0.000000 2021-02-19 05:05:21,977 | test | DEBUG | pool-2-thread-10 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers0': 0.000000 2021-02-19 05:05:21,983 | test | DEBUG | pool-2-thread-11 | [task:record_bucket_ops:3418] Ops rate for 'GleamBookUsers4': 0.000000 2021-02-19 05:05:22,181 | test | ERROR | MainThread | [cluster_ready_functions:copy_cb_collect_logs:1135] 172.23.110.69 node cb collect zip copied on client : True 2021-02-19 05:05:22,211 | test | WARNING | MainThread | [basetestcase:tearDownEverything:466] CLEANUP WAS SKIPPED 2021-02-19 05:05:22,211 | infra | INFO | MainThread | [basetestcase:tearDownEverything:508] ========== tasks in thread pool ========== 2021-02-19 05:05:22,211 | infra | INFO | MainThread | [basetestcase:tearDownEverything:510] ========================================== 2021-02-19 05:05:22,213 | infra | INFO | MainThread | [task_manager:shutdown:61] Running TaskManager shutdown 2021-02-19 05:05:22,213 | infra | INFO | MainThread | [task_manager:shutdown:61] Running TaskManager shutdown 2021-02-19 05:05:22,213 | infra | WARNING | MainThread | [cluster:shutdown:662] Cluster instance shutdown with force ERROR ====================================================================== ERROR: SystemTestMagma (volumetests.Magma.volume) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/volumetests/Magma.py", line 1876, in SystemTestMagma rebalance_task = self.abort_rebalance(rebalance_task, "kill_memcached") File "pytests/volumetests/Magma.py", line 906, in abort_rebalance reached = RestHelper(rest).rebalance_reached(expected_progress, File "lib/membase/api/rest_client.py", line 86, in rebalance_reached progress = self.rest._rebalance_progress() File "lib/membase/api/rest_client.py", line 1527, in _rebalance_progress return self._rebalance_status_and_progress()[1] File "lib/membase/api/rest_client.py", line 1496, in _rebalance_status_and_progress raise RebalanceFailedException(msg) RebalanceFailedException: Rebalance Failed: {u'errorMessage': u'Rebalance failed. See logs for detailed reason. You can try again.', u'status': u'none'} - rebalance failed ====================================================================== ERROR: SystemTestMagma (volumetests.Magma.volume) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/volumetests/Magma.py", line 197, in tearDown BaseTestCase.tearDown(self) File "pytests/basetestcase.py", line 447, in tearDown self.assertFalse(result, msg="Cb_log file validation failed") AssertionError: Cb_log file validation failed ---------------------------------------------------------------------- Ran 1 test in 6902.343s During the test, Remote Connections: 352, Disconnections: 352 SDK Connections: 20, Disconnections: 20 FAILED (errors=2) summary so far suite volumetests.Magma.volume , pass 0 , fail 1 failures so far... volumetests.Magma.volume.SystemTestMagma testrunner logs, diags and results are available under /data/workspace/magma_temp_job2/logs/testrunner-21-Feb-19_03-10-18/test_1 Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 1h 55m 20s 2 actionable tasks: 2 executed [description-setter] Could not determine description. Archiving artifacts Recording test results Build step 'Publish JUnit test result report' changed build result to UNSTABLE [description-setter] Description set: 7.0.0-4498 [BFA] Scanning build for known causes... [BFA] No failure causes found [BFA] Done. 0s Notifying upstream projects of job completion Email was triggered for: Unstable (Test Failures) Sending email for trigger: Unstable (Test Failures) An attempt to send an e-mail to empty list of recipients, ignored. Finished: UNSTABLE