[2019-04-08 10:16:14,314] - [rest_client] [139711490512640] - INFO - /diag/eval status on 172.23.107.160:8091: True content: "/opt/couchbase/var/lib/couchbase/logs" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))). [2019-04-08 10:16:14,318] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.160 with username:root [2019-04-08 10:16:14,477] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.160 [2019-04-08 10:16:14,679] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:15,159] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.160: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/goxdcr.log* [2019-04-08 10:16:15,208] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 10:16:15,322] - [xdcrnewbasetests] [139711490512640] - INFO - 0 [2019-04-08 10:16:15,325] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.160 with username:root [2019-04-08 10:16:15,481] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.160 [2019-04-08 10:16:15,684] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:16,114] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.160: zgrep "non-recoverable error from xmem client. response status=KEY_ENOENT" "/opt/couchbase/var/lib/couchbase/logs"/goxdcr.log* [2019-04-08 10:16:16,212] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 10:16:16,326] - [xdcrnewbasetests] [139711490512640] - INFO - 0 [2019-04-08 10:16:16,329] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.184 with username:root [2019-04-08 10:16:16,506] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.184 [2019-04-08 10:16:16,892] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:17,333] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.184: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/goxdcr.log* [2019-04-08 10:16:17,382] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 10:16:17,496] - [xdcrnewbasetests] [139711490512640] - INFO - 0 [2019-04-08 10:16:17,499] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.184 with username:root [2019-04-08 10:16:17,670] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.184 [2019-04-08 10:16:18,080] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:18,496] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.184: zgrep "non-recoverable error from xmem client. response status=KEY_ENOENT" "/opt/couchbase/var/lib/couchbase/logs"/goxdcr.log* [2019-04-08 10:16:18,562] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 10:16:18,676] - [xdcrnewbasetests] [139711490512640] - INFO - 0 [2019-04-08 10:16:18,679] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.190 with username:root [2019-04-08 10:16:18,840] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.190 [2019-04-08 10:16:19,040] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:19,482] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.190: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/goxdcr.log* [2019-04-08 10:16:19,581] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 10:16:19,695] - [xdcrnewbasetests] [139711490512640] - INFO - 0 [2019-04-08 10:16:19,698] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.190 with username:root [2019-04-08 10:16:19,854] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.190 [2019-04-08 10:16:20,081] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:20,507] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.190: zgrep "non-recoverable error from xmem client. response status=KEY_ENOENT" "/opt/couchbase/var/lib/couchbase/logs"/goxdcr.log* [2019-04-08 10:16:20,606] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 10:16:20,720] - [xdcrnewbasetests] [139711490512640] - INFO - 0 [2019-04-08 10:16:20,723] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.191 with username:root [2019-04-08 10:16:20,885] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.191 [2019-04-08 10:16:21,081] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:21,524] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.191: zgrep "panic:" "/opt/couchbase/var/lib/couchbase/logs"/goxdcr.log* [2019-04-08 10:16:21,613] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 10:16:21,727] - [xdcrnewbasetests] [139711490512640] - INFO - 0 [2019-04-08 10:16:21,730] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.191 with username:root [2019-04-08 10:16:21,890] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.191 [2019-04-08 10:16:22,111] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:22,535] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.191: zgrep "non-recoverable error from xmem client. response status=KEY_ENOENT" "/opt/couchbase/var/lib/couchbase/logs"/goxdcr.log* [2019-04-08 10:16:22,617] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 10:16:22,731] - [xdcrnewbasetests] [139711490512640] - INFO - 0 [2019-04-08 10:16:22,732] - [xdcrnewbasetests] [139711490512640] - INFO - {'172.23.107.160': {'non-recoverable error from xmem client. response status=KEY_ENOENT': 0, 'panic:': 0}, '172.23.107.184': {'non-recoverable error from xmem client. response status=KEY_ENOENT': 0, 'panic:': 0}, '172.23.107.191': {'non-recoverable error from xmem client. response status=KEY_ENOENT': 0, 'panic:': 0}, '172.23.107.190': {'non-recoverable error from xmem client. response status=KEY_ENOENT': 0, 'panic:': 0}} [2019-04-08 10:16:22,746] - [rest_client] [139711490512640] - INFO - /diag/eval status on 172.23.107.160:8091: True content: "/opt/couchbase/var/lib/couchbase/logs" command: filename:absname(element(2, application:get_env(ns_server,error_logger_mf_dir))). [2019-04-08 10:16:22,748] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.160 with username:root [2019-04-08 10:16:22,907] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.160 [2019-04-08 10:16:23,115] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:23,548] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.160: zgrep "Try to fix Pipeline" "/opt/couchbase/var/lib/couchbase/logs"/goxdcr.log* [2019-04-08 10:16:23,647] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 10:16:23,761] - [xdcrnewbasetests] [139711490512640] - INFO - 0 [2019-04-08 10:16:23,764] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.184 with username:root [2019-04-08 10:16:23,940] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.184 [2019-04-08 10:16:24,353] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:24,774] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.184: zgrep "Try to fix Pipeline" "/opt/couchbase/var/lib/couchbase/logs"/goxdcr.log* [2019-04-08 10:16:24,840] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 10:16:24,955] - [xdcrnewbasetests] [139711490512640] - INFO - 0 [2019-04-08 10:16:24,958] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.190 with username:root [2019-04-08 10:16:25,117] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.190 [2019-04-08 10:16:25,301] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:25,727] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.190: zgrep "Try to fix Pipeline" "/opt/couchbase/var/lib/couchbase/logs"/goxdcr.log* [2019-04-08 10:16:25,825] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 10:16:25,939] - [xdcrnewbasetests] [139711490512640] - INFO - 0 [2019-04-08 10:16:25,942] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.191 with username:root [2019-04-08 10:16:26,102] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.191 [2019-04-08 10:16:26,323] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:26,749] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.191: zgrep "Try to fix Pipeline" "/opt/couchbase/var/lib/couchbase/logs"/goxdcr.log* [2019-04-08 10:16:26,847] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 10:16:26,961] - [xdcrnewbasetests] [139711490512640] - INFO - 0 [2019-04-08 10:16:26,962] - [xdcrnewbasetests] [139711490512640] - INFO - {'172.23.107.160': 0, '172.23.107.184': 0, '172.23.107.191': 0, '172.23.107.190': 0} [2019-04-08 10:16:26,963] - [xdcrnewbasetests] [139711490512640] - INFO - ==== XDCRNewbasetests setup is started for test #4 load_with_async_ops ==== [2019-04-08 10:16:26,965] - [xdcrnewbasetests] [139711490512640] - INFO - removing xdcr/nodes settings [2019-04-08 10:16:27,005] - [xdcrnewbasetests] [139711490512640] - INFO - cleanup [ip:172.23.107.160 port:8091 ssh_username:root, ip:172.23.107.184 port:8091 ssh_username:root] [2019-04-08 10:16:27,048] - [cluster_helper] [139711490512640] - INFO - waiting for ns_server @ 172.23.107.160:8091 [2019-04-08 10:16:27,054] - [cluster_helper] [139711490512640] - INFO - ns_server @ 172.23.107.160:8091 is running [2019-04-08 10:16:27,096] - [cluster_helper] [139711490512640] - INFO - waiting for ns_server @ 172.23.107.184:8091 [2019-04-08 10:16:27,103] - [cluster_helper] [139711490512640] - INFO - ns_server @ 172.23.107.184:8091 is running [2019-04-08 10:16:27,103] - [xdcrnewbasetests] [139711490512640] - INFO - removing xdcr/nodes settings [2019-04-08 10:16:27,135] - [xdcrnewbasetests] [139711490512640] - INFO - cleanup [ip:172.23.107.190 port:8091 ssh_username:root, ip:172.23.107.191 port:8091 ssh_username:root] [2019-04-08 10:16:27,175] - [cluster_helper] [139711490512640] - INFO - waiting for ns_server @ 172.23.107.190:8091 [2019-04-08 10:16:27,183] - [cluster_helper] [139711490512640] - INFO - ns_server @ 172.23.107.190:8091 is running [2019-04-08 10:16:27,225] - [cluster_helper] [139711490512640] - INFO - waiting for ns_server @ 172.23.107.191:8091 [2019-04-08 10:16:27,234] - [cluster_helper] [139711490512640] - INFO - ns_server @ 172.23.107.191:8091 is running [2019-04-08 10:16:27,235] - [xdcrnewbasetests] [139711490512640] - INFO - Initializing all clusters... [2019-04-08 10:16:27,247] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.160 with username:root [2019-04-08 10:16:27,408] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.160 [2019-04-08 10:16:27,642] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:28,087] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.160: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' [2019-04-08 10:16:28,336] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 10:16:28,336] - [xdcrnewbasetests] [139711490512640] - INFO - Enabled diag/eval for non-local hosts from 172.23.107.160 [2019-04-08 10:16:28,456] - [rest_client] [139711490512640] - INFO - /diag/eval status on 172.23.107.160:8091: True content: [6,5] command: cluster_compat_mode:get_compat_version(). [2019-04-08 10:16:28,980] - [task] [139711473727232] - INFO - server: ip:172.23.107.160 port:8091 ssh_username:root, nodes/self: {'ip': u'172.23.107.160', 'availableStorage': [], 'rest_username': '', 'id': u'ns_1@172.23.107.160', 'uptime': u'865', 'mcdMemoryReserved': 6053, 'storageTotalRam': 7567, 'hostname': u'172.23.107.160:8091', 'storage': [], 'moxi': 11211, 'port': u'8091', 'version': u'6.5.0-2881-enterprise', 'memcached': 11210, 'status': u'healthy', 'clusterCompatibility': 393221, 'curr_items': 0, 'services': [u'fts', u'index', u'kv', u'n1ql'], 'rest_password': '', 'clusterMembership': u'active', 'memoryFree': 6936702976, 'memoryTotal': 7934996480, 'memoryQuota': 4035, 'mcdMemoryAllocated': 6053, 'os': u'x86_64-unknown-linux-gnu', 'ports': []} [2019-04-08 10:16:28,989] - [rest_client] [139711473727232] - INFO - pools/default params : memoryQuota=4035 [2019-04-08 10:16:28,997] - [rest_client] [139711473727232] - INFO - settings/web params on 172.23.107.160:8091:username=Administrator&password=password&port=8091 [2019-04-08 10:16:29,068] - [remote_util] [139711473727232] - INFO - connecting to 172.23.107.160 with username:root [2019-04-08 10:16:29,230] - [remote_util] [139711473727232] - INFO - Connected to 172.23.107.160 [2019-04-08 10:16:29,457] - [remote_util] [139711473727232] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:29,902] - [remote_util] [139711473727232] - INFO - running command.raw on 172.23.107.160: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' [2019-04-08 10:16:30,151] - [remote_util] [139711473727232] - INFO - command executed successfully [2019-04-08 10:16:30,156] - [rest_client] [139711473727232] - INFO - /diag/eval status on 172.23.107.160:8091: True content: [6,5] command: cluster_compat_mode:get_compat_version(). [2019-04-08 10:16:30,157] - [rest_client] [139711473727232] - INFO - settings/indexes params : storageMode=forestdb [2019-04-08 10:16:30,161] - [rest_client] [139711473727232] - ERROR - POST http://172.23.107.160:8091/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Accept': '*/*', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==\n'} error: 400 reason: unknown {"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}} auth: Administrator:password [2019-04-08 10:16:30,251] - [task] [139711473727232] - INFO - server: ip:172.23.107.184 port:8091 ssh_username:root, nodes/self: {'ip': u'172.23.107.184', 'availableStorage': [], 'rest_username': '', 'id': u'ns_1@172.23.107.184', 'uptime': u'859', 'mcdMemoryReserved': 6250, 'storageTotalRam': 7812, 'hostname': u'172.23.107.184:8091', 'storage': [], 'moxi': 11211, 'port': u'8091', 'version': u'6.5.0-2881-enterprise', 'memcached': 11210, 'status': u'healthy', 'clusterCompatibility': 393221, 'curr_items': 0, 'services': [u'kv'], 'rest_password': '', 'clusterMembership': u'active', 'memoryFree': 7631339520, 'memoryTotal': 8192135168, 'memoryQuota': 4021, 'mcdMemoryAllocated': 6250, 'os': u'x86_64-unknown-linux-gnu', 'ports': []} [2019-04-08 10:16:30,256] - [rest_client] [139711473727232] - ERROR - GET http://172.23.107.184:8091/pools/default body: headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Accept': '*/*', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==\n'} error: 404 reason: unknown "unknown pool" auth: Administrator:password [2019-04-08 10:16:30,256] - [rest_client] [139711473727232] - INFO - pools/default params : memoryQuota=4166 [2019-04-08 10:16:30,262] - [rest_client] [139711473727232] - INFO - settings/web params on 172.23.107.184:8091:username=Administrator&password=password&port=8091 [2019-04-08 10:16:30,319] - [remote_util] [139711473727232] - INFO - connecting to 172.23.107.184 with username:root [2019-04-08 10:16:30,491] - [remote_util] [139711473727232] - INFO - Connected to 172.23.107.184 [2019-04-08 10:16:30,936] - [remote_util] [139711473727232] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:31,391] - [remote_util] [139711473727232] - INFO - running command.raw on 172.23.107.184: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' [2019-04-08 10:16:31,440] - [remote_util] [139711473727232] - INFO - command executed successfully [2019-04-08 10:16:31,446] - [rest_client] [139711473727232] - INFO - /diag/eval status on 172.23.107.184:8091: True content: [6,5] command: cluster_compat_mode:get_compat_version(). [2019-04-08 10:16:31,446] - [rest_client] [139711473727232] - INFO - settings/indexes params : storageMode=forestdb [2019-04-08 10:16:31,450] - [rest_client] [139711473727232] - ERROR - POST http://172.23.107.184:8091/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Accept': '*/*', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==\n'} error: 400 reason: unknown {"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}} auth: Administrator:password [2019-04-08 10:16:32,580] - [task] [139711473727232] - INFO - adding node 172.23.107.184:8091 to cluster [2019-04-08 10:16:32,580] - [rest_client] [139711473727232] - INFO - adding remote node @172.23.107.184:8091 to this cluster @172.23.107.160:8091 [2019-04-08 10:16:34,877] - [rest_client] [139711473727232] - INFO - rebalance params : {'password': 'password', 'ejectedNodes': '', 'user': 'Administrator', 'knownNodes': u'ns_1@172.23.107.160,ns_1@172.23.107.184'} [2019-04-08 10:16:34,886] - [rest_client] [139711473727232] - INFO - rebalance operation started [2019-04-08 10:16:34,893] - [rest_client] [139711473727232] - INFO - rebalance percentage : 0.00 % [2019-04-08 10:16:34,894] - [task] [139711473727232] - INFO - Rebalance - status: running, progress: 0.00% [2019-04-08 10:16:44,919] - [task] [139711473727232] - INFO - Rebalance - status: none, progress: 100.00% [2019-04-08 10:16:44,928] - [task] [139711473727232] - INFO - rebalancing was completed with progress: 100% in 10.0410830975 sec [2019-04-08 10:16:44,937] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.190 with username:root [2019-04-08 10:16:45,101] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.190 [2019-04-08 10:16:45,321] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:45,757] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.190: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' [2019-04-08 10:16:46,005] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 10:16:46,006] - [xdcrnewbasetests] [139711490512640] - INFO - Enabled diag/eval for non-local hosts from 172.23.107.190 [2019-04-08 10:16:46,075] - [rest_client] [139711490512640] - INFO - /diag/eval status on 172.23.107.190:8091: True content: [6,5] command: cluster_compat_mode:get_compat_version(). [2019-04-08 10:16:47,021] - [task] [139711251212032] - INFO - server: ip:172.23.107.190 port:8091 ssh_username:root, nodes/self: {'ip': u'172.23.107.190', 'availableStorage': [], 'rest_username': '', 'id': u'ns_1@172.23.107.190', 'uptime': u'819', 'mcdMemoryReserved': 6053, 'storageTotalRam': 7567, 'hostname': u'172.23.107.190:8091', 'storage': [], 'moxi': 11211, 'port': u'8091', 'version': u'6.5.0-2881-enterprise', 'memcached': 11210, 'status': u'healthy', 'clusterCompatibility': 393221, 'curr_items': 0, 'services': [u'fts', u'index', u'kv', u'n1ql'], 'rest_password': '', 'clusterMembership': u'active', 'memoryFree': 7009325056, 'memoryTotal': 7934996480, 'memoryQuota': 4035, 'mcdMemoryAllocated': 6053, 'os': u'x86_64-unknown-linux-gnu', 'ports': []} [2019-04-08 10:16:47,028] - [rest_client] [139711251212032] - INFO - pools/default params : memoryQuota=4035 [2019-04-08 10:16:47,035] - [rest_client] [139711251212032] - INFO - settings/web params on 172.23.107.190:8091:username=Administrator&password=password&port=8091 [2019-04-08 10:16:47,091] - [remote_util] [139711251212032] - INFO - connecting to 172.23.107.190 with username:root [2019-04-08 10:16:47,225] - [remote_util] [139711251212032] - INFO - Connected to 172.23.107.190 [2019-04-08 10:16:47,446] - [remote_util] [139711251212032] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:47,908] - [remote_util] [139711251212032] - INFO - running command.raw on 172.23.107.190: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' [2019-04-08 10:16:48,156] - [remote_util] [139711251212032] - INFO - command executed successfully [2019-04-08 10:16:48,162] - [rest_client] [139711251212032] - INFO - /diag/eval status on 172.23.107.190:8091: True content: [6,5] command: cluster_compat_mode:get_compat_version(). [2019-04-08 10:16:48,162] - [rest_client] [139711251212032] - INFO - settings/indexes params : storageMode=forestdb [2019-04-08 10:16:48,167] - [rest_client] [139711251212032] - ERROR - POST http://172.23.107.190:8091/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Accept': '*/*', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==\n'} error: 400 reason: unknown {"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}} auth: Administrator:password [2019-04-08 10:16:48,224] - [task] [139711251212032] - INFO - server: ip:172.23.107.191 port:8091 ssh_username:root, nodes/self: {'ip': u'172.23.107.191', 'availableStorage': [], 'rest_username': '', 'id': u'ns_1@172.23.107.191', 'uptime': u'841', 'mcdMemoryReserved': 6053, 'storageTotalRam': 7567, 'hostname': u'172.23.107.191:8091', 'storage': [], 'moxi': 11211, 'port': u'8091', 'version': u'6.5.0-2881-enterprise', 'memcached': 11210, 'status': u'healthy', 'clusterCompatibility': 393221, 'curr_items': 0, 'services': [u'kv'], 'rest_password': '', 'clusterMembership': u'active', 'memoryFree': 7386349568, 'memoryTotal': 7934996480, 'memoryQuota': 3874, 'mcdMemoryAllocated': 6053, 'os': u'x86_64-unknown-linux-gnu', 'ports': []} [2019-04-08 10:16:48,229] - [rest_client] [139711251212032] - ERROR - GET http://172.23.107.191:8091/pools/default body: headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Accept': '*/*', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==\n'} error: 404 reason: unknown "unknown pool" auth: Administrator:password [2019-04-08 10:16:48,230] - [rest_client] [139711251212032] - INFO - pools/default params : memoryQuota=4035 [2019-04-08 10:16:48,236] - [rest_client] [139711251212032] - INFO - settings/web params on 172.23.107.191:8091:username=Administrator&password=password&port=8091 [2019-04-08 10:16:48,292] - [remote_util] [139711251212032] - INFO - connecting to 172.23.107.191 with username:root [2019-04-08 10:16:48,451] - [remote_util] [139711251212032] - INFO - Connected to 172.23.107.191 [2019-04-08 10:16:48,645] - [remote_util] [139711251212032] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:16:49,074] - [remote_util] [139711251212032] - INFO - running command.raw on 172.23.107.191: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' [2019-04-08 10:16:49,275] - [remote_util] [139711251212032] - INFO - command executed successfully [2019-04-08 10:16:49,279] - [rest_client] [139711251212032] - INFO - /diag/eval status on 172.23.107.191:8091: True content: [6,5] command: cluster_compat_mode:get_compat_version(). [2019-04-08 10:16:49,279] - [rest_client] [139711251212032] - INFO - settings/indexes params : storageMode=forestdb [2019-04-08 10:16:49,284] - [rest_client] [139711251212032] - ERROR - POST http://172.23.107.191:8091/settings/indexes body: storageMode=forestdb headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Accept': '*/*', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==\n'} error: 400 reason: unknown {"errors":{"storageMode":"The value must be one of the following: [plasma,memory_optimized]"}} auth: Administrator:password [2019-04-08 10:16:50,412] - [task] [139711251212032] - INFO - adding node 172.23.107.191:8091 to cluster [2019-04-08 10:16:50,412] - [rest_client] [139711251212032] - INFO - adding remote node @172.23.107.191:8091 to this cluster @172.23.107.190:8091 [2019-04-08 10:16:52,752] - [rest_client] [139711251212032] - INFO - rebalance params : {'password': 'password', 'ejectedNodes': '', 'user': 'Administrator', 'knownNodes': u'ns_1@172.23.107.190,ns_1@172.23.107.191'} [2019-04-08 10:16:52,761] - [rest_client] [139711251212032] - INFO - rebalance operation started [2019-04-08 10:16:52,770] - [rest_client] [139711251212032] - INFO - rebalance percentage : 0.00 % [2019-04-08 10:16:52,770] - [task] [139711251212032] - INFO - Rebalance - status: running, progress: 0.00% [2019-04-08 10:17:02,799] - [task] [139711251212032] - INFO - Rebalance - status: none, progress: 100.00% [2019-04-08 10:17:02,808] - [task] [139711251212032] - INFO - rebalancing was completed with progress: 100% in 10.0457210541 sec [2019-04-08 10:17:02,835] - [rest_client] [139711490512640] - ERROR - DELETE http://172.23.107.160:8091/settings/rbac/users/local/cbadminbucket body: headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Accept': '*/*', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==\n'} error: 404 reason: unknown "User was not found." auth: Administrator:password [2019-04-08 10:17:02,836] - [internal_user] [139711490512640] - INFO - Exception while deleting user. Exception is -"User was not found." [2019-04-08 10:17:02,961] - [rest_client] [139711490512640] - ERROR - DELETE http://172.23.107.190:8091/settings/rbac/users/local/cbadminbucket body: headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Accept': '*/*', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==\n'} error: 404 reason: unknown "User was not found." auth: Administrator:password [2019-04-08 10:17:02,961] - [internal_user] [139711490512640] - INFO - Exception while deleting user. Exception is -"User was not found." [2019-04-08 10:17:03,983] - [rest_client] [139711473727232] - INFO - http://172.23.107.160:8091/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=3535&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&compressionMode=passive&saslPassword=None&replicaIndex=1 [2019-04-08 10:17:03,992] - [rest_client] [139711473727232] - INFO - 0.01 seconds to create bucket default [2019-04-08 10:17:03,993] - [bucket_helper] [139711473727232] - INFO - waiting for memcached bucket : default in 172.23.107.160 to accept set ops [2019-04-08 10:17:05,299] - [data_helper] [139711473727232] - INFO - creating direct client 172.23.107.160:11210 default [2019-04-08 10:17:05,457] - [data_helper] [139711473727232] - INFO - creating direct client 172.23.107.184:11210 default [2019-04-08 10:17:05,676] - [data_helper] [139711473727232] - INFO - creating direct client 172.23.107.160:11210 default [2019-04-08 10:17:05,827] - [data_helper] [139711473727232] - INFO - creating direct client 172.23.107.184:11210 default [2019-04-08 10:17:06,464] - [task] [139711473727232] - INFO - bucket 'default' was created with per node RAM quota: 3535 [2019-04-08 10:17:06,852] - [rest_client] [139711251212032] - INFO - http://172.23.107.190:8091/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=3535&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&compressionMode=passive&saslPassword=None&replicaIndex=1 [2019-04-08 10:17:06,868] - [rest_client] [139711251212032] - INFO - 0.02 seconds to create bucket default [2019-04-08 10:17:06,868] - [bucket_helper] [139711251212032] - INFO - waiting for memcached bucket : default in 172.23.107.190 to accept set ops [2019-04-08 10:17:08,082] - [data_helper] [139711251212032] - INFO - creating direct client 172.23.107.190:11210 default [2019-04-08 10:17:08,216] - [data_helper] [139711251212032] - INFO - creating direct client 172.23.107.191:11210 default [2019-04-08 10:17:08,402] - [data_helper] [139711251212032] - INFO - creating direct client 172.23.107.190:11210 default [2019-04-08 10:17:08,526] - [data_helper] [139711251212032] - INFO - creating direct client 172.23.107.191:11210 default [2019-04-08 10:17:09,547] - [task] [139711251212032] - INFO - bucket 'default' was created with per node RAM quota: 3535 [2019-04-08 10:17:09,577] - [xdcrnewbasetests] [139711490512640] - INFO - ==== XDCRNewbasetests setup is finished for test #4 load_with_async_ops ==== [2019-04-08 10:17:09,585] - [rest_client] [139711490512640] - INFO - adding remote cluster hostname:172.23.107.190:8091 with username:password Administrator:password name:remote_cluster_C1-C2 to source node: 172.23.107.160:8091 [2019-04-08 10:17:09,612] - [rest_client] [139711490512640] - INFO - adding remote cluster hostname:172.23.107.160:8091 with username:password Administrator:password name:remote_cluster_C2-C1 to source node: 172.23.107.190:8091 [2019-04-08 10:17:09,648] - [rest_client] [139711490512640] - INFO - starting continuous replication type:xmem from default to default in the remote cluster remote_cluster_C1-C2 with settings {} [2019-04-08 10:17:09,712] - [rest_client] [139711490512640] - INFO - Replication created with id: 2e98d99293267ae437b44f54ccd5faf3/default/default [2019-04-08 10:17:19,731] - [rest_client] [139711490512640] - INFO - starting continuous replication type:xmem from default to default in the remote cluster remote_cluster_C2-C1 with settings {} [2019-04-08 10:17:19,795] - [rest_client] [139711490512640] - INFO - Replication created with id: e4fd61298d973e61ffad631cd334ad7a/default/default [2019-04-08 10:17:29,835] - [rest_client] [139711490512640] - INFO - Updated checkpointInterval=60 on bucket'default' on 172.23.107.160 [2019-04-08 10:17:29,875] - [rest_client] [139711490512640] - INFO - Updated checkpointInterval=60 on bucket'default' on 172.23.107.190 [2019-04-08 10:17:29,977] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.160:11210 default [2019-04-08 10:17:30,075] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.184:11210 default [2019-04-08 10:17:30,646] - [data_helper] [139711259604736] - INFO - creating direct client 172.23.107.160:11210 default [2019-04-08 10:17:30,648] - [data_helper] [139711259604736] - INFO - creating direct client 172.23.107.160:11210 default [2019-04-08 10:17:30,652] - [data_helper] [139711259604736] - INFO - creating direct client 172.23.107.160:11210 default [2019-04-08 10:17:30,653] - [data_helper] [139711259604736] - INFO - creating direct client 172.23.107.160:11210 default [2019-04-08 10:17:30,752] - [data_helper] [139711259604736] - INFO - creating direct client 172.23.107.184:11210 default [2019-04-08 10:17:30,752] - [data_helper] [139711259604736] - INFO - creating direct client 172.23.107.184:11210 default [2019-04-08 10:17:30,757] - [data_helper] [139711259604736] - INFO - creating direct client 172.23.107.184:11210 default [2019-04-08 10:17:30,758] - [data_helper] [139711259604736] - INFO - creating direct client 172.23.107.184:11210 default [2019-04-08 10:17:31,487] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.190:11210 default [2019-04-08 10:17:31,595] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.191:11210 default [2019-04-08 10:17:32,782] - [data_helper] [139711259604736] - INFO - creating direct client 172.23.107.190:11210 default [2019-04-08 10:17:32,785] - [data_helper] [139711259604736] - INFO - creating direct client 172.23.107.190:11210 default [2019-04-08 10:17:32,788] - [data_helper] [139711259604736] - INFO - creating direct client 172.23.107.190:11210 default [2019-04-08 10:17:32,788] - [data_helper] [139711259604736] - INFO - creating direct client 172.23.107.190:11210 default [2019-04-08 10:17:32,925] - [data_helper] [139711259604736] - INFO - creating direct client 172.23.107.191:11210 default [2019-04-08 10:17:32,928] - [data_helper] [139711259604736] - INFO - creating direct client 172.23.107.191:11210 default [2019-04-08 10:17:32,930] - [data_helper] [139711259604736] - INFO - creating direct client 172.23.107.191:11210 default [2019-04-08 10:17:32,933] - [data_helper] [139711259604736] - INFO - creating direct client 172.23.107.191:11210 default [2019-04-08 10:17:33,534] - [xdcrnewbasetests] [139711490512640] - INFO - sleep for 10 secs. ... [2019-04-08 10:17:43,544] - [xdcrnewbasetests] [139711490512640] - INFO - Updating keys @ C1 [2019-04-08 10:17:43,545] - [xdcrnewbasetests] [139711490512640] - INFO - At bucket 'default' @ C1: operation: update, key range 0 - 300 [2019-04-08 10:17:43,687] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.160:11210 default [2019-04-08 10:17:43,895] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.184:11210 default [2019-04-08 10:17:44,104] - [xdcrnewbasetests] [139711490512640] - INFO - Updating keys @ C2 [2019-04-08 10:17:44,105] - [xdcrnewbasetests] [139711490512640] - INFO - At bucket 'default' @ C2: operation: update, key range 0 - 300 [2019-04-08 10:17:44,185] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.190:11210 default [2019-04-08 10:17:44,288] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.191:11210 default [2019-04-08 10:17:45,019] - [xdcrnewbasetests] [139711490512640] - INFO - Batched updates loaded to cluster(s) [2019-04-08 10:17:45,020] - [xdcrnewbasetests] [139711490512640] - INFO - Deleting keys @ C1 [2019-04-08 10:17:45,020] - [xdcrnewbasetests] [139711490512640] - INFO - At bucket 'default' @ C1: operation: delete, key range 700 - 1000 [2019-04-08 10:17:45,119] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.160:11210 default [2019-04-08 10:17:45,252] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.184:11210 default [2019-04-08 10:17:45,391] - [xdcrnewbasetests] [139711490512640] - INFO - Deleting keys @ C2 [2019-04-08 10:17:45,393] - [xdcrnewbasetests] [139711490512640] - INFO - At bucket 'default' @ C2: operation: delete, key range 700 - 1000 [2019-04-08 10:17:45,642] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.190:11210 default [2019-04-08 10:17:45,900] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.191:11210 default [2019-04-08 10:17:46,948] - [xdcrnewbasetests] [139711490512640] - INFO - Batched deletes sent to cluster(s) [2019-04-08 10:17:46,949] - [xdcrnewbasetests] [139711490512640] - INFO - Merging keys for replication Replication C1:default -> C2:default [2019-04-08 10:17:46,976] - [xdcrnewbasetests] [139711490512640] - INFO - src_kvstore has 700 valid and 300 deleted keys [2019-04-08 10:17:46,977] - [xdcrnewbasetests] [139711490512640] - INFO - dest kvstore has 700 valid and 300 deleted keys [2019-04-08 10:17:47,009] - [xdcrnewbasetests] [139711490512640] - INFO - After merging: destination bucket's kv_store now has 1400 valid keys and 300 deleted keys [2019-04-08 10:17:47,009] - [xdcrnewbasetests] [139711490512640] - INFO - Merging keys for replication Replication C2:default -> C1:default [2019-04-08 10:17:47,025] - [xdcrnewbasetests] [139711490512640] - INFO - src_kvstore has 1400 valid and 300 deleted keys [2019-04-08 10:17:47,025] - [xdcrnewbasetests] [139711490512640] - INFO - dest kvstore has 700 valid and 300 deleted keys [2019-04-08 10:17:47,076] - [xdcrnewbasetests] [139711490512640] - INFO - After merging: destination bucket's kv_store now has 1400 valid keys and 300 deleted keys [2019-04-08 10:17:47,127] - [data_helper] [139711490512640] - INFO - dict:{'username': 'Administrator', 'ip': u'172.23.107.160', 'password': 'password', 'port': u'8091'} [2019-04-08 10:17:47,127] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.160:11210 default [2019-04-08 10:17:47,249] - [cluster_helper] [139711490512640] - INFO - Setting flush param on server {'username': 'Administrator', 'ip': u'172.23.107.160', 'password': 'password', 'port': u'8091'}, exp_pager_stime to 10 on default [2019-04-08 10:17:47,250] - [cluster_helper] [139711490512640] - INFO - Setting flush param on server {'username': 'Administrator', 'ip': u'172.23.107.160', 'password': 'password', 'port': u'8091'}, exp_pager_stime to 10, result: (4172141871, 0, '') [2019-04-08 10:17:47,278] - [data_helper] [139711490512640] - INFO - dict:{'username': 'Administrator', 'ip': u'172.23.107.184', 'password': 'password', 'port': u'8091'} [2019-04-08 10:17:47,278] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.184:11210 default [2019-04-08 10:17:47,363] - [cluster_helper] [139711490512640] - INFO - Setting flush param on server {'username': 'Administrator', 'ip': u'172.23.107.184', 'password': 'password', 'port': u'8091'}, exp_pager_stime to 10 on default [2019-04-08 10:17:47,364] - [cluster_helper] [139711490512640] - INFO - Setting flush param on server {'username': 'Administrator', 'ip': u'172.23.107.184', 'password': 'password', 'port': u'8091'}, exp_pager_stime to 10, result: (51916839, 0, '') [2019-04-08 10:17:47,364] - [xdcrnewbasetests] [139711490512640] - INFO - wait for expiry pager to run on all these nodes [2019-04-08 10:17:57,439] - [data_helper] [139711490512640] - INFO - dict:{'username': 'Administrator', 'ip': u'172.23.107.190', 'password': 'password', 'port': u'8091'} [2019-04-08 10:17:57,440] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.190:11210 default [2019-04-08 10:17:57,540] - [cluster_helper] [139711490512640] - INFO - Setting flush param on server {'username': 'Administrator', 'ip': u'172.23.107.190', 'password': 'password', 'port': u'8091'}, exp_pager_stime to 10 on default [2019-04-08 10:17:57,541] - [cluster_helper] [139711490512640] - INFO - Setting flush param on server {'username': 'Administrator', 'ip': u'172.23.107.190', 'password': 'password', 'port': u'8091'}, exp_pager_stime to 10, result: (1278594165, 0, '') [2019-04-08 10:17:57,571] - [data_helper] [139711490512640] - INFO - dict:{'username': 'Administrator', 'ip': u'172.23.107.191', 'password': 'password', 'port': u'8091'} [2019-04-08 10:17:57,572] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.191:11210 default [2019-04-08 10:17:57,684] - [cluster_helper] [139711490512640] - INFO - Setting flush param on server {'username': 'Administrator', 'ip': u'172.23.107.191', 'password': 'password', 'port': u'8091'}, exp_pager_stime to 10 on default [2019-04-08 10:17:57,686] - [cluster_helper] [139711490512640] - INFO - Setting flush param on server {'username': 'Administrator', 'ip': u'172.23.107.191', 'password': 'password', 'port': u'8091'}, exp_pager_stime to 10, result: (2934394833, 0, '') [2019-04-08 10:17:57,686] - [xdcrnewbasetests] [139711490512640] - INFO - wait for expiry pager to run on all these nodes [2019-04-08 10:18:08,656] - [data_helper] [139711473727232] - INFO - creating direct client 172.23.107.160:11210 default [2019-04-08 10:18:08,751] - [task] [139711473727232] - INFO - Saw ep_queue_size 0 == 0 expected on '172.23.107.160:8091',default bucket [2019-04-08 10:18:08,767] - [data_helper] [139711473727232] - INFO - creating direct client 172.23.107.184:11210 default [2019-04-08 10:18:08,866] - [task] [139711473727232] - INFO - Saw ep_queue_size 0 == 0 expected on '172.23.107.184:8091',default bucket [2019-04-08 10:18:09,694] - [data_helper] [139711251212032] - INFO - creating direct client 172.23.107.190:11210 default [2019-04-08 10:18:09,816] - [task] [139711251212032] - INFO - Saw ep_queue_size 0 == 0 expected on '172.23.107.190:8091',default bucket [2019-04-08 10:18:09,831] - [data_helper] [139711251212032] - INFO - creating direct client 172.23.107.191:11210 default [2019-04-08 10:18:09,930] - [task] [139711251212032] - INFO - Saw ep_queue_size 0 == 0 expected on '172.23.107.191:8091',default bucket [2019-04-08 10:18:09,966] - [xdcrnewbasetests] [139711490512640] - INFO - Waiting for dcp queue to drain on cluster node: 172.23.107.160 [2019-04-08 10:18:09,974] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:18:10,007] - [xdcrnewbasetests] [139711490512640] - INFO - Current dcp queue size on C1 for default is 0 [2019-04-08 10:18:10,007] - [xdcrnewbasetests] [139711490512640] - INFO - Waiting for dcp queue to drain on cluster node: 172.23.107.190 [2019-04-08 10:18:10,016] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:18:10,052] - [xdcrnewbasetests] [139711490512640] - INFO - Current dcp queue size on C2 for default is 0 [2019-04-08 10:18:10,052] - [xdcrnewbasetests] [139711490512640] - INFO - Waiting for Outbound mutation to be zero on cluster node: 172.23.107.160 [2019-04-08 10:18:10,087] - [xdcrnewbasetests] [139711490512640] - INFO - Current Outbound mutations on cluster node: C1 for bucket default is 0 [2019-04-08 10:18:10,087] - [xdcrnewbasetests] [139711490512640] - INFO - Waiting for Outbound mutation to be zero on cluster node: 172.23.107.190 [2019-04-08 10:18:10,119] - [xdcrnewbasetests] [139711490512640] - INFO - Current Outbound mutations on cluster node: C2 for bucket default is 0 [2019-04-08 10:18:10,132] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:18:10,164] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:18:15,170] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:18:15,208] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:18:20,213] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:18:20,241] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:18:25,246] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:18:25,275] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:18:30,280] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:18:30,306] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:18:35,312] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:18:35,337] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:18:40,343] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:18:40,364] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:18:45,369] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:18:45,393] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:18:45,409] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:18:50,414] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:18:50,435] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:18:50,449] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:18:55,454] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:18:55,479] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:18:55,492] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:19:00,493] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:19:00,514] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:19:00,528] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:19:05,533] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:19:05,558] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:19:05,571] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:19:10,577] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:19:10,601] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:19:10,614] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:19:15,620] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:19:15,644] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:19:15,658] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:19:20,661] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:19:20,683] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:19:20,696] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:19:25,701] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:19:25,724] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:19:25,738] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:19:30,743] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:19:30,763] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:19:30,780] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:19:35,785] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:19:35,816] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:19:35,828] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:19:40,834] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:19:40,854] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:19:40,867] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:19:45,873] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:19:45,894] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:19:45,909] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:19:50,915] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:19:50,938] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:19:50,950] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:19:55,956] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:19:55,979] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:19:55,995] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:20:01,000] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:20:01,022] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:20:01,036] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:20:06,040] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:20:06,064] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:20:06,078] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:20:11,083] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:20:11,109] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:20:11,124] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:20:16,129] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:20:16,153] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:20:16,166] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:20:21,172] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:20:21,199] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:20:21,214] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:20:26,220] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:20:26,247] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:20:26,260] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:20:31,266] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:20:31,288] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:20:31,303] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:20:36,309] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:20:36,330] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:20:36,346] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:20:41,351] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:20:41,374] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:20:41,388] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:20:46,394] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:20:46,417] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:20:46,434] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:20:51,439] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:20:51,460] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:20:51,474] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:20:56,479] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:20:56,502] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:20:56,515] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:21:01,521] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:21:01,546] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:21:01,560] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:21:06,566] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:21:06,587] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:21:06,601] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:21:11,606] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:21:11,629] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:21:11,642] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:21:16,647] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:21:16,669] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:21:16,684] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:21:21,690] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:21:21,710] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:21:21,724] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:21:26,729] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:21:26,750] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:21:26,764] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:21:31,770] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:21:31,791] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:21:31,803] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:21:36,809] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:21:36,833] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:21:36,849] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:21:41,854] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:21:41,878] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:21:41,891] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:21:46,896] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:21:46,921] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:21:46,934] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:21:51,939] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:21:51,960] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:21:51,974] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:21:56,980] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:21:57,004] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:21:57,019] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:22:02,025] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:22:02,047] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:22:02,060] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:22:07,066] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:22:07,093] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:22:07,109] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:22:12,114] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:22:12,138] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:22:12,155] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:22:17,161] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:22:17,182] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:22:17,206] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:22:22,212] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:22:22,233] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:22:22,245] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:22:27,251] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:22:27,272] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:22:27,286] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:22:32,291] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:22:32,314] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:22:32,330] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:22:37,335] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:22:37,359] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:22:37,372] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:22:42,377] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:22:42,399] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:22:42,416] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:22:47,418] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:22:47,444] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:22:47,481] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:22:52,487] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:22:52,511] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:22:52,524] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:22:57,530] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:22:57,554] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:22:57,567] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:02,573] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:02,596] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:23:02,609] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:07,614] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:07,636] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:23:07,649] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:12,654] - [xdcrnewbasetests] [139711490512640] - ERROR - ERROR: Timed-out waiting for active item count to match [2019-04-08 10:23:12,659] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:12,679] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:23:12,691] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:15,695] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:15,717] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:23:15,730] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:18,734] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:18,756] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:23:18,769] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:21,771] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:21,801] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:23:21,816] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:24,819] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:24,842] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:23:24,855] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:27,859] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:27,880] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:23:27,892] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:30,896] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:30,918] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:23:30,933] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:33,936] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:33,959] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:23:33,972] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:36,976] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:36,998] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:23:37,011] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:40,013] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:40,037] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:23:40,052] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:43,056] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:43,075] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:23:43,089] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:46,092] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:46,120] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:23:46,135] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:49,139] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:49,161] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:23:49,174] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:52,177] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:52,206] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:23:52,223] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:55,226] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:55,248] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:23:55,261] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:23:58,264] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:23:58,287] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:23:58,300] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:01,304] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:01,324] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:01,339] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:04,342] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:04,364] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:04,377] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:07,380] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:07,403] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:07,416] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:10,419] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:10,441] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:10,457] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:13,460] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:13,488] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:13,502] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:16,505] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:16,529] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:16,542] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:19,545] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:19,567] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:19,580] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:22,583] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:22,604] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:22,617] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:25,621] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:25,641] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:25,653] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:28,657] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:28,680] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:28,694] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:31,698] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:31,719] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:31,734] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:34,738] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:34,760] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:34,774] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:37,777] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:37,798] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:37,812] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:40,815] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:40,841] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:40,857] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:43,860] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:43,882] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:43,895] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:46,898] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:46,919] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:46,934] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:49,937] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:49,958] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:49,973] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:52,975] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:52,998] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:53,012] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:56,016] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:56,036] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:56,052] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:24:59,055] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:24:59,082] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:24:59,097] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:02,100] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:02,121] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:02,134] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:05,138] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:05,164] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:05,176] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:08,180] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:08,206] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:08,220] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:11,223] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:11,245] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:11,257] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:14,261] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:14,280] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:14,294] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:17,298] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:17,321] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:17,334] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:20,338] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:20,358] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:20,371] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:23,375] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:23,397] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:23,411] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:26,414] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:26,436] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:26,451] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:29,455] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:29,478] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:29,491] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:32,495] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:32,518] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:32,532] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:35,535] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:35,556] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:35,568] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:38,572] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:38,593] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:38,605] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:41,608] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:41,633] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:41,646] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:44,650] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:44,672] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:44,684] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:47,687] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:47,711] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:47,725] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:50,728] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:50,752] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:50,766] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:53,770] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:53,794] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:53,812] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:56,815] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:56,838] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:56,850] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:25:59,854] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:25:59,876] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:25:59,889] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:02,892] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:02,914] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:02,927] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:05,931] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:05,957] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:05,970] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:08,973] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:08,996] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:09,009] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:12,013] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:12,038] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:12,051] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:15,055] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:15,077] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:15,092] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:18,095] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:18,120] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:18,133] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:21,136] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:21,159] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:21,172] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:24,175] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:24,207] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:24,220] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:27,223] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:27,247] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:27,261] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:30,265] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:30,287] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:30,301] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:33,304] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:33,327] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:33,342] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:36,346] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:36,371] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:36,383] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:39,387] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:39,409] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:39,424] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:42,427] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:42,451] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:42,464] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:45,467] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:45,488] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:45,503] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:48,506] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:48,528] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:48,542] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:51,546] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:51,570] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:51,583] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:54,586] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:54,609] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:54,621] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:26:57,624] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:26:57,644] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:26:57,658] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:00,662] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:00,685] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:00,698] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:03,702] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:03,723] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:03,736] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:06,739] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:06,761] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:06,775] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:09,776] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:09,798] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:09,811] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:12,815] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:12,837] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:12,851] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:15,854] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:15,879] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:15,898] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:18,902] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:18,925] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:18,938] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:21,941] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:21,963] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:21,975] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:24,979] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:25,001] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:25,015] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:28,019] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:28,038] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:28,055] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:31,058] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:31,084] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:31,100] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:34,104] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:34,127] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:34,139] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:37,143] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:37,167] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:37,180] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:40,183] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:40,207] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:40,220] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:43,224] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:43,245] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:43,257] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:46,261] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:46,284] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:46,299] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:49,303] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:49,328] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:49,343] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:52,347] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:52,368] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:52,381] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:55,385] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:55,407] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:55,420] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:27:58,423] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:27:58,446] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:27:58,460] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:28:01,463] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:28:01,486] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:28:01,502] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:28:04,505] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:28:04,527] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:28:04,542] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:28:07,546] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:28:07,569] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:28:07,582] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:28:10,585] - [rest_client] [139711490512640] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:28:10,607] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:28:10,620] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 2000 == 1400 expected on C1, default bucket [2019-04-08 10:28:13,623] - [xdcrnewbasetests] [139711490512640] - ERROR - ERROR: Timed-out waiting for replica item count to match [2019-04-08 10:28:13,626] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.160 with username:root [2019-04-08 10:28:13,761] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.160 [2019-04-08 10:28:13,979] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:28:14,434] - [xdcrnewbasetests] [139711490512640] - INFO - Executing cbvdiff for bucket default [2019-04-08 10:28:14,435] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.160: /opt/couchbase/bin/cbvdiff -b default 172.23.107.160:11210,172.23.107.184:11210 [2019-04-08 10:28:14,633] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 10:28:14,633] - [remote_util] [139711490512640] - ERROR - Traceback (most recent call last): [2019-04-08 10:28:14,634] - [remote_util] [139711490512640] - ERROR - File "/opt/couchbase/lib/python/cbvdiff", line 97, in [2019-04-08 10:28:14,634] - [remote_util] [139711490512640] - ERROR - main() [2019-04-08 10:28:14,634] - [remote_util] [139711490512640] - ERROR - File "/opt/couchbase/lib/python/cbvdiff", line 46, in main [2019-04-08 10:28:14,634] - [remote_util] [139711490512640] - ERROR - mc.sasl_auth_plain(options.user, password) [2019-04-08 10:28:14,634] - [remote_util] [139711490512640] - ERROR - File "/opt/couchbase/lib/python/mc_bin_client.py", line 458, in sasl_auth_plain [2019-04-08 10:28:14,634] - [remote_util] [139711490512640] - ERROR - return self.sasl_auth_start('PLAIN', '\0'.join([foruser, user, password])) [2019-04-08 10:28:14,634] - [remote_util] [139711490512640] - ERROR - TypeError: sequence item 1: expected str instance, NoneType found [2019-04-08 10:28:14,710] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:28:14,730] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:28:14,743] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:28:19,748] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:28:19,769] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:28:19,785] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:28:24,791] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:28:24,810] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:28:24,824] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:28:29,830] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:28:29,855] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:28:29,867] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:28:34,873] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:28:34,895] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:28:34,908] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:28:39,914] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:28:39,934] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:28:39,947] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:28:44,953] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:28:44,974] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:28:44,987] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:28:49,992] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:28:50,017] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:28:50,030] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:28:55,036] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:28:55,058] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:28:55,070] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:29:00,074] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:29:00,094] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:29:00,109] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:29:05,115] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:29:05,135] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:29:05,147] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:29:10,153] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:29:10,173] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:29:10,188] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:29:15,194] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:29:15,215] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:29:15,227] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:29:20,233] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:29:20,254] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:29:20,267] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:29:25,272] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:29:25,292] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:29:25,305] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:29:30,310] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:29:30,330] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:29:30,344] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:29:35,350] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:29:35,373] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:29:35,386] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:29:40,391] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:29:40,410] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:29:40,422] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:29:45,428] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:29:45,448] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:29:45,461] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:29:50,466] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:29:50,485] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:29:50,496] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:29:55,502] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:29:55,523] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:29:55,535] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:30:00,541] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:30:00,563] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:30:00,576] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:30:05,580] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:30:05,600] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:30:05,612] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:30:10,613] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:30:10,632] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:30:10,643] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:30:15,649] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:30:15,668] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:30:15,681] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:30:20,686] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:30:20,707] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:30:20,720] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:30:25,725] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:30:25,745] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:30:25,757] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:30:30,762] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:30:30,783] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:30:30,795] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:30:35,801] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:30:35,819] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:30:35,858] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:30:40,864] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:30:40,883] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:30:40,898] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:30:45,904] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:30:45,925] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:30:45,937] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:30:50,943] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:30:50,964] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:30:50,976] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:30:55,982] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:30:56,001] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:30:56,015] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:31:01,021] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:31:01,041] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:31:01,056] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:31:06,061] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:31:06,084] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:31:06,099] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:31:11,104] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:31:11,129] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:31:11,143] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:31:16,148] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:31:16,172] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:31:16,186] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:31:21,192] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:31:21,214] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:31:21,227] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:31:26,233] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:31:26,255] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:31:26,271] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:31:31,276] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:31:31,298] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:31:31,310] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:31:36,316] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:31:36,337] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:31:36,349] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:31:41,355] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:31:41,379] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:31:41,392] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:31:46,398] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:31:46,422] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:31:46,434] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:31:51,439] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:31:51,461] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:31:51,474] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:31:56,480] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:31:56,501] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:31:56,515] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:32:01,520] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:32:01,542] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:32:01,555] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:32:06,560] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:32:06,579] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:32:06,593] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:32:11,598] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:32:11,619] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:32:11,631] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:32:16,634] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:32:16,654] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:32:16,665] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:32:21,671] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:32:21,692] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:32:21,706] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:32:26,711] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:32:26,731] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:32:26,743] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:32:31,749] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:32:31,772] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:32:31,785] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:32:36,790] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:32:36,810] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:32:36,824] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:32:41,829] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:32:41,849] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:32:41,863] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:32:46,868] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:32:46,887] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:32:46,900] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:32:51,906] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:32:51,926] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:32:51,939] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:32:56,944] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:32:56,964] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:32:56,978] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:01,983] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:02,005] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:33:02,021] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:07,026] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:07,052] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:33:07,065] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:12,071] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:12,092] - [xdcrnewbasetests] [139711490512640] - ERROR - 'curr_items' [2019-04-08 10:33:12,107] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_active_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:17,113] - [xdcrnewbasetests] [139711490512640] - ERROR - ERROR: Timed-out waiting for active item count to match [2019-04-08 10:33:17,118] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:17,137] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:33:17,151] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:20,154] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:20,175] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:33:20,187] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:23,191] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:23,212] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:33:23,224] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:26,228] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:26,250] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:33:26,263] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:29,267] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:29,287] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:33:29,300] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:32,304] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:32,325] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:33:32,340] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:35,343] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:35,363] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:33:35,376] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:38,380] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:38,400] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:33:38,412] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:41,415] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:41,435] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:33:41,448] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:44,452] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:44,473] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:33:44,487] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:47,490] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:47,511] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:33:47,524] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:50,528] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:50,549] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:33:50,562] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:53,565] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:53,585] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:33:53,598] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:56,601] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:56,622] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:33:56,635] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:33:59,638] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:33:59,658] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:33:59,671] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:02,674] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:02,694] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:02,706] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:05,710] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:05,729] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:05,741] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:08,744] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:08,768] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:08,780] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:11,783] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:11,803] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:11,815] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:14,819] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:14,839] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:14,853] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:17,856] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:17,876] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:17,894] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:20,898] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:20,920] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:20,933] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:23,936] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:23,956] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:23,969] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:26,972] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:26,993] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:27,006] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:30,009] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:30,030] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:30,043] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:33,046] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:33,068] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:33,081] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:36,084] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:36,109] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:36,123] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:39,127] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:39,147] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:39,160] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:42,163] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:42,186] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:42,204] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:45,208] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:45,229] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:45,242] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:48,246] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:48,266] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:48,279] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:51,282] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:51,302] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:51,315] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:54,318] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:54,337] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:54,351] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:34:57,354] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:34:57,376] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:34:57,391] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:00,395] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:00,414] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:00,427] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:03,430] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:03,450] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:03,464] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:06,467] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:06,495] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:06,510] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:09,514] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:09,534] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:09,547] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:12,550] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:12,570] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:12,582] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:15,585] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:15,607] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:15,620] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:18,623] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:18,643] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:18,655] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:21,659] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:21,678] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:21,691] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:24,694] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:24,714] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:24,727] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:27,730] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:27,751] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:27,764] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:30,767] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:30,787] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:30,800] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:33,803] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:33,826] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:33,838] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:36,842] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:36,863] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:36,876] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:39,880] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:39,899] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:39,912] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:42,916] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:42,936] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:42,949] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:45,952] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:45,972] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:45,986] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:48,989] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:49,008] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:49,022] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:52,026] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:52,049] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:52,062] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:55,066] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:55,085] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:55,098] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:35:58,102] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:35:58,122] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:35:58,135] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:01,138] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:01,160] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:01,172] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:04,176] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:04,198] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:04,213] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:07,216] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:07,238] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:07,251] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:10,254] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:10,276] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:10,288] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:13,292] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:13,311] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:13,324] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:16,327] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:16,349] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:16,363] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:19,366] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:19,389] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:19,406] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:22,409] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:22,432] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:22,445] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:25,449] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:25,472] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:25,484] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:28,488] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:28,507] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:28,519] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:31,523] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:31,543] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:31,556] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:34,560] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:34,580] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:34,593] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:37,597] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:37,616] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:37,629] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:40,632] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:40,652] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:40,665] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:43,668] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:43,689] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:43,702] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:46,704] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:46,725] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:46,739] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:49,742] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:49,762] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:49,774] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:52,777] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:52,796] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:52,810] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:55,813] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:55,835] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:55,847] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:36:58,851] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:36:58,871] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:36:58,884] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:01,888] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:01,909] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:01,922] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:04,925] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:04,945] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:04,959] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:07,962] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:07,983] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:07,996] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:11,000] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:11,023] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:11,037] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:14,040] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:14,061] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:14,073] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:17,077] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:17,096] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:17,115] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:20,118] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:20,138] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:20,150] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:23,153] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:23,174] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:23,188] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:26,191] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:26,215] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:26,229] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:29,232] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:29,253] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:29,266] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:32,270] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:32,289] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:32,302] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:35,306] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:35,327] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:35,340] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:38,343] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:38,363] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:38,376] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:41,379] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:41,399] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:41,412] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:44,416] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:44,437] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:44,451] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:47,454] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:47,478] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:47,491] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:50,494] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:50,514] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:50,527] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:53,531] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:53,551] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:53,565] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:56,568] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:56,590] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:56,603] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:37:59,607] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:37:59,627] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:37:59,639] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:38:02,642] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:38:02,662] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:38:02,674] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:38:05,678] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:38:05,698] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:38:05,712] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:38:08,715] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:38:08,737] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:38:08,750] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:38:11,753] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:38:11,774] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:38:11,791] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:38:14,794] - [rest_client] [139711490512640] - INFO - http://172.23.107.190:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:38:14,817] - [xdcrnewbasetests] [139711490512640] - ERROR - 'vb_replica_curr_items' [2019-04-08 10:38:14,829] - [xdcrnewbasetests] [139711490512640] - WARNING - Not Ready: vb_replica_curr_items 1876 == 1400 expected on C2, default bucket [2019-04-08 10:38:17,832] - [xdcrnewbasetests] [139711490512640] - ERROR - ERROR: Timed-out waiting for replica item count to match [2019-04-08 10:38:17,835] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.190 with username:root [2019-04-08 10:38:17,996] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.190 [2019-04-08 10:38:18,199] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:38:18,646] - [xdcrnewbasetests] [139711490512640] - INFO - Executing cbvdiff for bucket default [2019-04-08 10:38:18,647] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.190: /opt/couchbase/bin/cbvdiff -b default 172.23.107.190:11210,172.23.107.191:11210 [2019-04-08 10:38:18,845] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 10:38:18,845] - [remote_util] [139711490512640] - ERROR - Traceback (most recent call last): [2019-04-08 10:38:18,845] - [remote_util] [139711490512640] - ERROR - File "/opt/couchbase/lib/python/cbvdiff", line 97, in [2019-04-08 10:38:18,846] - [remote_util] [139711490512640] - ERROR - main() [2019-04-08 10:38:18,846] - [remote_util] [139711490512640] - ERROR - File "/opt/couchbase/lib/python/cbvdiff", line 46, in main [2019-04-08 10:38:18,846] - [remote_util] [139711490512640] - ERROR - mc.sasl_auth_plain(options.user, password) [2019-04-08 10:38:18,846] - [remote_util] [139711490512640] - ERROR - File "/opt/couchbase/lib/python/mc_bin_client.py", line 458, in sasl_auth_plain [2019-04-08 10:38:18,846] - [remote_util] [139711490512640] - ERROR - return self.sasl_auth_start('PLAIN', '\0'.join([foruser, user, password])) [2019-04-08 10:38:18,846] - [remote_util] [139711490512640] - ERROR - TypeError: sequence item 1: expected str instance, NoneType found [2019-04-08 10:38:19,011] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.160:11210 default [2019-04-08 10:38:19,111] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.184:11210 default [2019-04-08 10:38:19,252] - [task] [139711490512640] - INFO - 1700 items will be verified on default bucket [2019-04-08 10:38:20,250] - [task] [139711242819328] - INFO - 0 items were verified [2019-04-08 10:38:21,023] - [task] [139711242819328] - INFO - 1700 items were verified in 1.77000808716 sec.the average number of ops - 960.443837343 per second [2019-04-08 10:38:21,153] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.190:11210 default [2019-04-08 10:38:21,262] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.191:11210 default [2019-04-08 10:38:21,396] - [task] [139711490512640] - INFO - 1700 items will be verified on default bucket [2019-04-08 10:38:22,282] - [task] [139711242819328] - INFO - 0 items were verified [2019-04-08 10:38:23,056] - [task] [139711242819328] - INFO - 1700 items were verified in 1.65947008133 sec.the average number of ops - 1024.4197308 per second [2019-04-08 10:38:23,057] - [xdcrnewbasetests] [139711490512640] - INFO - Verifying RevIds for Couchbase Cluster: C1, Master Ip: 172.23.107.160 -> Couchbase Cluster: C2, Master Ip: 172.23.107.190, bucket default [2019-04-08 10:38:23,185] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.160:11210 default [2019-04-08 10:38:23,299] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.184:11210 default [2019-04-08 10:38:23,484] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.160:11210 default [2019-04-08 10:38:23,628] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.184:11210 default [2019-04-08 10:38:23,786] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.190:11210 default [2019-04-08 10:38:23,923] - [data_helper] [139711490512640] - INFO - creating direct client 172.23.107.191:11210 default [2019-04-08 10:38:24,021] - [task] [139711490512640] - INFO - RevID verification: in progress for default ... [2019-04-08 10:38:26,682] - [task] [139711242819328] - INFO - RevId Verification : 1400 existing items have been verified [2019-04-08 10:38:26,682] - [task] [139711242819328] - INFO - RevId Verification : 300 deleted items have been verified [2019-04-08 10:38:26,682] - [task] [139711242819328] - INFO - RevId Verification : 0 keys were apparently filtered out and not found in target bucket [2019-04-08 10:38:26,690] - [rest_client] [139711242819328] - INFO - http://172.23.107.160:8091/pools/default/buckets/default/stats?zoom=minute [2019-04-08 10:58:24,022] - [xdcrnewbasetests] [139711490512640] - INFO - Collecting logs @ 172.23.107.160 [2019-04-08 10:58:24,026] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.160 with username:root [2019-04-08 10:58:24,167] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.160 [2019-04-08 10:58:24,431] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 10:58:24,948] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.160: /opt/couchbase/bin/cbcollect_info 172.23.107.160-20190408-1058-diag.zip [2019-04-08 11:00:58,317] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 11:00:58,869] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.160: rm -f /root/172.23.107.160-20190408-1058-diag.zip [2019-04-08 11:00:58,890] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 11:00:59,008] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.160 with username:root [2019-04-08 11:00:59,180] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.160 [2019-04-08 11:00:59,407] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 11:00:59,884] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.160: tar -zcvf 172.23.107.160-482019-110-couch.tar.gz '/opt/couchbase/var/lib/couchbase/data' >/dev/null 2>&1 [2019-04-08 11:01:00,383] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 11:01:00,610] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.160: rm -f /root/172.23.107.160-482019-110-couch.tar.gz [2019-04-08 11:01:00,631] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 11:01:00,746] - [xdcrnewbasetests] [139711490512640] - INFO - Collecting logs @ 172.23.107.184 [2019-04-08 11:01:00,749] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.184 with username:root [2019-04-08 11:01:00,930] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.184 [2019-04-08 11:01:01,391] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 11:01:01,847] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.184: /opt/couchbase/bin/cbcollect_info 172.23.107.184-20190408-1101-diag.zip [2019-04-08 11:03:21,431] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 11:03:22,215] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.184: rm -f /root/172.23.107.184-20190408-1101-diag.zip [2019-04-08 11:03:22,253] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 11:03:22,370] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.184 with username:root [2019-04-08 11:03:22,553] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.184 [2019-04-08 11:03:23,004] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 11:03:23,455] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.184: tar -zcvf 172.23.107.184-482019-113-couch.tar.gz '/opt/couchbase/var/lib/couchbase/data' >/dev/null 2>&1 [2019-04-08 11:03:23,940] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 11:03:24,264] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.184: rm -f /root/172.23.107.184-482019-113-couch.tar.gz [2019-04-08 11:03:24,299] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 11:03:24,414] - [xdcrnewbasetests] [139711490512640] - INFO - Collecting logs @ 172.23.107.190 [2019-04-08 11:03:24,419] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.190 with username:root [2019-04-08 11:03:24,586] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.190 [2019-04-08 11:03:24,809] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 11:03:25,255] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.190: /opt/couchbase/bin/cbcollect_info 172.23.107.190-20190408-1103-diag.zip [2019-04-08 11:05:51,561] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 11:05:52,452] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.190: rm -f /root/172.23.107.190-20190408-1103-diag.zip [2019-04-08 11:05:52,473] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 11:05:52,590] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.190 with username:root [2019-04-08 11:05:52,753] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.190 [2019-04-08 11:05:52,955] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 11:05:53,396] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.190: tar -zcvf 172.23.107.190-482019-115-couch.tar.gz '/opt/couchbase/var/lib/couchbase/data' >/dev/null 2>&1 [2019-04-08 11:05:53,895] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 11:05:54,259] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.190: rm -f /root/172.23.107.190-482019-115-couch.tar.gz [2019-04-08 11:05:54,278] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 11:05:54,392] - [xdcrnewbasetests] [139711490512640] - INFO - Collecting logs @ 172.23.107.191 [2019-04-08 11:05:54,395] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.191 with username:root [2019-04-08 11:05:54,568] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.191 [2019-04-08 11:05:54,764] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 11:05:55,247] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.191: /opt/couchbase/bin/cbcollect_info 172.23.107.191-20190408-1105-diag.zip [2019-04-08 11:08:10,832] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 11:08:11,623] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.191: rm -f /root/172.23.107.191-20190408-1105-diag.zip [2019-04-08 11:08:11,706] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 11:08:11,824] - [remote_util] [139711490512640] - INFO - connecting to 172.23.107.191 with username:root [2019-04-08 11:08:11,985] - [remote_util] [139711490512640] - INFO - Connected to 172.23.107.191 [2019-04-08 11:08:12,183] - [remote_util] [139711490512640] - INFO - It could be other operating system. Go to check at other location [2019-04-08 11:08:12,629] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.191: tar -zcvf 172.23.107.191-482019-118-couch.tar.gz '/opt/couchbase/var/lib/couchbase/data' >/dev/null 2>&1 [2019-04-08 11:08:13,079] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 11:08:13,435] - [remote_util] [139711490512640] - INFO - running command.raw on 172.23.107.191: rm -f /root/172.23.107.191-482019-118-couch.tar.gz [2019-04-08 11:08:13,518] - [remote_util] [139711490512640] - INFO - command executed successfully [2019-04-08 11:08:13,690] - [xdcrnewbasetests] [139711490512640] - INFO - ==== XDCRNewbasetests cleanup is started for test #4 load_with_async_ops ==== [2019-04-08 11:08:13,690] - [xdcrnewbasetests] [139711490512640] - INFO - removing xdcr/nodes settings [2019-04-08 11:08:13,715] - [rest_client] [139711490512640] - INFO - Deleting replication /controller/cancelXDCR/2e98d99293267ae437b44f54ccd5faf3%2Fdefault%2Fdefault [2019-04-08 11:08:13,734] - [rest_client] [139711490512640] - INFO - Replication deleted successfully [2019-04-08 11:08:13,752] - [rest_client] [139711490512640] - INFO - removing remote cluster name:remote_cluster_C1-C2 [2019-04-08 11:08:13,799] - [xdcrnewbasetests] [139711490512640] - INFO - cleanup [ip:172.23.107.160 port:8091 ssh_username:root, ip:172.23.107.184 port:8091 ssh_username:root] [2019-04-08 11:08:13,865] - [bucket_helper] [139711490512640] - INFO - deleting existing buckets [u'default'] on 172.23.107.160 [2019-04-08 11:08:13,866] - [bucket_helper] [139711490512640] - INFO - remove bucket default ... [2019-04-08 11:08:14,859] - [bucket_helper] [139711490512640] - INFO - deleted bucket : default from 172.23.107.160 [2019-04-08 11:08:14,859] - [bucket_helper] [139711490512640] - INFO - waiting for bucket deletion to complete.... [2019-04-08 11:08:14,865] - [rest_client] [139711490512640] - INFO - node 172.23.107.160 existing buckets : [] [2019-04-08 11:08:14,865] - [bucket_helper] [139711490512640] - INFO - sleep 2 seconds to make sure all buckets ([u'default']) were deleted completely. [2019-04-08 11:08:16,900] - [cluster_helper] [139711490512640] - INFO - rebalancing all nodes in order to remove nodes [2019-04-08 11:08:16,906] - [rest_client] [139711490512640] - INFO - rebalance params : {'password': 'password', 'ejectedNodes': u'ns_1@172.23.107.184', 'user': 'Administrator', 'knownNodes': u'ns_1@172.23.107.160,ns_1@172.23.107.184'} [2019-04-08 11:08:16,915] - [rest_client] [139711490512640] - INFO - rebalance operation started [2019-04-08 11:08:16,921] - [rest_client] [139711490512640] - INFO - rebalance percentage : 0.00 % [2019-04-08 11:08:36,956] - [rest_client] [139711490512640] - INFO - rebalance progress took 20.04 seconds [2019-04-08 11:08:36,956] - [rest_client] [139711490512640] - INFO - sleep for 10 seconds after rebalance... [2019-04-08 11:08:46,980] - [cluster_helper] [139711490512640] - INFO - removed all the nodes from cluster associated with ip:172.23.107.160 port:8091 ssh_username:root ? [(u'ns_1@172.23.107.184', 8091)] [2019-04-08 11:08:46,989] - [cluster_helper] [139711490512640] - INFO - waiting for ns_server @ 172.23.107.160:8091 [2019-04-08 11:08:46,995] - [cluster_helper] [139711490512640] - INFO - ns_server @ 172.23.107.160:8091 is running [2019-04-08 11:08:47,034] - [cluster_helper] [139711490512640] - INFO - waiting for ns_server @ 172.23.107.184:8091 [2019-04-08 11:08:47,041] - [cluster_helper] [139711490512640] - INFO - ns_server @ 172.23.107.184:8091 is running [2019-04-08 11:08:47,041] - [xdcrnewbasetests] [139711490512640] - INFO - removing xdcr/nodes settings [2019-04-08 11:08:47,062] - [rest_client] [139711490512640] - INFO - removing remote cluster name:remote_cluster_C2-C1 [2019-04-08 11:08:47,093] - [xdcrnewbasetests] [139711490512640] - INFO - cleanup [ip:172.23.107.190 port:8091 ssh_username:root, ip:172.23.107.191 port:8091 ssh_username:root] [2019-04-08 11:08:47,122] - [bucket_helper] [139711490512640] - INFO - deleting existing buckets [u'default'] on 172.23.107.190 [2019-04-08 11:08:47,122] - [bucket_helper] [139711490512640] - INFO - remove bucket default ... [2019-04-08 11:08:48,406] - [bucket_helper] [139711490512640] - INFO - deleted bucket : default from 172.23.107.190 [2019-04-08 11:08:48,407] - [bucket_helper] [139711490512640] - INFO - waiting for bucket deletion to complete.... [2019-04-08 11:08:48,413] - [rest_client] [139711490512640] - INFO - node 172.23.107.190 existing buckets : [] [2019-04-08 11:08:48,413] - [bucket_helper] [139711490512640] - INFO - sleep 2 seconds to make sure all buckets ([u'default']) were deleted completely. [2019-04-08 11:08:50,443] - [cluster_helper] [139711490512640] - INFO - rebalancing all nodes in order to remove nodes [2019-04-08 11:08:50,448] - [rest_client] [139711490512640] - INFO - rebalance params : {'password': 'password', 'ejectedNodes': u'ns_1@172.23.107.191', 'user': 'Administrator', 'knownNodes': u'ns_1@172.23.107.190,ns_1@172.23.107.191'} [2019-04-08 11:08:50,455] - [rest_client] [139711490512640] - INFO - rebalance operation started [2019-04-08 11:08:50,460] - [rest_client] [139711490512640] - INFO - rebalance percentage : 0.00 % [2019-04-08 11:09:10,493] - [rest_client] [139711490512640] - INFO - rebalance progress took 20.04 seconds [2019-04-08 11:09:10,493] - [rest_client] [139711490512640] - INFO - sleep for 10 seconds after rebalance... [2019-04-08 11:09:20,517] - [cluster_helper] [139711490512640] - INFO - removed all the nodes from cluster associated with ip:172.23.107.190 port:8091 ssh_username:root ? [(u'ns_1@172.23.107.191', 8091)] [2019-04-08 11:09:20,526] - [cluster_helper] [139711490512640] - INFO - waiting for ns_server @ 172.23.107.190:8091 [2019-04-08 11:09:20,532] - [cluster_helper] [139711490512640] - INFO - ns_server @ 172.23.107.190:8091 is running [2019-04-08 11:09:20,571] - [cluster_helper] [139711490512640] - INFO - waiting for ns_server @ 172.23.107.191:8091 [2019-04-08 11:09:20,577] - [cluster_helper] [139711490512640] - INFO - ns_server @ 172.23.107.191:8091 is running [2019-04-08 11:09:20,577] - [xdcrnewbasetests] [139711490512640] - INFO - ==== XDCRNewbasetests cleanup is finished for test #4 load_with_async_ops === [2019-04-08 11:09:20,580] - [remote_util] [139711760615232] - INFO - connecting to 172.23.107.160 with username:root [2019-04-08 11:09:20,741] - [remote_util] [139711760615232] - INFO - Connected to 172.23.107.160 [2019-04-08 11:09:20,944] - [remote_util] [139711760615232] - INFO - It could be other operating system. Go to check at other location [2019-04-08 11:09:21,425] - [remote_util] [139711760615232] - INFO - running command.raw on 172.23.107.160: /opt/couchbase/bin/couch_dbinfo -i /opt/couchbase/var/lib/couchbase/data/*/*[0-9] >172.23.107.160-20190408-1109-couch-dbinfo.txt [2019-04-08 11:09:21,479] - [remote_util] [139711760615232] - INFO - command executed successfully [2019-04-08 11:09:21,479] - [remote_util] [139711760615232] - INFO - Failed to open "/opt/couchbase/var/lib/couchbase/data/*/*[0-9]": no such file [2019-04-08 11:09:21,567] - [remote_util] [139711760615232] - INFO - File 172.23.107.160-20190408-1109-couch-dbinfo.txt will be deleted [2019-04-08 11:09:21,567] - [remote_util] [139711760615232] - INFO - running command.raw on 172.23.107.160: rm -rf /root/*172.23.107.160-20190408-1109-couch-dbinfo.txt* [2019-04-08 11:09:21,586] - [remote_util] [139711760615232] - INFO - command executed successfully [2019-04-08 11:09:21,586] - [remote_util] [139711760615232] - INFO - 172.23.107.160:sleep for 30 secs. ** Network or sever may be busy. ** Wait 30 seconds before executing next instrucion ... [2019-04-08 11:09:51,619] - [remote_util] [139711760615232] - INFO - connecting to 172.23.107.184 with username:root [2019-04-08 11:09:51,795] - [remote_util] [139711760615232] - INFO - Connected to 172.23.107.184 [2019-04-08 11:09:52,184] - [remote_util] [139711760615232] - INFO - It could be other operating system. Go to check at other location [2019-04-08 11:09:52,641] - [remote_util] [139711760615232] - INFO - running command.raw on 172.23.107.184: /opt/couchbase/bin/couch_dbinfo -i /opt/couchbase/var/lib/couchbase/data/*/*[0-9] >172.23.107.184-20190408-1109-couch-dbinfo.txt [2019-04-08 11:09:52,727] - [remote_util] [139711760615232] - INFO - command executed successfully [2019-04-08 11:09:52,727] - [remote_util] [139711760615232] - INFO - Failed to open "/opt/couchbase/var/lib/couchbase/data/*/*[0-9]": no such file [2019-04-08 11:09:52,829] - [remote_util] [139711760615232] - INFO - File 172.23.107.184-20190408-1109-couch-dbinfo.txt will be deleted [2019-04-08 11:09:52,830] - [remote_util] [139711760615232] - INFO - running command.raw on 172.23.107.184: rm -rf /root/*172.23.107.184-20190408-1109-couch-dbinfo.txt* [2019-04-08 11:09:52,849] - [remote_util] [139711760615232] - INFO - command executed successfully [2019-04-08 11:09:52,850] - [remote_util] [139711760615232] - INFO - 172.23.107.184:sleep for 30 secs. ** Network or sever may be busy. ** Wait 30 seconds before executing next instrucion ... [2019-04-08 11:10:22,899] - [remote_util] [139711760615232] - INFO - connecting to 172.23.107.190 with username:root [2019-04-08 11:10:23,060] - [remote_util] [139711760615232] - INFO - Connected to 172.23.107.190 [2019-04-08 11:10:23,255] - [remote_util] [139711760615232] - INFO - It could be other operating system. Go to check at other location [2019-04-08 11:10:23,690] - [remote_util] [139711760615232] - INFO - running command.raw on 172.23.107.190: /opt/couchbase/bin/couch_dbinfo -i /opt/couchbase/var/lib/couchbase/data/*/*[0-9] >172.23.107.190-20190408-1110-couch-dbinfo.txt [2019-04-08 11:10:23,792] - [remote_util] [139711760615232] - INFO - command executed successfully [2019-04-08 11:10:23,793] - [remote_util] [139711760615232] - INFO - Failed to open "/opt/couchbase/var/lib/couchbase/data/*/*[0-9]": no such file [2019-04-08 11:10:23,918] - [remote_util] [139711760615232] - INFO - File 172.23.107.190-20190408-1110-couch-dbinfo.txt will be deleted [2019-04-08 11:10:23,918] - [remote_util] [139711760615232] - INFO - running command.raw on 172.23.107.190: rm -rf /root/*172.23.107.190-20190408-1110-couch-dbinfo.txt* [2019-04-08 11:10:23,937] - [remote_util] [139711760615232] - INFO - command executed successfully [2019-04-08 11:10:23,937] - [remote_util] [139711760615232] - INFO - 172.23.107.190:sleep for 30 secs. ** Network or sever may be busy. ** Wait 30 seconds before executing next instrucion ... [2019-04-08 11:10:53,957] - [remote_util] [139711760615232] - INFO - connecting to 172.23.107.191 with username:root [2019-04-08 11:10:54,118] - [remote_util] [139711760615232] - INFO - Connected to 172.23.107.191 [2019-04-08 11:10:54,341] - [remote_util] [139711760615232] - INFO - It could be other operating system. Go to check at other location [2019-04-08 11:10:54,740] - [remote_util] [139711760615232] - INFO - running command.raw on 172.23.107.191: /opt/couchbase/bin/couch_dbinfo -i /opt/couchbase/var/lib/couchbase/data/*/*[0-9] >172.23.107.191-20190408-1110-couch-dbinfo.txt [2019-04-08 11:10:54,842] - [remote_util] [139711760615232] - INFO - command executed successfully [2019-04-08 11:10:54,842] - [remote_util] [139711760615232] - INFO - Failed to open "/opt/couchbase/var/lib/couchbase/data/*/*[0-9]": no such file [2019-04-08 11:10:54,962] - [remote_util] [139711760615232] - INFO - File 172.23.107.191-20190408-1110-couch-dbinfo.txt will be deleted [2019-04-08 11:10:54,962] - [remote_util] [139711760615232] - INFO - running command.raw on 172.23.107.191: rm -rf /root/*172.23.107.191-20190408-1110-couch-dbinfo.txt* [2019-04-08 11:10:54,981] - [remote_util] [139711760615232] - INFO - command executed successfully [2019-04-08 11:10:54,981] - [remote_util] [139711760615232] - INFO - 172.23.107.191:sleep for 30 secs. ** Network or sever may be busy. ** Wait 30 seconds before executing next instrucion ...