[2016-09-03 12:22:54,398] - [rest_client] [123145306509312] - INFO - Node version in cluster 4.0.0r-1967-gfe0cf87-enterprise [2016-09-03 12:22:54,403] - [rest_client] [123145306509312] - INFO - Node versions in cluster [u'4.0.0r-1967-gfe0cf87-enterprise'] [2016-09-03 12:22:54,403] - [basetestcase] [123145306509312] - INFO - ============== basetestcase setup was started for test #2 rebalance_in_with_ops============== [2016-09-03 12:22:54,421] - [bucket_helper] [123145306509312] - INFO - deleting existing buckets [] on 127.0.0.1 [2016-09-03 12:22:54,426] - [bucket_helper] [123145306509312] - INFO - deleting existing buckets [] on 127.0.0.1 [2016-09-03 12:22:54,433] - [bucket_helper] [123145306509312] - INFO - deleting existing buckets [] on 127.0.0.1 [2016-09-03 12:22:54,440] - [bucket_helper] [123145306509312] - INFO - deleting existing buckets [] on 127.0.0.1 [2016-09-03 12:22:54,450] - [basetestcase] [123145306509312] - INFO - sleep for 10 secs. ... [2016-09-03 12:23:04,456] - [cluster_helper] [123145306509312] - INFO - waiting for ns_server @ 127.0.0.1:9000 [2016-09-03 12:23:04,459] - [cluster_helper] [123145306509312] - INFO - ns_server @ 127.0.0.1:9000 is running [2016-09-03 12:23:04,462] - [cluster_helper] [123145306509312] - INFO - waiting for ns_server @ 127.0.0.1:9001 [2016-09-03 12:23:04,464] - [cluster_helper] [123145306509312] - INFO - ns_server @ 127.0.0.1:9001 is running [2016-09-03 12:23:04,467] - [cluster_helper] [123145306509312] - INFO - waiting for ns_server @ 127.0.0.1:9002 [2016-09-03 12:23:04,469] - [cluster_helper] [123145306509312] - INFO - ns_server @ 127.0.0.1:9002 is running [2016-09-03 12:23:04,472] - [cluster_helper] [123145306509312] - INFO - waiting for ns_server @ 127.0.0.1:9003 [2016-09-03 12:23:04,475] - [cluster_helper] [123145306509312] - INFO - ns_server @ 127.0.0.1:9003 is running [2016-09-03 12:23:04,475] - [basetestcase] [123145306509312] - INFO - initializing cluster [2016-09-03 12:23:05,418] - [rest_client] [123145310715904] - INFO - pools/default params : memoryQuota=8738 [2016-09-03 12:23:05,421] - [rest_client] [123145310715904] - INFO - settings/indexes params : storageMode=forestdb [2016-09-03 12:23:05,424] - [rest_client] [123145310715904] - INFO - settings/web params on 127.0.0.1:9000:username=Administrator&password=asdasd&port=9000 [2016-09-03 12:23:05,438] - [rest_client] [123145310715904] - INFO - pools/default params : memoryQuota=8738 [2016-09-03 12:23:05,441] - [rest_client] [123145310715904] - INFO - settings/indexes params : storageMode=forestdb [2016-09-03 12:23:05,444] - [rest_client] [123145310715904] - INFO - settings/web params on 127.0.0.1:9001:username=Administrator&password=asdasd&port=9001 [2016-09-03 12:23:05,466] - [rest_client] [123145310715904] - INFO - pools/default params : memoryQuota=8738 [2016-09-03 12:23:05,469] - [rest_client] [123145310715904] - INFO - settings/indexes params : storageMode=forestdb [2016-09-03 12:23:05,472] - [rest_client] [123145310715904] - INFO - settings/web params on 127.0.0.1:9002:username=Administrator&password=asdasd&port=9002 [2016-09-03 12:23:05,487] - [rest_client] [123145310715904] - INFO - pools/default params : memoryQuota=8738 [2016-09-03 12:23:05,491] - [rest_client] [123145310715904] - INFO - settings/indexes params : storageMode=forestdb [2016-09-03 12:23:05,494] - [rest_client] [123145310715904] - INFO - settings/web params on 127.0.0.1:9003:username=Administrator&password=asdasd&port=9003 [2016-09-03 12:23:05,510] - [basetestcase] [123145306509312] - INFO - done initializing cluster [2016-09-03 12:23:06,527] - [rest_client] [123145310715904] - INFO - http://127.0.0.1:9000/pools/default/buckets with param: bucketType=membase&evictionPolicy=valueOnly&threadsNumber=3&ramQuotaMB=8738&proxyPort=11211&authType=sasl&name=default&flushEnabled=1&replicaNumber=1&replicaIndex=1&saslPassword=None [2016-09-03 12:23:06,531] - [rest_client] [123145310715904] - INFO - 0.00 seconds to create bucket default [2016-09-03 12:23:06,531] - [bucket_helper] [123145310715904] - INFO - waiting for memcached bucket : default in 127.0.0.1 to accept set ops [2016-09-03 12:23:07,604] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12000 default [2016-09-03 12:23:07,682] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12000 default [2016-09-03 12:23:08,231] - [task] [123145310715904] - INFO - bucket 'default' was created with per node RAM quota: 8738 [2016-09-03 12:23:08,237] - [basetestcase] [123145306509312] - INFO - ============== basetestcase setup was finished for test #2 rebalance_in_with_ops ============== [2016-09-03 12:23:08,245] - [basetestcase] [123145306509312] - INFO - sleep for 10 secs. ... [2016-09-03 12:23:18,286] - [data_helper] [123145306509312] - INFO - creating direct client 127.0.0.1:12000 default [2016-09-03 12:23:27,284] - [task] [123145310715904] - INFO - adding node 127.0.0.1:9001 to cluster [2016-09-03 12:23:27,284] - [rest_client] [123145310715904] - INFO - adding remote node @127.0.0.1:9001 to this cluster @127.0.0.1:9000 [2016-09-03 12:23:29,155] - [task] [123145310715904] - INFO - adding node 127.0.0.1:9002 to cluster [2016-09-03 12:23:29,156] - [rest_client] [123145310715904] - INFO - adding remote node @127.0.0.1:9002 to this cluster @127.0.0.1:9000 [2016-09-03 12:23:30,987] - [task] [123145310715904] - INFO - adding node 127.0.0.1:9003 to cluster [2016-09-03 12:23:30,987] - [rest_client] [123145310715904] - INFO - adding remote node @127.0.0.1:9003 to this cluster @127.0.0.1:9000 [2016-09-03 12:23:32,816] - [rest_client] [123145310715904] - INFO - rebalance params : password=asdasd&ejectedNodes=&user=Administrator&knownNodes=n_2%40127.0.0.1%2Cn_3%40127.0.0.1%2Cn_0%40127.0.0.1%2Cn_1%40127.0.0.1 [2016-09-03 12:23:32,824] - [rest_client] [123145310715904] - INFO - rebalance operation started [2016-09-03 12:23:32,829] - [rest_client] [123145310715904] - INFO - rebalance percentage : 0.00 % [2016-09-03 12:23:42,866] - [rest_client] [123145310715904] - INFO - rebalance percentage : 30.94 % [2016-09-03 12:23:52,897] - [rest_client] [123145310715904] - INFO - rebalance percentage : 64.34 % [2016-09-03 12:24:02,922] - [rest_client] [123145310715904] - INFO - rebalance percentage : 96.29 % [2016-09-03 12:24:12,970] - [task] [123145310715904] - INFO - rebalancing was completed with progress: 100% in 40.1454548836 sec [2016-09-03 12:24:12,976] - [rest_client] [123145306509312] - INFO - Node versions in cluster [u'4.0.0r-1967-gfe0cf87-enterprise', u'4.0.0r-1967-gfe0cf87-enterprise', u'4.0.0r-1967-gfe0cf87-enterprise', u'4.0.0r-1967-gfe0cf87-enterprise'] [2016-09-03 12:24:12,982] - [basetestcase] [123145306509312] - INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9002 ssh_username:Administrator, ip:127.0.0.1 port:9003 ssh_username:Administrator, ip:127.0.0.1 port:9000 ssh_username:Administrator, ip:127.0.0.1 port:9001 ssh_username:Administrator] [2016-09-03 12:24:12,988] - [rest_client] [123145306509312] - INFO - Node versions in cluster [u'4.0.0r-1967-gfe0cf87-enterprise', u'4.0.0r-1967-gfe0cf87-enterprise', u'4.0.0r-1967-gfe0cf87-enterprise', u'4.0.0r-1967-gfe0cf87-enterprise'] [2016-09-03 12:24:12,994] - [basetestcase] [123145306509312] - INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9002 ssh_username:Administrator, ip:127.0.0.1 port:9003 ssh_username:Administrator, ip:127.0.0.1 port:9000 ssh_username:Administrator, ip:127.0.0.1 port:9001 ssh_username:Administrator] [2016-09-03 12:24:13,984] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12000 default [2016-09-03 12:24:14,051] - [task] [123145310715904] - INFO - Saw ep_queue_size 0 == 0 expected on '127.0.0.1:9000',default bucket [2016-09-03 12:24:14,062] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12002 default [2016-09-03 12:24:14,116] - [task] [123145310715904] - INFO - Saw ep_queue_size 0 == 0 expected on '127.0.0.1:9001',default bucket [2016-09-03 12:24:14,124] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12004 default [2016-09-03 12:24:14,192] - [task] [123145310715904] - INFO - Saw ep_queue_size 0 == 0 expected on '127.0.0.1:9002',default bucket [2016-09-03 12:24:14,201] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12006 default [2016-09-03 12:24:14,252] - [task] [123145310715904] - INFO - Saw ep_queue_size 0 == 0 expected on '127.0.0.1:9003',default bucket [2016-09-03 12:24:14,316] - [data_helper] [123145306509312] - INFO - creating direct client 127.0.0.1:12000 default [2016-09-03 12:24:14,366] - [data_helper] [123145306509312] - INFO - creating direct client 127.0.0.1:12002 default [2016-09-03 12:24:14,416] - [data_helper] [123145306509312] - INFO - creating direct client 127.0.0.1:12004 default [2016-09-03 12:24:14,529] - [data_helper] [123145306509312] - INFO - creating direct client 127.0.0.1:12006 default [2016-09-03 12:24:14,669] - [task] [123145306509312] - INFO - 50000 items will be verified on default bucket [2016-09-03 12:24:15,255] - [task] [123145314922496] - INFO - 0 items were verified [2016-09-03 12:24:17,307] - [task] [123145314922496] - INFO - 10000 items were verified [2016-09-03 12:24:19,256] - [task] [123145314922496] - INFO - 20000 items were verified [2016-09-03 12:24:20,833] - [task] [123145314922496] - INFO - 30000 items were verified [2016-09-03 12:24:22,917] - [task] [123145314922496] - INFO - 40000 items were verified [2016-09-03 12:24:25,111] - [task] [123145314922496] - INFO - 50000 items were verified [2016-09-03 12:24:25,111] - [task] [123145314922496] - INFO - 50000 items were verified in 10.4423210621 sec.the average number of ops - 4788.20706013 per second [2016-09-03 12:24:25,119] - [rest_client] [123145306509312] - INFO - Node versions in cluster [u'4.0.0r-1967-gfe0cf87-enterprise', u'4.0.0r-1967-gfe0cf87-enterprise', u'4.0.0r-1967-gfe0cf87-enterprise', u'4.0.0r-1967-gfe0cf87-enterprise'] [2016-09-03 12:24:25,125] - [basetestcase] [123145306509312] - INFO - list of all nodes in cluster: [ip:127.0.0.1 port:9002 ssh_username:Administrator, ip:127.0.0.1 port:9003 ssh_username:Administrator, ip:127.0.0.1 port:9000 ssh_username:Administrator, ip:127.0.0.1 port:9001 ssh_username:Administrator] [2016-09-03 12:24:25,290] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12000 default [2016-09-03 12:24:25,337] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12002 default [2016-09-03 12:24:25,382] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12004 default [2016-09-03 12:24:25,426] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12006 default [2016-09-03 12:24:25,463] - [task] [123145310715904] - INFO - Saw curr_items 50000 == 50000 expected on '127.0.0.1:9000''127.0.0.1:9001''127.0.0.1:9002''127.0.0.1:9003',default bucket [2016-09-03 12:24:25,470] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12000 default [2016-09-03 12:24:25,515] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12002 default [2016-09-03 12:24:25,560] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12004 default [2016-09-03 12:24:25,605] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12006 default [2016-09-03 12:24:25,659] - [task] [123145310715904] - INFO - Saw vb_active_curr_items 50000 == 50000 expected on '127.0.0.1:9000''127.0.0.1:9001''127.0.0.1:9002''127.0.0.1:9003',default bucket [2016-09-03 12:24:25,665] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12000 default [2016-09-03 12:24:25,710] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12002 default [2016-09-03 12:24:25,754] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12004 default [2016-09-03 12:24:25,797] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12006 default [2016-09-03 12:24:25,839] - [task] [123145310715904] - INFO - Saw vb_replica_curr_items 50000 == 50000 expected on '127.0.0.1:9000''127.0.0.1:9001''127.0.0.1:9002''127.0.0.1:9003',default bucket [2016-09-03 12:24:25,845] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12000 default [2016-09-03 12:24:25,889] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12002 default [2016-09-03 12:24:25,933] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12004 default [2016-09-03 12:24:25,980] - [data_helper] [123145310715904] - INFO - creating direct client 127.0.0.1:12006 default [2016-09-03 12:24:26,019] - [task] [123145310715904] - INFO - Saw curr_items_tot 100000 == 100000 expected on '127.0.0.1:9000''127.0.0.1:9001''127.0.0.1:9002''127.0.0.1:9003',default bucket [2016-09-03 12:24:26,053] - [rebalance_helper] [123145306509312] - INFO - waiting for sum_of_curr_items == total_items.... [2016-09-03 12:24:26,162] - [rebalance_helper] [123145306509312] - INFO - curr_items from 127.0.0.1:9000 : 12499 [2016-09-03 12:24:26,162] - [rebalance_helper] [123145306509312] - INFO - vb_pending_num from 127.0.0.1:9000 : 0 [2016-09-03 12:24:26,163] - [rebalance_helper] [123145306509312] - INFO - vb_active_num from 127.0.0.1:9000 : 256 [2016-09-03 12:24:26,163] - [rebalance_helper] [123145306509312] - INFO - vb_replica_num from 127.0.0.1:9000 : 256 [2016-09-03 12:24:26,163] - [rebalance_helper] [123145306509312] - INFO - curr_items from 127.0.0.1:9001 : 12501 [2016-09-03 12:24:26,163] - [rebalance_helper] [123145306509312] - INFO - vb_pending_num from 127.0.0.1:9001 : 0 [2016-09-03 12:24:26,163] - [rebalance_helper] [123145306509312] - INFO - vb_active_num from 127.0.0.1:9001 : 256 [2016-09-03 12:24:26,164] - [rebalance_helper] [123145306509312] - INFO - vb_replica_num from 127.0.0.1:9001 : 256 [2016-09-03 12:24:26,164] - [rebalance_helper] [123145306509312] - INFO - curr_items from 127.0.0.1:9002 : 12501 [2016-09-03 12:24:26,164] - [rebalance_helper] [123145306509312] - INFO - vb_pending_num from 127.0.0.1:9002 : 0 [2016-09-03 12:24:26,164] - [rebalance_helper] [123145306509312] - INFO - vb_active_num from 127.0.0.1:9002 : 256 [2016-09-03 12:24:26,164] - [rebalance_helper] [123145306509312] - INFO - vb_replica_num from 127.0.0.1:9002 : 256 [2016-09-03 12:24:26,164] - [rebalance_helper] [123145306509312] - INFO - curr_items from 127.0.0.1:9003 : 12499 [2016-09-03 12:24:26,165] - [rebalance_helper] [123145306509312] - INFO - vb_pending_num from 127.0.0.1:9003 : 0 [2016-09-03 12:24:26,165] - [rebalance_helper] [123145306509312] - INFO - vb_active_num from 127.0.0.1:9003 : 256 [2016-09-03 12:24:26,165] - [rebalance_helper] [123145306509312] - INFO - vb_replica_num from 127.0.0.1:9003 : 256 [2016-09-03 12:24:26,165] - [rebalance_helper] [123145306509312] - INFO - summation of vb_active_num : 1024 vb_pending_num : 0 vb_replica_num : 1024 [2016-09-03 12:24:26,165] - [rebalance_helper] [123145306509312] - INFO - sum : 50000 and sum * (replica_factor + 1) (2) : 100000 [2016-09-03 12:24:26,198] - [rebalance_helper] [123145306509312] - INFO - curr_items_tot from master: 100000 [2016-09-03 12:24:26,198] - [rebalance_helper] [123145306509312] - INFO - delta : 0 missing_percentage : 1 replica_factor : 1 [2016-09-03 12:24:26,199] - [basetestcase] [123145306509312] - INFO - ============== basetestcase cleanup was started for test #2 rebalance_in_with_ops ============== [2016-09-03 12:24:26,227] - [bucket_helper] [123145306509312] - INFO - deleting existing buckets [u'default'] on 127.0.0.1 [2016-09-03 12:24:26,227] - [bucket_helper] [123145306509312] - INFO - remove bucket default ... [2016-09-03 12:24:56,243] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default error 500 reason: unknown {"_":"Bucket deletion not yet complete, but will continue.\r\n"} [2016-09-03 12:24:56,244] - [rest_client] [123145306509312] - WARNING - Bucket deletion timed out waiting for all nodes [2016-09-03 12:24:56,308] - [data_helper] [123145306509312] - INFO - creating direct client 127.0.0.1:12000 default [2016-09-03 12:24:56,312] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:24:56,822] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:24:57,332] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:24:57,838] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:24:58,344] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:24:58,850] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:24:59,355] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:24:59,861] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:00,367] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:00,874] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:01,381] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:01,887] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:02,393] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:02,898] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:03,407] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:03,913] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:04,422] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:04,932] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:05,439] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:05,945] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:06,451] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:06,958] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:07,466] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:07,973] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:08,481] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:08,987] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:09,492] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:09,998] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:10,507] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:11,014] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:11,522] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:12,032] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:12,538] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:13,045] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:13,551] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:14,057] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:14,563] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:15,070] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:15,576] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:16,086] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:16,594] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:17,105] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:17,610] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:18,116] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:18,621] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:19,127] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:19,635] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:20,141] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:20,647] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:21,153] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:21,659] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:22,168] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:22,673] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:23,183] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:23,689] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:24,194] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:24,701] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:25,209] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:25,716] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:26,222] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:26,728] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:27,233] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:27,740] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:28,246] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:28,760] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:29,267] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:29,777] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:30,284] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:30,793] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:31,298] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:31,807] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:32,314] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:32,821] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:33,327] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:33,834] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:34,341] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:34,846] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:35,351] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:35,857] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:36,370] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:36,881] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:37,389] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:37,901] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:38,410] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:38,914] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:39,422] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:39,928] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:40,434] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:40,940] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:41,446] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:41,955] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:42,467] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:42,973] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:43,479] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:43,986] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:44,492] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:44,999] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:45,507] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:46,015] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:46,521] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:47,029] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:47,535] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:48,041] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:48,546] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:49,052] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:49,557] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:50,063] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:50,568] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:51,073] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:51,589] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:52,105] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:52,609] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:53,121] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:53,629] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:54,135] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:54,639] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:55,153] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:55,665] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:56,171] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:56,673] - [rest_client] [123145306509312] - INFO - vbucket map is not ready for bucket default after waiting 60 seconds [2016-09-03 12:25:56,681] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:56,685] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9000/pools/default/buckets/default?basic_stats=true error 404 reason: status: 404, content: Requested resource not found. Requested resource not found. [2016-09-03 12:25:56,685] - [bucket_helper] [123145306509312] - ERROR - Unable to get timings for bucket [2016-09-03 12:25:56,685] - [bucket_helper] [123145306509312] - INFO - deleted bucket : default from 127.0.0.1 [2016-09-03 12:25:56,686] - [bucket_helper] [123145306509312] - INFO - waiting for bucket deletion to complete.... [2016-09-03 12:25:56,688] - [rest_client] [123145306509312] - INFO - node 127.0.0.1 existing buckets : [] [2016-09-03 12:25:56,693] - [bucket_helper] [123145306509312] - INFO - deleting existing buckets [] on 127.0.0.1 [2016-09-03 12:25:56,698] - [bucket_helper] [123145306509312] - INFO - deleting existing buckets [] on 127.0.0.1 [2016-09-03 12:25:56,703] - [bucket_helper] [123145306509312] - INFO - deleting existing buckets [] on 127.0.0.1 [2016-09-03 12:25:56,716] - [cluster_helper] [123145306509312] - INFO - rebalancing all nodes in order to remove nodes [2016-09-03 12:25:56,718] - [rest_client] [123145306509312] - INFO - rebalance params : password=asdasd&ejectedNodes=n_2%40127.0.0.1%2Cn_3%40127.0.0.1%2Cn_1%40127.0.0.1&user=Administrator&knownNodes=n_2%40127.0.0.1%2Cn_3%40127.0.0.1%2Cn_0%40127.0.0.1%2Cn_1%40127.0.0.1 [2016-09-03 12:25:56,722] - [rest_client] [123145306509312] - INFO - rebalance operation started [2016-09-03 12:25:56,727] - [rest_client] [123145306509312] - INFO - rebalance percentage : 0.00 % [2016-09-03 12:26:16,743] - [rest_client] [123145306509312] - INFO - rebalance progress took 20.020706892 seconds [2016-09-03 12:26:16,743] - [rest_client] [123145306509312] - INFO - sleep for 10 seconds after rebalance... [2016-09-03 12:26:26,757] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9003/nodes/self error 404 reason: unknown "Node is unknown to this cluster." [2016-09-03 12:26:26,757] - [rest_client] [123145306509312] - ERROR - Error Node is unknown to this cluster. was gotten, 5 seconds sleep before retry [2016-09-03 12:26:31,764] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9003/nodes/self error 404 reason: unknown "Node is unknown to this cluster." [2016-09-03 12:26:31,765] - [rest_client] [123145306509312] - ERROR - Error Node is unknown to this cluster. was gotten, 5 seconds sleep before retry [2016-09-03 12:26:36,768] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9003/nodes/self error 404 reason: unknown "Node is unknown to this cluster." [2016-09-03 12:26:36,768] - [rest_client] [123145306509312] - ERROR - Error Node is unknown to this cluster. was gotten, 5 seconds sleep before retry [2016-09-03 12:26:41,768] - [rest_client] [123145306509312] - ERROR - node 127.0.0.1:9003 is in a broken state! [2016-09-03 12:26:41,769] - [cluster_helper] [123145306509312] - ERROR - can't create rest connection after rebalance out for ejected nodes, will retry after 10 seconds according to MB-8430: unable to reach the host @ 127.0.0.1 [2016-09-03 12:26:51,774] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9003/nodes/self error 404 reason: unknown "Node is unknown to this cluster." [2016-09-03 12:26:51,775] - [rest_client] [123145306509312] - ERROR - Error Node is unknown to this cluster. was gotten, 5 seconds sleep before retry [2016-09-03 12:26:56,784] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9003/nodes/self error 404 reason: unknown "Node is unknown to this cluster." [2016-09-03 12:26:56,785] - [rest_client] [123145306509312] - ERROR - Error Node is unknown to this cluster. was gotten, 5 seconds sleep before retry [2016-09-03 12:27:01,789] - [rest_client] [123145306509312] - ERROR - http://127.0.0.1:9003/nodes/self error 404 reason: unknown "Node is unknown to this cluster." [2016-09-03 12:27:01,790] - [rest_client] [123145306509312] - ERROR - Error Node is unknown to this cluster. was gotten, 5 seconds sleep before retry [2016-09-03 12:27:06,795] - [rest_client] [123145306509312] - ERROR - node 127.0.0.1:9003 is in a broken state! [2016-09-03 12:27:06,797] - [remote_util] [123145306509312] - INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-09-03 12:27:06,797] - [remote_util] [123145306509312] - INFO - Connected to 127.0.0.1 [2016-09-03 12:27:06,829] - [remote_util] [123145306509312] - INFO - running command.raw on 127.0.0.1: /sbin/sysctl -n machdep.cpu.brand_string [2016-09-03 12:27:06,834] - [remote_util] [123145306509312] - INFO - command executed successfully [2016-09-03 12:27:06,855] - [remote_util] [123145306509312] - INFO - running command.raw on 127.0.0.1: kill $(ps aux | grep 'memcached' | awk '{print $2}') [2016-09-03 12:27:06,904] - [remote_util] [123145306509312] - INFO - command executed successfully [2016-09-03 12:27:06,904] - [remote_util] [123145306509312] - ERROR - / [2016-09-03 12:27:06,905] - [remote_util] [123145306509312] - ERROR - b [2016-09-03 12:27:06,905] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:06,905] - [remote_util] [123145306509312] - ERROR - n [2016-09-03 12:27:06,906] - [remote_util] [123145306509312] - ERROR - / [2016-09-03 12:27:06,906] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:06,906] - [remote_util] [123145306509312] - ERROR - h [2016-09-03 12:27:06,906] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:06,907] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,907] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:06,907] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:06,907] - [remote_util] [123145306509312] - ERROR - n [2016-09-03 12:27:06,908] - [remote_util] [123145306509312] - ERROR - e [2016-09-03 12:27:06,908] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,908] - [remote_util] [123145306509312] - ERROR - 0 [2016-09-03 12:27:06,908] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:06,909] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,909] - [remote_util] [123145306509312] - ERROR - k [2016-09-03 12:27:06,909] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:06,909] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:06,910] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:06,910] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:06,910] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,910] - [remote_util] [123145306509312] - ERROR - ( [2016-09-03 12:27:06,910] - [remote_util] [123145306509312] - ERROR - 2 [2016-09-03 12:27:06,911] - [remote_util] [123145306509312] - ERROR - 1 [2016-09-03 12:27:06,911] - [remote_util] [123145306509312] - ERROR - 7 [2016-09-03 12:27:06,911] - [remote_util] [123145306509312] - ERROR - 9 [2016-09-03 12:27:06,911] - [remote_util] [123145306509312] - ERROR - 7 [2016-09-03 12:27:06,912] - [remote_util] [123145306509312] - ERROR - ) [2016-09-03 12:27:06,912] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,912] - [remote_util] [123145306509312] - ERROR - - [2016-09-03 12:27:06,912] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,923] - [remote_util] [123145306509312] - ERROR - N [2016-09-03 12:27:06,923] - [remote_util] [123145306509312] - ERROR - o [2016-09-03 12:27:06,924] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,924] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:06,924] - [remote_util] [123145306509312] - ERROR - u [2016-09-03 12:27:06,924] - [remote_util] [123145306509312] - ERROR - c [2016-09-03 12:27:06,925] - [remote_util] [123145306509312] - ERROR - h [2016-09-03 12:27:06,925] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,925] - [remote_util] [123145306509312] - ERROR - p [2016-09-03 12:27:06,926] - [remote_util] [123145306509312] - ERROR - r [2016-09-03 12:27:06,926] - [remote_util] [123145306509312] - ERROR - o [2016-09-03 12:27:06,926] - [remote_util] [123145306509312] - ERROR - c [2016-09-03 12:27:06,926] - [remote_util] [123145306509312] - ERROR - e [2016-09-03 12:27:06,926] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:06,927] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:06,927] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,927] - [remote_util] [123145306509312] - ERROR - / [2016-09-03 12:27:06,927] - [remote_util] [123145306509312] - ERROR - b [2016-09-03 12:27:06,928] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:06,928] - [remote_util] [123145306509312] - ERROR - n [2016-09-03 12:27:06,928] - [remote_util] [123145306509312] - ERROR - / [2016-09-03 12:27:06,928] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:06,929] - [remote_util] [123145306509312] - ERROR - h [2016-09-03 12:27:06,929] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:06,929] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,930] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:06,930] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:06,930] - [remote_util] [123145306509312] - ERROR - n [2016-09-03 12:27:06,930] - [remote_util] [123145306509312] - ERROR - e [2016-09-03 12:27:06,931] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,931] - [remote_util] [123145306509312] - ERROR - 0 [2016-09-03 12:27:06,931] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:06,931] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,932] - [remote_util] [123145306509312] - ERROR - k [2016-09-03 12:27:06,932] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:06,932] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:06,932] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:06,932] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:06,933] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,933] - [remote_util] [123145306509312] - ERROR - ( [2016-09-03 12:27:06,933] - [remote_util] [123145306509312] - ERROR - 2 [2016-09-03 12:27:06,937] - [remote_util] [123145306509312] - ERROR - 1 [2016-09-03 12:27:06,937] - [remote_util] [123145306509312] - ERROR - 7 [2016-09-03 12:27:06,937] - [remote_util] [123145306509312] - ERROR - 9 [2016-09-03 12:27:06,937] - [remote_util] [123145306509312] - ERROR - 5 [2016-09-03 12:27:06,938] - [remote_util] [123145306509312] - ERROR - ) [2016-09-03 12:27:06,938] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,938] - [remote_util] [123145306509312] - ERROR - - [2016-09-03 12:27:06,938] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,939] - [remote_util] [123145306509312] - ERROR - N [2016-09-03 12:27:06,939] - [remote_util] [123145306509312] - ERROR - o [2016-09-03 12:27:06,939] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,939] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:06,940] - [remote_util] [123145306509312] - ERROR - u [2016-09-03 12:27:06,940] - [remote_util] [123145306509312] - ERROR - c [2016-09-03 12:27:06,940] - [remote_util] [123145306509312] - ERROR - h [2016-09-03 12:27:06,940] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,941] - [remote_util] [123145306509312] - ERROR - p [2016-09-03 12:27:06,941] - [remote_util] [123145306509312] - ERROR - r [2016-09-03 12:27:06,941] - [remote_util] [123145306509312] - ERROR - o [2016-09-03 12:27:06,941] - [remote_util] [123145306509312] - ERROR - c [2016-09-03 12:27:06,942] - [remote_util] [123145306509312] - ERROR - e [2016-09-03 12:27:06,942] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:06,942] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:06,943] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:06,945] - [remote_util] [123145306509312] - INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-09-03 12:27:06,945] - [remote_util] [123145306509312] - INFO - Connected to 127.0.0.1 [2016-09-03 12:27:06,969] - [remote_util] [123145306509312] - INFO - running command.raw on 127.0.0.1: /sbin/sysctl -n machdep.cpu.brand_string [2016-09-03 12:27:06,976] - [remote_util] [123145306509312] - INFO - command executed successfully [2016-09-03 12:27:07,006] - [remote_util] [123145306509312] - INFO - running command.raw on 127.0.0.1: kill $(ps aux | grep 'memcached' | awk '{print $2}') [2016-09-03 12:27:07,049] - [remote_util] [123145306509312] - INFO - command executed successfully [2016-09-03 12:27:07,050] - [remote_util] [123145306509312] - ERROR - / [2016-09-03 12:27:07,050] - [remote_util] [123145306509312] - ERROR - b [2016-09-03 12:27:07,050] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,050] - [remote_util] [123145306509312] - ERROR - n [2016-09-03 12:27:07,050] - [remote_util] [123145306509312] - ERROR - / [2016-09-03 12:27:07,051] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,051] - [remote_util] [123145306509312] - ERROR - h [2016-09-03 12:27:07,051] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,051] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,051] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,051] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,051] - [remote_util] [123145306509312] - ERROR - n [2016-09-03 12:27:07,052] - [remote_util] [123145306509312] - ERROR - e [2016-09-03 12:27:07,052] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,052] - [remote_util] [123145306509312] - ERROR - 0 [2016-09-03 12:27:07,052] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,052] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,052] - [remote_util] [123145306509312] - ERROR - k [2016-09-03 12:27:07,052] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,053] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,053] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,053] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,053] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,054] - [remote_util] [123145306509312] - ERROR - ( [2016-09-03 12:27:07,054] - [remote_util] [123145306509312] - ERROR - 2 [2016-09-03 12:27:07,054] - [remote_util] [123145306509312] - ERROR - 1 [2016-09-03 12:27:07,054] - [remote_util] [123145306509312] - ERROR - 8 [2016-09-03 12:27:07,055] - [remote_util] [123145306509312] - ERROR - 1 [2016-09-03 12:27:07,055] - [remote_util] [123145306509312] - ERROR - 2 [2016-09-03 12:27:07,055] - [remote_util] [123145306509312] - ERROR - ) [2016-09-03 12:27:07,055] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,056] - [remote_util] [123145306509312] - ERROR - - [2016-09-03 12:27:07,056] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,056] - [remote_util] [123145306509312] - ERROR - N [2016-09-03 12:27:07,056] - [remote_util] [123145306509312] - ERROR - o [2016-09-03 12:27:07,056] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,056] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,057] - [remote_util] [123145306509312] - ERROR - u [2016-09-03 12:27:07,057] - [remote_util] [123145306509312] - ERROR - c [2016-09-03 12:27:07,057] - [remote_util] [123145306509312] - ERROR - h [2016-09-03 12:27:07,057] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,057] - [remote_util] [123145306509312] - ERROR - p [2016-09-03 12:27:07,057] - [remote_util] [123145306509312] - ERROR - r [2016-09-03 12:27:07,057] - [remote_util] [123145306509312] - ERROR - o [2016-09-03 12:27:07,057] - [remote_util] [123145306509312] - ERROR - c [2016-09-03 12:27:07,058] - [remote_util] [123145306509312] - ERROR - e [2016-09-03 12:27:07,058] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,058] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,058] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,058] - [remote_util] [123145306509312] - ERROR - / [2016-09-03 12:27:07,058] - [remote_util] [123145306509312] - ERROR - b [2016-09-03 12:27:07,058] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,058] - [remote_util] [123145306509312] - ERROR - n [2016-09-03 12:27:07,059] - [remote_util] [123145306509312] - ERROR - / [2016-09-03 12:27:07,059] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,059] - [remote_util] [123145306509312] - ERROR - h [2016-09-03 12:27:07,059] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,059] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,059] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,059] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,060] - [remote_util] [123145306509312] - ERROR - n [2016-09-03 12:27:07,060] - [remote_util] [123145306509312] - ERROR - e [2016-09-03 12:27:07,060] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,060] - [remote_util] [123145306509312] - ERROR - 0 [2016-09-03 12:27:07,060] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,060] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,060] - [remote_util] [123145306509312] - ERROR - k [2016-09-03 12:27:07,060] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,061] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,061] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,061] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,061] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,061] - [remote_util] [123145306509312] - ERROR - ( [2016-09-03 12:27:07,061] - [remote_util] [123145306509312] - ERROR - 2 [2016-09-03 12:27:07,061] - [remote_util] [123145306509312] - ERROR - 1 [2016-09-03 12:27:07,061] - [remote_util] [123145306509312] - ERROR - 8 [2016-09-03 12:27:07,062] - [remote_util] [123145306509312] - ERROR - 1 [2016-09-03 12:27:07,062] - [remote_util] [123145306509312] - ERROR - 0 [2016-09-03 12:27:07,062] - [remote_util] [123145306509312] - ERROR - ) [2016-09-03 12:27:07,062] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,062] - [remote_util] [123145306509312] - ERROR - - [2016-09-03 12:27:07,062] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,062] - [remote_util] [123145306509312] - ERROR - N [2016-09-03 12:27:07,063] - [remote_util] [123145306509312] - ERROR - o [2016-09-03 12:27:07,063] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,063] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,063] - [remote_util] [123145306509312] - ERROR - u [2016-09-03 12:27:07,063] - [remote_util] [123145306509312] - ERROR - c [2016-09-03 12:27:07,063] - [remote_util] [123145306509312] - ERROR - h [2016-09-03 12:27:07,063] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,064] - [remote_util] [123145306509312] - ERROR - p [2016-09-03 12:27:07,064] - [remote_util] [123145306509312] - ERROR - r [2016-09-03 12:27:07,064] - [remote_util] [123145306509312] - ERROR - o [2016-09-03 12:27:07,064] - [remote_util] [123145306509312] - ERROR - c [2016-09-03 12:27:07,064] - [remote_util] [123145306509312] - ERROR - e [2016-09-03 12:27:07,064] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,064] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,065] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,066] - [remote_util] [123145306509312] - INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-09-03 12:27:07,066] - [remote_util] [123145306509312] - INFO - Connected to 127.0.0.1 [2016-09-03 12:27:07,084] - [remote_util] [123145306509312] - INFO - running command.raw on 127.0.0.1: /sbin/sysctl -n machdep.cpu.brand_string [2016-09-03 12:27:07,088] - [remote_util] [123145306509312] - INFO - command executed successfully [2016-09-03 12:27:07,108] - [remote_util] [123145306509312] - INFO - running command.raw on 127.0.0.1: kill $(ps aux | grep 'memcached' | awk '{print $2}') [2016-09-03 12:27:07,157] - [remote_util] [123145306509312] - INFO - command executed successfully [2016-09-03 12:27:07,157] - [remote_util] [123145306509312] - ERROR - / [2016-09-03 12:27:07,157] - [remote_util] [123145306509312] - ERROR - b [2016-09-03 12:27:07,157] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,158] - [remote_util] [123145306509312] - ERROR - n [2016-09-03 12:27:07,158] - [remote_util] [123145306509312] - ERROR - / [2016-09-03 12:27:07,158] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,158] - [remote_util] [123145306509312] - ERROR - h [2016-09-03 12:27:07,158] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,158] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,158] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,158] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,159] - [remote_util] [123145306509312] - ERROR - n [2016-09-03 12:27:07,159] - [remote_util] [123145306509312] - ERROR - e [2016-09-03 12:27:07,159] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,159] - [remote_util] [123145306509312] - ERROR - 0 [2016-09-03 12:27:07,159] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,159] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,159] - [remote_util] [123145306509312] - ERROR - k [2016-09-03 12:27:07,159] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,160] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,160] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,160] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,160] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,160] - [remote_util] [123145306509312] - ERROR - ( [2016-09-03 12:27:07,160] - [remote_util] [123145306509312] - ERROR - 2 [2016-09-03 12:27:07,160] - [remote_util] [123145306509312] - ERROR - 1 [2016-09-03 12:27:07,161] - [remote_util] [123145306509312] - ERROR - 8 [2016-09-03 12:27:07,161] - [remote_util] [123145306509312] - ERROR - 2 [2016-09-03 12:27:07,161] - [remote_util] [123145306509312] - ERROR - 7 [2016-09-03 12:27:07,161] - [remote_util] [123145306509312] - ERROR - ) [2016-09-03 12:27:07,161] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,161] - [remote_util] [123145306509312] - ERROR - - [2016-09-03 12:27:07,161] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,161] - [remote_util] [123145306509312] - ERROR - N [2016-09-03 12:27:07,162] - [remote_util] [123145306509312] - ERROR - o [2016-09-03 12:27:07,162] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,162] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,162] - [remote_util] [123145306509312] - ERROR - u [2016-09-03 12:27:07,162] - [remote_util] [123145306509312] - ERROR - c [2016-09-03 12:27:07,162] - [remote_util] [123145306509312] - ERROR - h [2016-09-03 12:27:07,162] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,162] - [remote_util] [123145306509312] - ERROR - p [2016-09-03 12:27:07,163] - [remote_util] [123145306509312] - ERROR - r [2016-09-03 12:27:07,163] - [remote_util] [123145306509312] - ERROR - o [2016-09-03 12:27:07,163] - [remote_util] [123145306509312] - ERROR - c [2016-09-03 12:27:07,163] - [remote_util] [123145306509312] - ERROR - e [2016-09-03 12:27:07,163] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,163] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,163] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,163] - [remote_util] [123145306509312] - ERROR - / [2016-09-03 12:27:07,164] - [remote_util] [123145306509312] - ERROR - b [2016-09-03 12:27:07,164] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,164] - [remote_util] [123145306509312] - ERROR - n [2016-09-03 12:27:07,164] - [remote_util] [123145306509312] - ERROR - / [2016-09-03 12:27:07,164] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,164] - [remote_util] [123145306509312] - ERROR - h [2016-09-03 12:27:07,164] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,164] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,165] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,165] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,165] - [remote_util] [123145306509312] - ERROR - n [2016-09-03 12:27:07,165] - [remote_util] [123145306509312] - ERROR - e [2016-09-03 12:27:07,165] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,165] - [remote_util] [123145306509312] - ERROR - 0 [2016-09-03 12:27:07,165] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,165] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,166] - [remote_util] [123145306509312] - ERROR - k [2016-09-03 12:27:07,166] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,166] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,166] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,166] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,166] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,166] - [remote_util] [123145306509312] - ERROR - ( [2016-09-03 12:27:07,166] - [remote_util] [123145306509312] - ERROR - 2 [2016-09-03 12:27:07,167] - [remote_util] [123145306509312] - ERROR - 1 [2016-09-03 12:27:07,167] - [remote_util] [123145306509312] - ERROR - 8 [2016-09-03 12:27:07,167] - [remote_util] [123145306509312] - ERROR - 2 [2016-09-03 12:27:07,167] - [remote_util] [123145306509312] - ERROR - 5 [2016-09-03 12:27:07,167] - [remote_util] [123145306509312] - ERROR - ) [2016-09-03 12:27:07,167] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,167] - [remote_util] [123145306509312] - ERROR - - [2016-09-03 12:27:07,168] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,168] - [remote_util] [123145306509312] - ERROR - N [2016-09-03 12:27:07,168] - [remote_util] [123145306509312] - ERROR - o [2016-09-03 12:27:07,168] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,168] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,168] - [remote_util] [123145306509312] - ERROR - u [2016-09-03 12:27:07,168] - [remote_util] [123145306509312] - ERROR - c [2016-09-03 12:27:07,168] - [remote_util] [123145306509312] - ERROR - h [2016-09-03 12:27:07,169] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,169] - [remote_util] [123145306509312] - ERROR - p [2016-09-03 12:27:07,169] - [remote_util] [123145306509312] - ERROR - r [2016-09-03 12:27:07,169] - [remote_util] [123145306509312] - ERROR - o [2016-09-03 12:27:07,170] - [remote_util] [123145306509312] - ERROR - c [2016-09-03 12:27:07,170] - [remote_util] [123145306509312] - ERROR - e [2016-09-03 12:27:07,170] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,170] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,170] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,172] - [remote_util] [123145306509312] - INFO - connecting to 127.0.0.1 with username : Administrator password : asdasd ssh_key: [2016-09-03 12:27:07,172] - [remote_util] [123145306509312] - INFO - Connected to 127.0.0.1 [2016-09-03 12:27:07,189] - [remote_util] [123145306509312] - INFO - running command.raw on 127.0.0.1: /sbin/sysctl -n machdep.cpu.brand_string [2016-09-03 12:27:07,194] - [remote_util] [123145306509312] - INFO - command executed successfully [2016-09-03 12:27:07,215] - [remote_util] [123145306509312] - INFO - running command.raw on 127.0.0.1: kill $(ps aux | grep 'memcached' | awk '{print $2}') [2016-09-03 12:27:07,254] - [remote_util] [123145306509312] - INFO - command executed successfully [2016-09-03 12:27:07,254] - [remote_util] [123145306509312] - ERROR - / [2016-09-03 12:27:07,255] - [remote_util] [123145306509312] - ERROR - b [2016-09-03 12:27:07,255] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,255] - [remote_util] [123145306509312] - ERROR - n [2016-09-03 12:27:07,255] - [remote_util] [123145306509312] - ERROR - / [2016-09-03 12:27:07,255] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,257] - [remote_util] [123145306509312] - ERROR - h [2016-09-03 12:27:07,257] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,257] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,257] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,257] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,258] - [remote_util] [123145306509312] - ERROR - n [2016-09-03 12:27:07,258] - [remote_util] [123145306509312] - ERROR - e [2016-09-03 12:27:07,258] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,258] - [remote_util] [123145306509312] - ERROR - 0 [2016-09-03 12:27:07,258] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,258] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,258] - [remote_util] [123145306509312] - ERROR - k [2016-09-03 12:27:07,258] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,259] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,259] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,259] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,259] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,259] - [remote_util] [123145306509312] - ERROR - ( [2016-09-03 12:27:07,259] - [remote_util] [123145306509312] - ERROR - 2 [2016-09-03 12:27:07,259] - [remote_util] [123145306509312] - ERROR - 1 [2016-09-03 12:27:07,259] - [remote_util] [123145306509312] - ERROR - 8 [2016-09-03 12:27:07,260] - [remote_util] [123145306509312] - ERROR - 4 [2016-09-03 12:27:07,260] - [remote_util] [123145306509312] - ERROR - 2 [2016-09-03 12:27:07,260] - [remote_util] [123145306509312] - ERROR - ) [2016-09-03 12:27:07,260] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,260] - [remote_util] [123145306509312] - ERROR - - [2016-09-03 12:27:07,260] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,260] - [remote_util] [123145306509312] - ERROR - N [2016-09-03 12:27:07,260] - [remote_util] [123145306509312] - ERROR - o [2016-09-03 12:27:07,261] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,261] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,261] - [remote_util] [123145306509312] - ERROR - u [2016-09-03 12:27:07,261] - [remote_util] [123145306509312] - ERROR - c [2016-09-03 12:27:07,261] - [remote_util] [123145306509312] - ERROR - h [2016-09-03 12:27:07,261] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,261] - [remote_util] [123145306509312] - ERROR - p [2016-09-03 12:27:07,261] - [remote_util] [123145306509312] - ERROR - r [2016-09-03 12:27:07,262] - [remote_util] [123145306509312] - ERROR - o [2016-09-03 12:27:07,262] - [remote_util] [123145306509312] - ERROR - c [2016-09-03 12:27:07,262] - [remote_util] [123145306509312] - ERROR - e [2016-09-03 12:27:07,262] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,262] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,262] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,262] - [remote_util] [123145306509312] - ERROR - / [2016-09-03 12:27:07,262] - [remote_util] [123145306509312] - ERROR - b [2016-09-03 12:27:07,263] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,263] - [remote_util] [123145306509312] - ERROR - n [2016-09-03 12:27:07,263] - [remote_util] [123145306509312] - ERROR - / [2016-09-03 12:27:07,263] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,263] - [remote_util] [123145306509312] - ERROR - h [2016-09-03 12:27:07,263] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,263] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,263] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,264] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,264] - [remote_util] [123145306509312] - ERROR - n [2016-09-03 12:27:07,264] - [remote_util] [123145306509312] - ERROR - e [2016-09-03 12:27:07,264] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,264] - [remote_util] [123145306509312] - ERROR - 0 [2016-09-03 12:27:07,264] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,264] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,264] - [remote_util] [123145306509312] - ERROR - k [2016-09-03 12:27:07,265] - [remote_util] [123145306509312] - ERROR - i [2016-09-03 12:27:07,265] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,265] - [remote_util] [123145306509312] - ERROR - l [2016-09-03 12:27:07,265] - [remote_util] [123145306509312] - ERROR - : [2016-09-03 12:27:07,265] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,265] - [remote_util] [123145306509312] - ERROR - ( [2016-09-03 12:27:07,265] - [remote_util] [123145306509312] - ERROR - 2 [2016-09-03 12:27:07,266] - [remote_util] [123145306509312] - ERROR - 1 [2016-09-03 12:27:07,266] - [remote_util] [123145306509312] - ERROR - 8 [2016-09-03 12:27:07,266] - [remote_util] [123145306509312] - ERROR - 4 [2016-09-03 12:27:07,266] - [remote_util] [123145306509312] - ERROR - 0 [2016-09-03 12:27:07,266] - [remote_util] [123145306509312] - ERROR - ) [2016-09-03 12:27:07,266] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,266] - [remote_util] [123145306509312] - ERROR - - [2016-09-03 12:27:07,266] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,267] - [remote_util] [123145306509312] - ERROR - N [2016-09-03 12:27:07,267] - [remote_util] [123145306509312] - ERROR - o [2016-09-03 12:27:07,267] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,267] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,267] - [remote_util] [123145306509312] - ERROR - u [2016-09-03 12:27:07,267] - [remote_util] [123145306509312] - ERROR - c [2016-09-03 12:27:07,267] - [remote_util] [123145306509312] - ERROR - h [2016-09-03 12:27:07,267] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,268] - [remote_util] [123145306509312] - ERROR - p [2016-09-03 12:27:07,268] - [remote_util] [123145306509312] - ERROR - r [2016-09-03 12:27:07,268] - [remote_util] [123145306509312] - ERROR - o [2016-09-03 12:27:07,268] - [remote_util] [123145306509312] - ERROR - c [2016-09-03 12:27:07,268] - [remote_util] [123145306509312] - ERROR - e [2016-09-03 12:27:07,268] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,268] - [remote_util] [123145306509312] - ERROR - s [2016-09-03 12:27:07,268] - [remote_util] [123145306509312] - ERROR - [2016-09-03 12:27:07,270] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:10,271] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:13,298] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:16,301] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:19,304] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:22,306] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:25,308] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:28,311] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:31,314] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:34,320] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:37,323] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:40,325] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:43,327] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:46,330] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:49,336] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:52,342] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:55,347] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:27:58,349] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:01,356] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:04,365] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:07,371] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:10,377] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:13,397] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:16,404] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:19,408] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:22,412] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:25,415] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:28,417] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:31,420] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:34,424] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:37,427] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:40,429] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:43,437] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:46,445] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:49,449] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:52,452] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:55,458] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:28:58,464] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:29:01,467] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:29:04,472] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused [2016-09-03 12:29:07,479] - [rest_client] [123145306509312] - ERROR - socket error while connecting to http://127.0.0.1:9000/nodes/self error [Errno 61] Connection refused