./testrunner -i b/try.ini -p -t epengine.basic_collections.basic_collections.test_memecached_basic_api Test Input params: {'ini': 'b/try.ini', 'cluster_name': 'try', 'num_nodes': 2, 'case_number': 1, 'logs_folder': '/Users/anithakuberan/Documents/testlib/venv/testrunner-py3/logs/testrunner-19-Nov-28_13-56-59/test_1'} Run before suite setup for epengine.basic_collections.basic_collections.test_memecached_basic_api /Users/anithakuberan/Documents/testlib/venv/lib/python3.7/site-packages/couchbase/result.py:283: DeprecationWarning: __class__ not set defining 'SDK2AsyncResult' as .Wrapped'>. Was __classcell__ propagated to type.__new__? class SDK2AsyncResult(with_metaclass(AsyncWrapper, SDK2GetResult)): /Users/anithakuberan/Documents/testlib/venv/lib/python3.7/site-packages/couchbase/result.py:299: DeprecationWarning: __class__ not set defining 'SDK2AsyncMutationResult' as .Wrapped'>. Was __classcell__ propagated to type.__new__? class SDK2AsyncMutationResult(with_metaclass(AsyncWrapper, SDK2MutationResult)): /Users/anithakuberan/Documents/testlib/venv/lib/python3.7/site-packages/couchbase_core/asynchronous/bucket.py:186: DeprecationWarning: __class__ not set defining 'AsyncClient' as .AsyncClient'>. Was __classcell__ propagated to type.__new__? class AsyncClient(with_metaclass(AsyncClientFactory, CoreClient)): /Users/anithakuberan/Documents/testlib/venv/lib/python3.7/site-packages/boltons/funcutils.py:552: DeprecationWarning: `formatargspec` is deprecated since Python 3.5. Use `signature` and the `Signature` object directly **formatters) /Users/anithakuberan/Documents/testlib/venv/lib/python3.7/site-packages/couchbase/collection.py:1413: DeprecationWarning: __class__ not set defining 'AsyncCBCollection' as .AsyncClient'>. Was __classcell__ propagated to type.__new__? class AsyncCBCollection(with_metaclass(AsyncClientFactory, CBCollection)): -->before_suite_name:epengine.basic_collections.basic_collections.suite_setUp,suite: ]> suite_setUp (epengine.basic_collections.basic_collections) ... 2019-11-28 13:56:59 | INFO | MainProcess | MainThread | [remote_util.__init__] connecting to 10.112.190.101 with username:root 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [remote_util.__init__] Connected to 10.112.190.101 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [remote_util.extract_remote_info] It could be other operating system. Go to check at other location lib/membase/api/rest_client.py:802: DeprecationWarning: encodestring() is a deprecated alias since 3.1, use encodebytes() authorization = base64.encodestring(('%s:%s' % (self.username, self.password)).encode()).decode() 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [rest_client.get_nodes_version] Node version in cluster 7.0.0-1086-community 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [rest_client.get_nodes_versions] Node versions in cluster ['7.0.0-1086-community'] 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [basetestcase.setUp] ============== basetestcase setup was started for test #1 suite_setUp============== 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.101:8091 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.101:8091 is running 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.102:8091 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.102:8091 is running 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] ------- Cluster statistics ------- 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] 10.112.190.101:8091 => {'services': ['kv'], 'cpu_utilization': 0, 'mem_free': 584634368, 'mem_total': 1042685952, 'swap_mem_used': 602112, 'swap_mem_total': 1107292160} 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] --- End of cluster statistics --- 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [basetestcase.tearDown] ============== basetestcase cleanup was started for test #1 suite_setUp ============== 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.101:8091 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.101:8091 is running 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.102:8091 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.102:8091 is running 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [basetestcase.tearDown] ============== basetestcase cleanup was finished for test #1 suite_setUp ============== Cluster instance shutdown with force 2019-11-28 13:57:00 | INFO | MainProcess | MainThread | [basetestcase.setUp] initializing cluster 2019-11-28 13:57:01 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:10.112.190.101 port:8091 ssh_username:root, nodes/self: {'uptime': '7476', 'memoryTotal': 1042685952, 'memoryFree': 584634368, 'mcdMemoryReserved': 795, 'mcdMemoryAllocated': 795, 'status': 'healthy', 'hostname': '10.112.190.101:8091', 'clusterCompatibility': 393221, 'clusterMembership': 'active', 'version': '7.0.0-1086-community', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 532, 'moxi': 11211, 'memcached': 11210, 'id': 'ns_1@cb.local', 'ip': '10.112.190.101', 'rest_username': '', 'rest_password': '', 'port': '8091', 'services': ['kv'], 'storageTotalRam': 994, 'curr_items': 0} 2019-11-28 13:57:01 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=532 2019-11-28 13:57:01 | INFO | MainProcess | Cluster_Thread | [rest_client.init_node_services] --> init_node_services(Administrator,password,10.112.190.101,8091,['kv']) 2019-11-28 13:57:01 | INFO | MainProcess | Cluster_Thread | [rest_client.init_node_services] /node/controller/setupServices params on 10.112.190.101: 8091:hostname=10.112.190.101&user=Administrator&password=password&services=kv lib/membase/api/rest_client.py:845: DeprecationWarning: decodestring() is a deprecated alias since Python 3.1, use decodebytes() return str("auth: " + base64.decodestring(val[6:]).decode()) 2019-11-28 13:57:01 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://10.112.190.101:8091//node/controller/setupServices body: hostname=10.112.190.101&user=Administrator&password=password&services=kv headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'["cannot change node services after cluster is provisioned"]' auth: Administrator:password 2019-11-28 13:57:01 | INFO | MainProcess | Cluster_Thread | [rest_client.init_node_services] This node is already provisioned with services, we do not consider this as failure for test case 2019-11-28 13:57:01 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> in init_cluster...Administrator,password,8091 2019-11-28 13:57:01 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 10.112.190.101:8091:port=8091&username=Administrator&password=password 2019-11-28 13:57:01 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> status:True 2019-11-28 13:57:01 | INFO | MainProcess | Cluster_Thread | [remote_util.__init__] connecting to 10.112.190.101 with username:root 2019-11-28 13:57:01 | INFO | MainProcess | Cluster_Thread | [remote_util.__init__] Connected to 10.112.190.101 2019-11-28 13:57:01 | INFO | MainProcess | Cluster_Thread | [remote_util.extract_remote_info] It could be other operating system. Go to check at other location 2019-11-28 13:57:01 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command start: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:01 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] running command.raw on 10.112.190.101: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] command executed successfully 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command end: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).', ['ok'], [' % Total % Received % Xferd Average Speed Time Time Time Current', ' Dload Upload Total Spent Left Speed', '', ' 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0', '100 43 100 2 100 41 12 265 --:--:-- --:--:-- --:--:-- 266'] 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 10.112.190.101:8091: True content: b'[6,5]' command: cluster_compat_mode:get_compat_version(). 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 10.112.190.101:8091: True content: b'[6,5]' command: cluster_compat_mode:get_compat_version(). 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=plasma 2019-11-28 13:57:02 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://10.112.190.101:8091/settings/indexes body: storageMode=plasma headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [forestdb]"}}' auth: Administrator:password 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:10.112.190.102 port:8091 ssh_username:root, nodes/self: {'uptime': '7481', 'memoryTotal': 1042685952, 'memoryFree': 654270464, 'mcdMemoryReserved': 795, 'mcdMemoryAllocated': 795, 'status': 'healthy', 'hostname': '10.112.190.102:8091', 'clusterCompatibility': 393221, 'clusterMembership': 'active', 'version': '7.0.0-1086-community', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 532, 'moxi': 11211, 'memcached': 11210, 'id': 'ns_1@cb.local', 'ip': '10.112.190.102', 'rest_username': '', 'rest_password': '', 'port': '8091', 'services': ['kv'], 'storageTotalRam': 994, 'curr_items': 0} 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=532 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> in init_cluster...Administrator,password,8091 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 10.112.190.102:8091:port=8091&username=Administrator&password=password 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> status:True 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [remote_util.__init__] connecting to 10.112.190.102 with username:root 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [remote_util.__init__] Connected to 10.112.190.102 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [remote_util.extract_remote_info] It could be other operating system. Go to check at other location 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command start: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] running command.raw on 10.112.190.102: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] command executed successfully 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command end: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).', ['ok'], [' % Total % Received % Xferd Average Speed Time Time Time Current', ' Dload Upload Total Spent Left Speed', '', ' 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0', '100 43 100 2 100 41 13 266 --:--:-- --:--:-- --:--:-- 267'] 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 10.112.190.102:8091: True content: b'[6,5]' command: cluster_compat_mode:get_compat_version(). 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 10.112.190.102:8091: True content: b'[6,5]' command: cluster_compat_mode:get_compat_version(). 2019-11-28 13:57:02 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=plasma 2019-11-28 13:57:02 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://10.112.190.102:8091/settings/indexes body: storageMode=plasma headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [forestdb]"}}' auth: Administrator:password 2019-11-28 13:57:02 | INFO | MainProcess | MainThread | [basetestcase.add_built_in_server_user] **** add built-in 'cbadminbucket' user to node 10.112.190.101 **** 2019-11-28 13:57:02 | INFO | MainProcess | MainThread | [basetestcase.add_built_in_server_user] **** add 'admin' role to 'cbadminbucket' user **** 2019-11-28 13:57:03 | INFO | MainProcess | MainThread | [basetestcase.setUp] done initializing cluster 2019-11-28 13:57:03 | INFO | MainProcess | MainThread | [remote_util.__init__] connecting to 10.112.190.101 with username:root 2019-11-28 13:57:03 | INFO | MainProcess | MainThread | [remote_util.__init__] Connected to 10.112.190.101 2019-11-28 13:57:03 | INFO | MainProcess | MainThread | [remote_util.extract_remote_info] It could be other operating system. Go to check at other location 2019-11-28 13:57:03 | INFO | MainProcess | MainThread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command start: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:03 | INFO | MainProcess | MainThread | [remote_util.execute_command_raw] running command.raw on 10.112.190.101: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:03 | INFO | MainProcess | MainThread | [remote_util.execute_command_raw] command executed successfully 2019-11-28 13:57:03 | INFO | MainProcess | MainThread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command end: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).', ['ok'], [' % Total % Received % Xferd Average Speed Time Time Time Current', ' Dload Upload Total Spent Left Speed', '', ' 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0', '100 43 100 2 100 41 13 268 --:--:-- --:--:-- --:--:-- 269'] 2019-11-28 13:57:03 | INFO | MainProcess | MainThread | [basetestcase.enable_diag_eval_on_non_local_hosts] Enabled diag/eval for non-local hosts from 10.112.190.101 2019-11-28 13:57:03 | ERROR | MainProcess | Cluster_Thread | [rest_client.is_enterprise_edition] IP(s) for node(s) with community edition ['10.112.190.101'] 2019-11-28 13:57:03 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] http://10.112.190.101:8091/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=532&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly 2019-11-28 13:57:03 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] 0.01 seconds to create bucket default 2019-11-28 13:57:03 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 10.112.190.101 to accept set ops 2019-11-28 13:57:04 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 10.112.190.101:11210 default 2019-11-28 13:57:04 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 10.112.190.101:11210 default 2019-11-28 13:57:06 | INFO | MainProcess | Cluster_Thread | [task.check] bucket 'default' was created with per node RAM quota: 532 2019-11-28 13:57:06 | INFO | MainProcess | MainThread | [basetestcase.setUp] ============== basetestcase setup was finished for test #1 suite_setUp ============== 2019-11-28 13:57:06 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] ------- Cluster statistics ------- 2019-11-28 13:57:06 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] 10.112.190.101:8091 => {'services': ['kv'], 'cpu_utilization': 22.34042553191489, 'mem_free': 579141632, 'mem_total': 1042685952, 'swap_mem_used': 602112, 'swap_mem_total': 1107292160} 2019-11-28 13:57:06 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] --- End of cluster statistics --- 2019-11-28 13:57:06 | INFO | MainProcess | MainThread | [basetestcase.suite_setUp] ============== BaseTestCase suite_setup has started ============== 2019-11-28 13:57:06 | INFO | MainProcess | MainThread | [basetestcase.suite_setUp] ============== BaseTestCase suite_setup has completed ============== 2019-11-28 13:57:06 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] ------- Cluster statistics ------- 2019-11-28 13:57:06 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] 10.112.190.101:8091 => {'services': ['kv'], 'cpu_utilization': 22.34042553191489, 'mem_free': 579141632, 'mem_total': 1042685952, 'swap_mem_used': 602112, 'swap_mem_total': 1107292160} 2019-11-28 13:57:06 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] --- End of cluster statistics --- 2019-11-28 13:57:06 | INFO | MainProcess | MainThread | [basetestcase.tearDown] ============== basetestcase cleanup was started for test #1 suite_setUp ============== 2019-11-28 13:57:06 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets ['default'] on 10.112.190.101 2019-11-28 13:57:06 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] remove bucket default ... 2019-11-28 13:57:06 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] deleted bucket : default from 10.112.190.101 2019-11-28 13:57:06 | INFO | MainProcess | MainThread | [bucket_helper.wait_for_bucket_deletion] waiting for bucket deletion to complete.... 2019-11-28 13:57:06 | INFO | MainProcess | MainThread | [rest_client.bucket_exists] node 10.112.190.101 existing buckets : [] 2019-11-28 13:57:06 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] sleep 2 seconds to make sure all buckets (['default']) were deleted completely. 2019-11-28 13:57:08 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.101:8091 2019-11-28 13:57:08 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.101:8091 is running 2019-11-28 13:57:08 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.102:8091 2019-11-28 13:57:08 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.102:8091 is running 2019-11-28 13:57:08 | INFO | MainProcess | MainThread | [basetestcase.tearDown] ============== basetestcase cleanup was finished for test #1 suite_setUp ============== Cluster instance shutdown with force ok ---------------------------------------------------------------------- Ran 1 test in 8.634s OK -->result: test_memecached_basic_api (epengine.basic_collections.basic_collections) ... 2019-11-28 13:57:08 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.112.190.101 with username:root 2019-11-28 13:57:08 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.112.190.101 2019-11-28 13:57:08 | INFO | MainProcess | test_thread | [remote_util.extract_remote_info] It could be other operating system. Go to check at other location lib/membase/api/rest_client.py:802: DeprecationWarning: encodestring() is a deprecated alias since 3.1, use encodebytes() authorization = base64.encodestring(('%s:%s' % (self.username, self.password)).encode()).decode() 2019-11-28 13:57:08 | INFO | MainProcess | test_thread | [rest_client.get_nodes_version] Node version in cluster 7.0.0-1086-community 2019-11-28 13:57:08 | INFO | MainProcess | test_thread | [rest_client.get_nodes_versions] Node versions in cluster ['7.0.0-1086-community'] 2019-11-28 13:57:08 | INFO | MainProcess | test_thread | [basetestcase.setUp] ============== basetestcase setup was started for test #1 test_memecached_basic_api============== 2019-11-28 13:57:09 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.101:8091 2019-11-28 13:57:09 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.101:8091 is running 2019-11-28 13:57:09 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.102:8091 2019-11-28 13:57:09 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.102:8091 is running 2019-11-28 13:57:09 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] ------- Cluster statistics ------- 2019-11-28 13:57:09 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] 10.112.190.101:8091 => {'services': ['kv'], 'cpu_utilization': 3.092783505154639, 'mem_free': 540381184, 'mem_total': 1042685952, 'swap_mem_used': 602112, 'swap_mem_total': 1107292160} 2019-11-28 13:57:09 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] --- End of cluster statistics --- 2019-11-28 13:57:09 | INFO | MainProcess | test_thread | [basetestcase.tearDown] ============== basetestcase cleanup was started for test #1 test_memecached_basic_api ============== 2019-11-28 13:57:09 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.101:8091 2019-11-28 13:57:09 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.101:8091 is running 2019-11-28 13:57:09 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.102:8091 2019-11-28 13:57:09 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.102:8091 is running 2019-11-28 13:57:09 | INFO | MainProcess | test_thread | [basetestcase.tearDown] ============== basetestcase cleanup was finished for test #1 test_memecached_basic_api ============== Cluster instance shutdown with force 2019-11-28 13:57:09 | INFO | MainProcess | test_thread | [basetestcase.setUp] initializing cluster 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:10.112.190.101 port:8091 ssh_username:root, nodes/self: {'uptime': '7486', 'memoryTotal': 1042685952, 'memoryFree': 540381184, 'mcdMemoryReserved': 795, 'mcdMemoryAllocated': 795, 'status': 'healthy', 'hostname': '10.112.190.101:8091', 'clusterCompatibility': 393221, 'clusterMembership': 'active', 'version': '7.0.0-1086-community', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 532, 'moxi': 11211, 'memcached': 11210, 'id': 'ns_1@cb.local', 'ip': '10.112.190.101', 'rest_username': '', 'rest_password': '', 'port': '8091', 'services': ['kv'], 'storageTotalRam': 994, 'curr_items': 0} 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=532 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [rest_client.init_node_services] --> init_node_services(Administrator,password,10.112.190.101,8091,['kv']) 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [rest_client.init_node_services] /node/controller/setupServices params on 10.112.190.101: 8091:hostname=10.112.190.101&user=Administrator&password=password&services=kv lib/membase/api/rest_client.py:845: DeprecationWarning: decodestring() is a deprecated alias since Python 3.1, use decodebytes() return str("auth: " + base64.decodestring(val[6:]).decode()) 2019-11-28 13:57:10 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://10.112.190.101:8091//node/controller/setupServices body: hostname=10.112.190.101&user=Administrator&password=password&services=kv headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'["cannot change node services after cluster is provisioned"]' auth: Administrator:password 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [rest_client.init_node_services] This node is already provisioned with services, we do not consider this as failure for test case 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> in init_cluster...Administrator,password,8091 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 10.112.190.101:8091:port=8091&username=Administrator&password=password 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> status:True 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [remote_util.__init__] connecting to 10.112.190.101 with username:root 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [remote_util.__init__] Connected to 10.112.190.101 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [remote_util.extract_remote_info] It could be other operating system. Go to check at other location 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command start: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] running command.raw on 10.112.190.101: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] command executed successfully 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command end: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).', ['ok'], [' % Total % Received % Xferd Average Speed Time Time Time Current', ' Dload Upload Total Spent Left Speed', '', ' 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0', '100 43 100 2 100 41 12 265 --:--:-- --:--:-- --:--:-- 267'] 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 10.112.190.101:8091: True content: b'[6,5]' command: cluster_compat_mode:get_compat_version(). 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 10.112.190.101:8091: True content: b'[6,5]' command: cluster_compat_mode:get_compat_version(). 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=plasma 2019-11-28 13:57:10 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://10.112.190.101:8091/settings/indexes body: storageMode=plasma headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [forestdb]"}}' auth: Administrator:password 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:10.112.190.102 port:8091 ssh_username:root, nodes/self: {'uptime': '7486', 'memoryTotal': 1042685952, 'memoryFree': 654594048, 'mcdMemoryReserved': 795, 'mcdMemoryAllocated': 795, 'status': 'healthy', 'hostname': '10.112.190.102:8091', 'clusterCompatibility': 393221, 'clusterMembership': 'active', 'version': '7.0.0-1086-community', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 532, 'moxi': 11211, 'memcached': 11210, 'id': 'ns_1@cb.local', 'ip': '10.112.190.102', 'rest_username': '', 'rest_password': '', 'port': '8091', 'services': ['kv'], 'storageTotalRam': 994, 'curr_items': 0} 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=532 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> in init_cluster...Administrator,password,8091 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 10.112.190.102:8091:port=8091&username=Administrator&password=password 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> status:True 2019-11-28 13:57:10 | INFO | MainProcess | Cluster_Thread | [remote_util.__init__] connecting to 10.112.190.102 with username:root 2019-11-28 13:57:11 | INFO | MainProcess | Cluster_Thread | [remote_util.__init__] Connected to 10.112.190.102 2019-11-28 13:57:11 | INFO | MainProcess | Cluster_Thread | [remote_util.extract_remote_info] It could be other operating system. Go to check at other location 2019-11-28 13:57:11 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command start: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:11 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] running command.raw on 10.112.190.102: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:11 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] command executed successfully 2019-11-28 13:57:11 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command end: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).', ['ok'], [' % Total % Received % Xferd Average Speed Time Time Time Current', ' Dload Upload Total Spent Left Speed', '', ' 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0', '100 43 100 2 100 41 12 264 --:--:-- --:--:-- --:--:-- 266'] 2019-11-28 13:57:11 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 10.112.190.102:8091: True content: b'[6,5]' command: cluster_compat_mode:get_compat_version(). 2019-11-28 13:57:11 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 10.112.190.102:8091: True content: b'[6,5]' command: cluster_compat_mode:get_compat_version(). 2019-11-28 13:57:11 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=plasma 2019-11-28 13:57:11 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://10.112.190.102:8091/settings/indexes body: storageMode=plasma headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [forestdb]"}}' auth: Administrator:password 2019-11-28 13:57:11 | INFO | MainProcess | test_thread | [basetestcase.add_built_in_server_user] **** add built-in 'cbadminbucket' user to node 10.112.190.101 **** 2019-11-28 13:57:11 | INFO | MainProcess | test_thread | [basetestcase.add_built_in_server_user] **** add 'admin' role to 'cbadminbucket' user **** 2019-11-28 13:57:11 | INFO | MainProcess | test_thread | [basetestcase.setUp] done initializing cluster 2019-11-28 13:57:11 | INFO | MainProcess | test_thread | [remote_util.__init__] connecting to 10.112.190.101 with username:root 2019-11-28 13:57:11 | INFO | MainProcess | test_thread | [remote_util.__init__] Connected to 10.112.190.101 2019-11-28 13:57:11 | INFO | MainProcess | test_thread | [remote_util.extract_remote_info] It could be other operating system. Go to check at other location 2019-11-28 13:57:12 | INFO | MainProcess | test_thread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command start: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:12 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] running command.raw on 10.112.190.101: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:12 | INFO | MainProcess | test_thread | [remote_util.execute_command_raw] command executed successfully 2019-11-28 13:57:12 | INFO | MainProcess | test_thread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command end: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).', ['ok'], [' % Total % Received % Xferd Average Speed Time Time Time Current', ' Dload Upload Total Spent Left Speed', '', ' 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0', '100 43 100 2 100 41 12 265 --:--:-- --:--:-- --:--:-- 266'] 2019-11-28 13:57:12 | INFO | MainProcess | test_thread | [basetestcase.enable_diag_eval_on_non_local_hosts] Enabled diag/eval for non-local hosts from 10.112.190.101 2019-11-28 13:57:12 | ERROR | MainProcess | Cluster_Thread | [rest_client.is_enterprise_edition] IP(s) for node(s) with community edition ['10.112.190.101'] 2019-11-28 13:57:12 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] http://10.112.190.101:8091/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=532&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly 2019-11-28 13:57:12 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] 0.00 seconds to create bucket default 2019-11-28 13:57:12 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 10.112.190.101 to accept set ops 2019-11-28 13:57:13 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 10.112.190.101:11210 default 2019-11-28 13:57:13 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 10.112.190.101:11210 default 2019-11-28 13:57:14 | INFO | MainProcess | Cluster_Thread | [task.check] bucket 'default' was created with per node RAM quota: 532 2019-11-28 13:57:14 | INFO | MainProcess | test_thread | [basetestcase.setUp] ============== basetestcase setup was finished for test #1 test_memecached_basic_api ============== 2019-11-28 13:57:14 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] ------- Cluster statistics ------- 2019-11-28 13:57:14 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] 10.112.190.101:8091 => {'services': ['kv'], 'cpu_utilization': 20.65217391304348, 'mem_free': 559505408, 'mem_total': 1042685952, 'swap_mem_used': 602112, 'swap_mem_total': 1107292160} 2019-11-28 13:57:14 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] --- End of cluster statistics --- 2019-11-28 13:57:14 | INFO | MainProcess | test_thread | [basetestcase.create_scope] Scope creation passed, name=ScopeWith30CharactersinName123 2019-11-28 13:57:14 | INFO | MainProcess | test_thread | [basetestcase.create_collection] Collection creation passed, name=CollectionsWithLargeNamechecki 2019-11-28 13:57:14 | INFO | MainProcess | test_thread | [basic_collections.test_memecached_basic_api] colelction name is ScopeWith30CharactersinName123.CollectionsWithLargeNamechecki 2019-11-28 13:57:14 | INFO | MainProcess | test_thread | [basetestcase.sleep] sleep for 10 secs. ... /Users/anithakuberan/Documents/testlib/venv/lib/python3.7/site-packages/couchbase_core/supportability.py:22: UserWarning: 'Bucket.collection' is an uncommitted API call which may be subject to change in future. warnings.warn(message % "'{}'".format(func_name)) /Users/anithakuberan/Documents/testlib/venv/lib/python3.7/site-packages/couchbase_core/supportability.py:22: UserWarning: 'Scope.collection' is an uncommitted API call which may be subject to change in future. warnings.warn(message % "'{}'".format(func_name)) going to do set , >, nodes=['10.112.190.101:8091'] at 0x10d02daf0> collection object is , >, nodes=['10.112.190.101:8091'] at 0x10d02daf0> going to do set , >, nodes=['10.112.190.101:8091'] at 0x10d02de20> collection object is , >, nodes=['10.112.190.101:8091'] at 0x10d02de20> 2019-11-28 13:57:30 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] ------- Cluster statistics ------- 2019-11-28 13:57:30 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] 10.112.190.101:8091 => {'services': ['kv'], 'cpu_utilization': 4.210526315789473, 'mem_free': 531714048, 'mem_total': 1042685952, 'swap_mem_used': 602112, 'swap_mem_total': 1107292160} 2019-11-28 13:57:30 | INFO | MainProcess | test_thread | [basetestcase.print_cluster_stats] --- End of cluster statistics --- 2019-11-28 13:57:30 | INFO | MainProcess | test_thread | [basetestcase.tearDown] ============== basetestcase cleanup was started for test #1 test_memecached_basic_api ============== 2019-11-28 13:57:30 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets ['default'] on 10.112.190.101 2019-11-28 13:57:30 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] remove bucket default ... 2019-11-28 13:57:30 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] deleted bucket : default from 10.112.190.101 2019-11-28 13:57:30 | INFO | MainProcess | test_thread | [bucket_helper.wait_for_bucket_deletion] waiting for bucket deletion to complete.... 2019-11-28 13:57:30 | INFO | MainProcess | test_thread | [rest_client.bucket_exists] node 10.112.190.101 existing buckets : [] 2019-11-28 13:57:30 | INFO | MainProcess | test_thread | [bucket_helper.delete_all_buckets_or_assert] sleep 2 seconds to make sure all buckets (['default']) were deleted completely. 2019-11-28 13:57:32 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.101:8091 2019-11-28 13:57:32 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.101:8091 is running 2019-11-28 13:57:32 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.102:8091 2019-11-28 13:57:32 | INFO | MainProcess | test_thread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.102:8091 is running 2019-11-28 13:57:32 | INFO | MainProcess | test_thread | [basetestcase.tearDown] ============== basetestcase cleanup was finished for test #1 test_memecached_basic_api ============== Cluster instance shutdown with force ERROR ====================================================================== ERROR: test_memecached_basic_api (epengine.basic_collections.basic_collections) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/epengine/basic_collections.py", line 88, in test_memecached_basic_api client.set("key", 0, 0, "value", collection='_default.default') File "lib/sdk_client.py", line 878, in set self.collection.insert(key, value, ttl = exp) File "", line 2, in insert File "/Users/anithakuberan/Documents/testlib/venv/lib/python3.7/site-packages/couchbase/result.py", line 375, in mutated result = func(*args, **kwargs) File "/Users/anithakuberan/Documents/testlib/venv/lib/python3.7/site-packages/couchbase/collection.py", line 857, in insert return ResultPrecursor(_Base.insert(self, key, value, **final_options), final_options) couchbase_core.exceptions._KeyExistsException_0xC (generated, catch KeyExistsException): ---------------------------------------------------------------------- Ran 1 test in 24.025s FAILED (errors=1) summary so far suite epengine.basic_collections.basic_collections , pass 0 , fail 1 failures so far... epengine.basic_collections.basic_collections.test_memecached_basic_api testrunner logs, diags and results are available under /Users/anithakuberan/Documents/testlib/venv/testrunner-py3/logs/testrunner-19-Nov-28_13-56-59/test_1 Run after suite setup for epengine.basic_collections.basic_collections.test_memecached_basic_api suite_tearDown (epengine.basic_collections.basic_collections) ... 2019-11-28 13:57:32 | INFO | MainProcess | MainThread | [remote_util.__init__] connecting to 10.112.190.101 with username:root 2019-11-28 13:57:32 | INFO | MainProcess | MainThread | [remote_util.__init__] Connected to 10.112.190.101 2019-11-28 13:57:32 | INFO | MainProcess | MainThread | [remote_util.extract_remote_info] It could be other operating system. Go to check at other location lib/membase/api/rest_client.py:802: DeprecationWarning: encodestring() is a deprecated alias since 3.1, use encodebytes() authorization = base64.encodestring(('%s:%s' % (self.username, self.password)).encode()).decode() 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [rest_client.get_nodes_version] Node version in cluster 7.0.0-1086-community 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [rest_client.get_nodes_versions] Node versions in cluster ['7.0.0-1086-community'] 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [basetestcase.setUp] ============== basetestcase setup was started for test #1 suite_tearDown============== 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.101:8091 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.101:8091 is running 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.102:8091 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.102:8091 is running 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] ------- Cluster statistics ------- 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] 10.112.190.101:8091 => {'services': ['kv'], 'cpu_utilization': 7.526881720430108, 'mem_free': 529317888, 'mem_total': 1042685952, 'swap_mem_used': 602112, 'swap_mem_total': 1107292160} 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] --- End of cluster statistics --- 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [basetestcase.tearDown] ============== basetestcase cleanup was started for test #1 suite_tearDown ============== 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.101:8091 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.101:8091 is running 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.102:8091 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.102:8091 is running 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [basetestcase.tearDown] ============== basetestcase cleanup was finished for test #1 suite_tearDown ============== Cluster instance shutdown with force 2019-11-28 13:57:33 | INFO | MainProcess | MainThread | [basetestcase.setUp] initializing cluster 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:10.112.190.101 port:8091 ssh_username:root, nodes/self: {'uptime': '7511', 'memoryTotal': 1042685952, 'memoryFree': 531832832, 'mcdMemoryReserved': 795, 'mcdMemoryAllocated': 795, 'status': 'healthy', 'hostname': '10.112.190.101:8091', 'clusterCompatibility': 393221, 'clusterMembership': 'active', 'version': '7.0.0-1086-community', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 532, 'moxi': 11211, 'memcached': 11210, 'id': 'ns_1@cb.local', 'ip': '10.112.190.101', 'rest_username': '', 'rest_password': '', 'port': '8091', 'services': ['kv'], 'storageTotalRam': 994, 'curr_items': 0} 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=532 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [rest_client.init_node_services] --> init_node_services(Administrator,password,10.112.190.101,8091,['kv']) 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [rest_client.init_node_services] /node/controller/setupServices params on 10.112.190.101: 8091:hostname=10.112.190.101&user=Administrator&password=password&services=kv lib/membase/api/rest_client.py:845: DeprecationWarning: decodestring() is a deprecated alias since Python 3.1, use decodebytes() return str("auth: " + base64.decodestring(val[6:]).decode()) 2019-11-28 13:57:34 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://10.112.190.101:8091//node/controller/setupServices body: hostname=10.112.190.101&user=Administrator&password=password&services=kv headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'["cannot change node services after cluster is provisioned"]' auth: Administrator:password 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [rest_client.init_node_services] This node is already provisioned with services, we do not consider this as failure for test case 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> in init_cluster...Administrator,password,8091 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 10.112.190.101:8091:port=8091&username=Administrator&password=password 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> status:True 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [remote_util.__init__] connecting to 10.112.190.101 with username:root 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [remote_util.__init__] Connected to 10.112.190.101 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [remote_util.extract_remote_info] It could be other operating system. Go to check at other location 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command start: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] running command.raw on 10.112.190.101: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] command executed successfully 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command end: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).', ['ok'], [' % Total % Received % Xferd Average Speed Time Time Time Current', ' Dload Upload Total Spent Left Speed', '', ' 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0', ' 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0', '100 43 100 2 100 41 12 265 --:--:-- --:--:-- --:--:-- 264'] 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 10.112.190.101:8091: True content: b'[6,5]' command: cluster_compat_mode:get_compat_version(). 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 10.112.190.101:8091: True content: b'[6,5]' command: cluster_compat_mode:get_compat_version(). 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=plasma 2019-11-28 13:57:34 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://10.112.190.101:8091/settings/indexes body: storageMode=plasma headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [forestdb]"}}' auth: Administrator:password 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [task.execute] server: ip:10.112.190.102 port:8091 ssh_username:root, nodes/self: {'uptime': '7511', 'memoryTotal': 1042685952, 'memoryFree': 652771328, 'mcdMemoryReserved': 795, 'mcdMemoryAllocated': 795, 'status': 'healthy', 'hostname': '10.112.190.102:8091', 'clusterCompatibility': 393221, 'clusterMembership': 'active', 'version': '7.0.0-1086-community', 'os': 'x86_64-unknown-linux-gnu', 'ports': [], 'availableStorage': [], 'storage': [], 'memoryQuota': 532, 'moxi': 11211, 'memcached': 11210, 'id': 'ns_1@cb.local', 'ip': '10.112.190.102', 'rest_username': '', 'rest_password': '', 'port': '8091', 'services': ['kv'], 'storageTotalRam': 994, 'curr_items': 0} 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster_memoryQuota] pools/default params : memoryQuota=532 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> in init_cluster...Administrator,password,8091 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] settings/web params on 10.112.190.102:8091:port=8091&username=Administrator&password=password 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [rest_client.init_cluster] --> status:True 2019-11-28 13:57:34 | INFO | MainProcess | Cluster_Thread | [remote_util.__init__] connecting to 10.112.190.102 with username:root 2019-11-28 13:57:35 | INFO | MainProcess | Cluster_Thread | [remote_util.__init__] Connected to 10.112.190.102 2019-11-28 13:57:35 | INFO | MainProcess | Cluster_Thread | [remote_util.extract_remote_info] It could be other operating system. Go to check at other location 2019-11-28 13:57:35 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command start: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:35 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] running command.raw on 10.112.190.102: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:35 | INFO | MainProcess | Cluster_Thread | [remote_util.execute_command_raw] command executed successfully 2019-11-28 13:57:35 | INFO | MainProcess | Cluster_Thread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command end: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).', ['ok'], [' % Total % Received % Xferd Average Speed Time Time Time Current', ' Dload Upload Total Spent Left Speed', '', ' 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0', '100 43 100 2 100 41 12 266 --:--:-- --:--:-- --:--:-- 267'] 2019-11-28 13:57:35 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 10.112.190.102:8091: True content: b'[6,5]' command: cluster_compat_mode:get_compat_version(). 2019-11-28 13:57:35 | INFO | MainProcess | Cluster_Thread | [rest_client.diag_eval] /diag/eval status on 10.112.190.102:8091: True content: b'[6,5]' command: cluster_compat_mode:get_compat_version(). 2019-11-28 13:57:35 | INFO | MainProcess | Cluster_Thread | [rest_client.set_indexer_storage_mode] settings/indexes params : storageMode=plasma 2019-11-28 13:57:35 | ERROR | MainProcess | Cluster_Thread | [rest_client._http_request] POST http://10.112.190.102:8091/settings/indexes body: storageMode=plasma headers: {'Content-Type': 'application/x-www-form-urlencoded', 'Authorization': 'Basic QWRtaW5pc3RyYXRvcjpwYXNzd29yZA==', 'Accept': '*/*'} error: 400 reason: unknown b'{"errors":{"storageMode":"The value must be one of the following: [forestdb]"}}' auth: Administrator:password 2019-11-28 13:57:35 | INFO | MainProcess | MainThread | [basetestcase.add_built_in_server_user] **** add built-in 'cbadminbucket' user to node 10.112.190.101 **** 2019-11-28 13:57:35 | INFO | MainProcess | MainThread | [basetestcase.add_built_in_server_user] **** add 'admin' role to 'cbadminbucket' user **** 2019-11-28 13:57:35 | INFO | MainProcess | MainThread | [basetestcase.setUp] done initializing cluster 2019-11-28 13:57:35 | INFO | MainProcess | MainThread | [remote_util.__init__] connecting to 10.112.190.101 with username:root 2019-11-28 13:57:35 | INFO | MainProcess | MainThread | [remote_util.__init__] Connected to 10.112.190.101 2019-11-28 13:57:35 | INFO | MainProcess | MainThread | [remote_util.extract_remote_info] It could be other operating system. Go to check at other location 2019-11-28 13:57:36 | INFO | MainProcess | MainThread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command start: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:36 | INFO | MainProcess | MainThread | [remote_util.execute_command_raw] running command.raw on 10.112.190.101: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).' 2019-11-28 13:57:36 | INFO | MainProcess | MainThread | [remote_util.execute_command_raw] command executed successfully 2019-11-28 13:57:36 | INFO | MainProcess | MainThread | [remote_util.enable_diag_eval_on_non_local_hosts] -->command end: curl http://Administrator:password@localhost:8091/diag/eval -X POST -d 'ns_config:set(allow_nonlocal_eval, true).', ['ok'], [' % Total % Received % Xferd Average Speed Time Time Time Current', ' Dload Upload Total Spent Left Speed', '', ' 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0', '100 43 100 2 100 41 12 265 --:--:-- --:--:-- --:--:-- 266'] 2019-11-28 13:57:36 | INFO | MainProcess | MainThread | [basetestcase.enable_diag_eval_on_non_local_hosts] Enabled diag/eval for non-local hosts from 10.112.190.101 2019-11-28 13:57:36 | ERROR | MainProcess | Cluster_Thread | [rest_client.is_enterprise_edition] IP(s) for node(s) with community edition ['10.112.190.101'] 2019-11-28 13:57:36 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] http://10.112.190.101:8091/pools/default/buckets with param: name=default&authType=sasl&saslPassword=None&ramQuotaMB=532&replicaNumber=1&bucketType=membase&replicaIndex=1&threadsNumber=3&flushEnabled=1&evictionPolicy=valueOnly 2019-11-28 13:57:36 | INFO | MainProcess | Cluster_Thread | [rest_client.create_bucket] 0.00 seconds to create bucket default 2019-11-28 13:57:36 | INFO | MainProcess | Cluster_Thread | [bucket_helper.wait_for_memcached] waiting for memcached bucket : default in 10.112.190.101 to accept set ops 2019-11-28 13:57:37 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 10.112.190.101:11210 default 2019-11-28 13:57:37 | INFO | MainProcess | Cluster_Thread | [data_helper.direct_client] creating direct client 10.112.190.101:11210 default 2019-11-28 13:57:39 | INFO | MainProcess | Cluster_Thread | [task.check] bucket 'default' was created with per node RAM quota: 532 2019-11-28 13:57:39 | INFO | MainProcess | MainThread | [basetestcase.setUp] ============== basetestcase setup was finished for test #1 suite_tearDown ============== 2019-11-28 13:57:39 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] ------- Cluster statistics ------- 2019-11-28 13:57:39 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] 10.112.190.101:8091 => {'services': ['kv'], 'cpu_utilization': 36.14457831325301, 'mem_free': 553250816, 'mem_total': 1042685952, 'swap_mem_used': 602112, 'swap_mem_total': 1107292160} 2019-11-28 13:57:39 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] --- End of cluster statistics --- 2019-11-28 13:57:39 | INFO | MainProcess | MainThread | [basetestcase.suite_tearDown] ============== BaseTestCase suite_teardown has started ============== 2019-11-28 13:57:39 | INFO | MainProcess | MainThread | [basetestcase.suite_tearDown] ============== BaseTestCase suite_teardown has completed ============== 2019-11-28 13:57:39 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] ------- Cluster statistics ------- 2019-11-28 13:57:39 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] 10.112.190.101:8091 => {'services': ['kv'], 'cpu_utilization': 36.14457831325301, 'mem_free': 553250816, 'mem_total': 1042685952, 'swap_mem_used': 602112, 'swap_mem_total': 1107292160} 2019-11-28 13:57:39 | INFO | MainProcess | MainThread | [basetestcase.print_cluster_stats] --- End of cluster statistics --- 2019-11-28 13:57:39 | INFO | MainProcess | MainThread | [basetestcase.tearDown] ============== basetestcase cleanup was started for test #1 suite_tearDown ============== 2019-11-28 13:57:39 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] deleting existing buckets ['default'] on 10.112.190.101 2019-11-28 13:57:39 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] remove bucket default ... 2019-11-28 13:57:39 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] deleted bucket : default from 10.112.190.101 2019-11-28 13:57:39 | INFO | MainProcess | MainThread | [bucket_helper.wait_for_bucket_deletion] waiting for bucket deletion to complete.... 2019-11-28 13:57:39 | INFO | MainProcess | MainThread | [rest_client.bucket_exists] node 10.112.190.101 existing buckets : [] 2019-11-28 13:57:39 | INFO | MainProcess | MainThread | [bucket_helper.delete_all_buckets_or_assert] sleep 2 seconds to make sure all buckets (['default']) were deleted completely. 2019-11-28 13:57:41 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.101:8091 2019-11-28 13:57:41 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.101:8091 is running 2019-11-28 13:57:41 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] waiting for ns_server @ 10.112.190.102:8091 2019-11-28 13:57:41 | INFO | MainProcess | MainThread | [cluster_helper.wait_for_ns_servers_or_assert] ns_server @ 10.112.190.102:8091 is running 2019-11-28 13:57:41 | INFO | MainProcess | MainThread | [basetestcase.tearDown] ============== basetestcase cleanup was finished for test #1 suite_tearDown ============== Cluster instance shutdown with force ok ---------------------------------------------------------------------- Ran 1 test in 8.819s OK Thread was not properly terminated, will be terminated now. Stopping the thread... Thread was not properly terminated, will be terminated now. Stopping the thread... Thread was not properly terminated, will be terminated now. Stopping the thread... Thread was not properly terminated, will be terminated now. Stopping the thread... Thread was not properly terminated, will be terminated now. Stopping the thread... Thread was not properly terminated, will be terminated now. Stopping the thread... Thread was not properly terminated, will be terminated now. Shutting down the thread... Thread was not properly terminated, will be terminated now. Stopping the thread... Thread was not properly terminated, will be terminated now. Stopping the thread... Thread was not properly terminated, will be terminated now. Stopping the thread... (venv) Anithas-MacBook-Pro:testrunner-py3 anithakuberan$