./testrunner -i node.ini rerun=False,skip_cleanup=True,get-cbcollect-info=False -t epengine.bucket_level_durability.BucketDurabilityTests.test_update_durability_level,nodes_init=2,replicas=1,num_items=5000,bucket_type=couchbase,GROUP=P0 Test Input params: {'cluster_name': 'node', 'bucket_type': 'couchbase', 'ini': 'node.ini', 'get-cbcollect-info': 'False', 'replicas': '1', 'conf_file': 'debug.conf', 'spec': 'debug', 'rerun': 'False', 'num_nodes': 2, 'logs_folder': '/Users/ashwin/gitRepos/couchbaselabs/TAF/logs/testrunner-20-May-28_17-26-59/test_1', 'skip_cleanup': 'True', 'nodes_init': '2', 'GROUP': 'P0', 'num_items': '5000', 'case_number': 1} 2020-05-28 17:27:00,042 | root | WARNING | MainThread | [data_helper::31] Can not import concurrent module. Data for each server will be loaded/retrieved sequentially 2020-05-28 17:27:01,233 | test | INFO | MainThread | [basetestcase:_BaseTestCase__log_setup_status:409] ========= basetestcase setup started for test #1 test_update_durability_level ========= 2020-05-28 17:27:02,996 | test | INFO | MainThread | [basetestcase:_BaseTestCase__log_setup_status:409] ========= basetestcase setup started for test #1 test_update_durability_level ========= 2020-05-28 17:27:28,825 | test | INFO | MainThread | [rest_client:monitorRebalance:1423] Rebalance done. Taken 25.1549999714 seconds to complete 2020-05-28 17:27:28,829 | test | INFO | MainThread | [rest_client:monitorRebalance:1425] Sleep for 5 seconds after rebalance 2020-05-28 17:27:33,990 | test | WARNING | MainThread | [basetestcase:setUp:246] Any cluster operation in setup will be skipped 2020-05-28 17:27:33,993 | test | INFO | MainThread | [basetestcase:_BaseTestCase__log_setup_status:409] ========= basetestcase setup finished for test #1 test_update_durability_level ========= 2020-05-28 17:27:38,454 | test | INFO | pool-2-thread-1 | [table_view:display:72] Rebalance Overview +----------------+----------+--------------+ | Nodes | Services | Status | +----------------+----------+--------------+ | 10.112.191.101 | kv | Cluster node | | 10.112.191.102 | None | <--- IN --- | +----------------+----------+--------------+ 2020-05-28 17:27:38,487 | test | INFO | pool-2-thread-1 | [task:check:304] Rebalance - status: running, progress: 0 2020-05-28 17:27:53,604 | test | INFO | pool-2-thread-1 | [task:check:304] Rebalance - status: none, progress: 100 2020-05-28 17:27:53,627 | test | INFO | pool-2-thread-1 | [task:check:363] Rebalance completed with progress: 100% in 15.1730000973 sec 2020-05-28 17:27:53,993 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+----------+-----------------+------------+------------+----------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+----------+-----------------+------------+------------+----------------+-------------------+-----------------------+ | 10.112.191.102 | kv | 1.0101010101 | 1930829824 | 1526542336 | 0 / 1107292160 | 0 / 0 | 6.6.0-7687-enterprise | | 10.112.191.101 | kv | 2 | 1930829824 | 1477230592 | 0 / 1107292160 | 0 / 0 | 6.6.0-7687-enterprise | +----------------+----------+-----------------+------------+------------+----------------+-------------------+-----------------------+ 2020-05-28 17:27:54,552 | test | INFO | MainThread | [durability_base:setUp:186] ===== BucketDurabilityBase setup complete ===== 2020-05-28 17:27:54,555 | test | INFO | MainThread | [bucket_level_durability:test_update_durability_level:375] Create couchbase bucket with durability level 'MAJORITY' 2020-05-28 17:27:58,937 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+---------+----------+------------+-----+-------+-----------+----------+-----------+ | Bucket | Type | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | +---------+---------+----------+------------+-----+-------+-----------+----------+-----------+ | default | membase | 1 | majority | 0 | 0 | 209715200 | 52041520 | 68 | +---------+---------+----------+------------+-----+-------+-----------+----------+-----------+ 2020-05-28 17:27:58,938 | test | INFO | MainThread | [bucket_level_durability:test_update_durability_level:389] Performing initial doc_load 2020-05-28 17:28:10,326 | test | INFO | pool-2-thread-4 | [table_view:display:72] Ops Trend for bucket 'default' +-------+---------------------------------------------------------------------------------------------------------+----------+ | Min | Trend | Max | +-------+---------------------------------------------------------------------------------------------------------+----------+ | 0.000 | **.........................................*..........................................................X | 1452.547 | +-------+---------------------------------------------------------------------------------------------------------+----------+ 2020-05-28 17:28:11,085 | test | INFO | MainThread | [bucket_level_durability:test_update_durability_level:449] Starting create task 2020-05-28 17:28:42,237 | test | INFO | MainThread | [bucket_ready_functions:update_bucket_props:2578] Changing the bucket properties by changing durability_min_level to majorityAndPersistActive 2020-05-28 17:28:46,444 | infra | ERROR | MainThread | [remote_util:log_command_output:3037] Redirecting to /bin/systemctl restart couchbase-server.service 2020-05-28 17:28:48,762 | infra | ERROR | MainThread | [remote_util:log_command_output:3037] Redirecting to /bin/systemctl restart couchbase-server.service [] 2020-05-28 17:29:48,894 | test | ERROR | MainThread | [basetestcase:log_failure:515] Failed to update bucket_d_level to majorityAndPersistActive 2020-05-28 17:29:49,017 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +---------+---------+----------+------------+-----+-------+-----------+----------+-----------+ | Bucket | Type | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | +---------+---------+----------+------------+-----+-------+-----------+----------+-----------+ | default | membase | 1 | majority | 0 | 10000 | 209715200 | 59272064 | 92451767 | +---------+---------+----------+------------+-----+-------+-----------+----------+-----------+