./testrunner -i /tmp/atomicity.ini rerun=False,data_spec_name=initial_load_N1ql,get-cbcollect-info=False,GROUP=P0 -t N1qlTransaction.basic_ops.BasicOps.test_concurrent_txn,nodes_init=2,num_stmt_txn=10,num_collection=1,num_savepoints=2,num_txn=3,num_commit=3,num_rollback_to_savepoint=3,GROUP=P0,bucket_spec=single_bucket.def_scope_ten_collections Test Input params: {'cluster_name': 'atomicity', 'num_stmt_txn': '10', 'num_rollback_to_savepoint': '3', 'ini': '/tmp/atomicity.ini', 'get-cbcollect-info': 'False', 'conf_file': 'conf/N1qlTransaction/concurrency.conf', 'spec': 'concurrency', 'rerun': 'False', 'num_nodes': 2, 'logs_folder': '/data/workspace/temp_atomicity_phase1/logs/testrunner-20-Oct-14_00-19-02/test_4', 'num_txn': '3', 'nodes_init': '2', 'num_collection': '1', 'num_savepoints': '2', 'GROUP': 'P0', 'num_commit': '3', 'bucket_spec': 'single_bucket.def_scope_ten_collections', 'case_number': 4, 'data_spec_name': 'initial_load_N1ql'} test_concurrent_txn (N1qlTransaction.basic_ops.BasicOps) ... 2020-10-14 00:32:17,016 | test | INFO | MainThread | [basetestcase:log_setup_status:540] ========= BaseTestCase setup started for test #4 test_concurrent_txn ========= 2020-10-14 00:32:17,453 | test | INFO | MainThread | [basetestcase:log_setup_status:540] ========= BaseTestCase setup started for test #4 test_concurrent_txn ========= 2020-10-14 00:32:17,625 | test | INFO | MainThread | [basetestcase:setUp:321] Initializing cluster 2020-10-14 00:32:17,801 | test | WARNING | MainThread | [basetestcase:_initialize_nodes:584] RAM quota was defined less than 100 MB: 2020-10-14 00:32:29,526 | test | INFO | MainThread | [basetestcase:setUp:343] Couchbase Cluster: default, Nodes: 172.23.105.229, 172.23.105.230 initialized 2020-10-14 00:32:29,539 | test | INFO | MainThread | [basetestcase:log_setup_status:540] ========= BaseTestCase setup finished for test #4 test_concurrent_txn ========= 2020-10-14 00:32:29,558 | test | INFO | MainThread | [basetestcase:log_setup_status:540] ========= CollectionBase setup started for test #4 test_concurrent_txn ========= 2020-10-14 00:32:32,260 | test | INFO | pool-5-thread-3 | [table_view:display:72] Rebalance Overview +----------------+-----------------+--------------+ | Nodes | Services | Status | +----------------+-----------------+--------------+ | 172.23.105.229 | index, kv, n1ql | Cluster node | | 172.23.105.230 | None | <--- IN --- | +----------------+-----------------+--------------+ 2020-10-14 00:32:32,272 | test | INFO | pool-5-thread-3 | [task:check:320] Rebalance - status: running, progress: 0 2020-10-14 00:32:42,308 | test | INFO | pool-5-thread-3 | [task:check:320] Rebalance - status: none, progress: 100 2020-10-14 00:32:42,321 | test | INFO | pool-5-thread-3 | [task:check:377] Rebalance completed with progress: 100% in 10.0600001812 sec 2020-10-14 00:32:42,463 | test | INFO | MainThread | [bucket_ready_functions:create_buckets_using_json_data:1772] Creating required buckets from template 2020-10-14 00:32:42,645 | test | INFO | Thread-152 | [common_lib:sleep:22] Sleep 2 seconds. Reason: MB-38073: Wait after collection 7-bTNylTXLcb-42-485000 creation 2020-10-14 00:32:44,684 | test | INFO | Thread-152 | [common_lib:sleep:22] Sleep 2 seconds. Reason: MB-38073: Wait after collection YJm94ZKtBBkm-Y4GCCy-42-485000 creation 2020-10-14 00:32:46,716 | test | INFO | Thread-155 | [common_lib:sleep:22] Sleep 2 seconds. Reason: MB-38073: Wait after collection EQMB-42-485000 creation 2020-10-14 00:32:48,782 | test | INFO | Thread-157 | [common_lib:sleep:22] Sleep 2 seconds. Reason: MB-38073: Wait after collection 7wyrLVeUyp6DmEKDr-42-485000 creation 2020-10-14 00:32:50,812 | test | INFO | Thread-157 | [common_lib:sleep:22] Sleep 2 seconds. Reason: MB-38073: Wait after collection qLc0E-VZTPlm59-42-485000 creation 2020-10-14 00:32:52,881 | test | INFO | Thread-160 | [common_lib:sleep:22] Sleep 2 seconds. Reason: MB-38073: Wait after collection V2fKOuSkq2aFPB-42-485000 creation 2020-10-14 00:32:54,917 | test | INFO | Thread-160 | [common_lib:sleep:22] Sleep 2 seconds. Reason: MB-38073: Wait after collection 4-42-485000 creation 2020-10-14 00:32:56,990 | test | INFO | Thread-163 | [common_lib:sleep:22] Sleep 2 seconds. Reason: MB-38073: Wait after collection o_qlrSX-42-486000 creation 2020-10-14 00:32:59,020 | test | INFO | Thread-163 | [common_lib:sleep:22] Sleep 2 seconds. Reason: MB-38073: Wait after collection XN0WsGp%aiy-42-486000 creation 2020-10-14 00:33:01,022 | test | INFO | MainThread | [bucket_ready_functions:wait_for_collection_creation_to_complete:2233] Waiting for all collections to be created 2020-10-14 00:33:01,073 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +-------------------------+-----------+----------+------------+-----+-------+------------+----------+-----------+ | Bucket | Type | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | +-------------------------+-----------+----------+------------+-----+-------+------------+----------+-----------+ | boXC0MfdMbL0U-42-484000 | couchbase | 1 | none | 0 | 0 | 5322571776 | 60567856 | 73927596 | +-------------------------+-----------+----------+------------+-----+-------+------------+----------+-----------+ 2020-10-14 00:33:01,073 | test | INFO | MainThread | [collections_base:collection_setup:130] Creating required SDK clients for client_pool 2020-10-14 00:33:08,826 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 120 seconds. Reason: MB-38497 2020-10-14 00:35:08,826 | test | INFO | MainThread | [bucket_ready_functions:perform_tasks_from_spec:4879] Performing scope/collection specific operations 2020-10-14 00:35:15,486 | test | INFO | MainThread | [table_view:display:72] Cluster statistics +----------------+-----------------+-----------------+------------+------------+------------------------+-------------------+-----------------------+ | Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version | +----------------+-----------------+-----------------+------------+------------+------------------------+-------------------+-----------------------+ | 172.23.105.229 | index, kv, n1ql | 5.5 | 4201840640 | 3337920512 | 219566080 / 3758092288 | 1896 / 198 | 7.0.0-3383-enterprise | | 172.23.105.230 | kv | 5.02512562814 | 4201844736 | 3516743680 | 101187584 / 3758092288 | 2054 / 594 | 7.0.0-3383-enterprise | +----------------+-----------------+-----------------+------------+------------+------------------------+-------------------+-----------------------+ 2020-10-14 00:35:16,482 | test | INFO | MainThread | [bucket_ready_functions:validate_docs_per_collections_all_buckets:4364] Validating collection stats and item counts 2020-10-14 00:35:21,464 | test | INFO | MainThread | [table_view:display:72] Bucket statistics +-------------------------+-----------+----------+------------+-----+-------+------------+----------+-----------+ | Bucket | Type | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | +-------------------------+-----------+----------+------------+-----+-------+------------+----------+-----------+ | boXC0MfdMbL0U-42-484000 | couchbase | 1 | none | 0 | 20000 | 5322571776 | 89754224 | 118847736 | +-------------------------+-----------+----------+------------+-----+-------+------------+----------+-----------+ 2020-10-14 00:35:21,466 | test | INFO | MainThread | [basetestcase:log_setup_status:540] ========= CollectionBase setup complete for test #4 test_concurrent_txn ========= 2020-10-14 00:35:26,946 | test | INFO | MainThread | [N1qlBase:get_stmt_for_threads:809] insert, delete and update 4 0 6 2020-10-14 00:35:26,963 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY CREATE PRIMARY INDEX on default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` USING GSI 2020-10-14 00:35:28,900 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 1.931507259s 2020-10-14 00:35:28,911 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY CREATE INDEX `tl2-28-900000` ON default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`(join_mo) USING GSI 2020-10-14 00:35:31,809 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 2.892356153s 2020-10-14 00:35:31,821 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY CREATE INDEX `7UD-31-809000` ON default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`(citizen_of) USING GSI 2020-10-14 00:35:34,513 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 2.686610864s 2020-10-14 00:35:34,525 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY CREATE INDEX `xsa1enpO-34-513000` ON default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`(job_title) USING GSI 2020-10-14 00:35:37,190 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 2.661378738s 2020-10-14 00:35:37,207 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY CREATE INDEX `U-37-192000` ON default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`(citizen_of,job_title) USING GSI 2020-10-14 00:35:39,917 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 2.703856292s 2020-10-14 00:35:39,931 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY CREATE INDEX `3u-uiaYj_1hQyr-39-917000` ON default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`(job_title) USING GSI 2020-10-14 00:35:42,611 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 2.674171972s 2020-10-14 00:35:42,625 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY CREATE INDEX `8UFvVUpRR-42-611000` ON default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`(job_title) USING GSI 2020-10-14 00:35:45,339 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 2.709517759s 2020-10-14 00:35:45,352 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY CREATE INDEX `iK5kIATONzFh-45-341000` ON default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`(Working_country) USING GSI 2020-10-14 00:35:48,032 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 2.674506745s 2020-10-14 00:35:48,046 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY CREATE INDEX `z527ALaQ-48-34000` ON default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`(join_yr,job_title) USING GSI 2020-10-14 00:35:50,786 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 2.732641581s 2020-10-14 00:35:50,802 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY CREATE INDEX `xBq4mrBHnM-50-786000` ON default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`(join_mo) USING GSI 2020-10-14 00:35:53,513 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 2.705023188s 2020-10-14 00:35:53,530 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY CREATE INDEX `pqqY-PYFkqAYEN6nH-53-514000` ON default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`(job_title,skills) USING GSI 2020-10-14 00:35:56,290 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 2.75534783s 2020-10-14 00:35:56,302 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY BEGIN WORK 2020-10-14 00:35:56,308 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 1.003556ms 2020-10-14 00:35:56,335 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY BEGIN WORK 2020-10-14 00:35:56,348 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 513.722µs 2020-10-14 00:35:56,358 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY BEGIN WORK 2020-10-14 00:35:56,364 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 437.867µs 2020-10-14 00:35:56,375 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY BEGIN WORK 2020-10-14 00:35:56,378 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 387.702µs 2020-10-14 00:35:56,380 | test | INFO | Thread-200 | [N1qlBase:thread_txn:791] values are ["boXC0MfdMbL0U-42-484000._default.EQMB-42-485000:DELETE: job_title='Support':SE=True:job_title", 'SAVEPOINT:a1', "boXC0MfdMbL0U-42-484000._default.EQMB-42-485000:INSERT: job_title='Support':job_title", 'SAVEPOINT:a0', "boXC0MfdMbL0U-42-484000._default.EQMB-42-485000:DELETE: job_title='Engineer' and 'Testing' in skills:QE=True:job_title,skills"] True True False 2020-10-14 00:35:56,380 | test | INFO | Thread-202 | [N1qlBase:thread_txn:791] values are ['SAVEPOINT:a1', "boXC0MfdMbL0U-42-484000._default.EQMB-42-485000:INSERT: citizen_of='USA' AND job_title='Sales':citizen_of,job_title", 'SAVEPOINT:a0'] False False False 2020-10-14 00:35:56,380 | test | INFO | Thread-201 | [N1qlBase:thread_txn:791] values are ['SAVEPOINT:a1', 'SAVEPOINT:a0', 'boXC0MfdMbL0U-42-484000._default.EQMB-42-485000:INSERT: join_mo=9:join_mo', "boXC0MfdMbL0U-42-484000._default.EQMB-42-485000:DELETE: ['Development'] in skills:gaming=True:job_title", "boXC0MfdMbL0U-42-484000._default.EQMB-42-485000:DELETE: join_mo =1:join_month='January':join_mo"] True True False 2020-10-14 00:35:56,380 | test | INFO | Thread-199 | [N1qlBase:thread_txn:791] values are ["boXC0MfdMbL0U-42-484000._default.EQMB-42-485000:DELETE: Working_country='USA':temp_emp=True:Working_country", 'SAVEPOINT:a1', "boXC0MfdMbL0U-42-484000._default.EQMB-42-485000:INSERT: citizen_of='INDIA':citizen_of", 'SAVEPOINT:a0', "boXC0MfdMbL0U-42-484000._default.EQMB-42-485000:DELETE: join_yr > 2016 OR job_title='Engineer':mutated=1:join_yr,job_title"] True True False 2020-10-14 00:35:56,394 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:145] RUN QUERY DELETE FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE job_title='Support' LIMIT 200 RETURNING meta().id 2020-10-14 00:35:56,394 | test | INFO | Thread-202 | [N1qlBase:run_cbq_query:145] RUN QUERY SAVEPOINT a1 2020-10-14 00:35:56,395 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:145] RUN QUERY SAVEPOINT a1 2020-10-14 00:35:56,397 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:145] RUN QUERY DELETE FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE Working_country='USA' LIMIT 200 RETURNING meta().id 2020-10-14 00:35:56,398 | test | INFO | Thread-202 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 465.977µs 2020-10-14 00:35:56,401 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 339.347µs 2020-10-14 00:35:56,414 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:145] RUN QUERY SAVEPOINT a0 2020-10-14 00:35:56,414 | test | INFO | Thread-202 | [N1qlBase:run_cbq_query:145] RUN QUERY INSERT INTO default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` (KEY k1, value t) SELECT DISTINCT t.name AS k1,t FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` t WHERE citizen_of='USA' AND job_title='Sales' LIMIT 10 RETURNING * 2020-10-14 00:35:56,421 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 291.329µs 2020-10-14 00:35:56,423 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 24.714168ms 2020-10-14 00:35:56,424 | test | INFO | Thread-202 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 6.159213ms 2020-10-14 00:35:56,438 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:145] RUN QUERY SELECT META().id,* from default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE META().id in [] 2020-10-14 00:35:56,440 | test | INFO | Thread-202 | [N1qlBase:run_cbq_query:145] RUN QUERY SELECT * from default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE META().id in [] 2020-10-14 00:35:56,443 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:145] RUN QUERY INSERT INTO default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` (KEY k1, value t) SELECT DISTINCT t.name AS k1,t FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` t WHERE join_mo=9 LIMIT 10 RETURNING * 2020-10-14 00:35:56,450 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 5.259388ms 2020-10-14 00:35:56,450 | test | INFO | Thread-200 | [N1qlBase:validate_delete_results:423] delete result is [] 2020-10-14 00:35:56,454 | test | INFO | Thread-202 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 3.343513ms 2020-10-14 00:35:56,463 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:145] RUN QUERY SAVEPOINT a1 2020-10-14 00:35:56,470 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 384.197µs 2020-10-14 00:35:56,470 | test | INFO | Thread-202 | [N1qlBase:run_cbq_query:145] RUN QUERY SAVEPOINT a0 2020-10-14 00:35:56,480 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:145] RUN QUERY INSERT INTO default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` (KEY k1, value t) SELECT DISTINCT t.name AS k1,t FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` t WHERE job_title='Support' LIMIT 10 RETURNING * 2020-10-14 00:35:56,499 | test | INFO | Thread-202 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 337.29µs 2020-10-14 00:35:56,500 | test | INFO | Thread-202 | [N1qlBase:end_txn:102] commit work for txn {'txid': u'9b680266-e914-47cc-bfe0-984d9689b87a', 'scan_consistency': 'REQUEST_PLUS'} 2020-10-14 00:35:56,503 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 51.993722ms 2020-10-14 00:35:56,505 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 13.913458ms 2020-10-14 00:35:56,510 | test | INFO | Thread-202 | [N1qlBase:run_cbq_query:145] RUN QUERY ROLLBACK WORK 2020-10-14 00:35:56,516 | test | INFO | Thread-202 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 440.467µs 2020-10-14 00:35:56,516 | test | INFO | Thread-202 | [N1qlBase:thread_txn:797] queries executed in txn are {u'9b680266-e914-47cc-bfe0-984d9689b87a': [{u'signature': u'json', u'requestID': u'66d2db57-ad6e-478e-988f-634c93af5329', u'metrics': {u'resultCount': 0, u'executionTime': u'381.223\xb5s', u'serviceLoad': 3, u'resultSize': 0, u'elapsedTime': u'465.977\xb5s'}, u'results': [], u'status': u'success'}, "INSERT INTO default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` (KEY k1, value t) SELECT DISTINCT t.name AS k1,t FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` t WHERE citizen_of='USA' AND job_title='Sales' LIMIT 10 RETURNING *", {u'signature': u'json', u'requestID': u'8bdd008e-0093-40ef-b456-1d85313aa0c1', u'metrics': {u'resultCount': 0, u'executionTime': u'266.918\xb5s', u'serviceLoad': 6, u'resultSize': 0, u'elapsedTime': u'337.29\xb5s'}, u'results': [], u'status': u'success'}, 'ROLLBACK WORK']} 2020-10-14 00:35:56,523 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:145] RUN QUERY SELECT * from default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE META().id in [] 2020-10-14 00:35:56,525 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:145] RUN QUERY SELECT * from default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE META().id in ['Jerica Morgan', 'Mia Nicolas', 'Basha Howard Jr.', 'Fantine Howard Jr.', 'Basha Baker', 'Basha Scott', 'Jerica copper', 'Mia Bailey', 'Alvita Palmer', 'Maura Davis'] 2020-10-14 00:35:56,526 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 123.37741ms 2020-10-14 00:35:56,529 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 2.36051ms 2020-10-14 00:35:56,539 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 6.747202ms 2020-10-14 00:35:56,539 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:145] RUN QUERY SELECT META().id,* from default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE META().id in ['test_collections-1000', 'test_collections-1008', 'test_collections-1011', 'test_collections-1013', 'test_collections-1015', 'test_collections-1020', 'test_collections-1027', 'test_collections-1032', 'test_collections-1047', 'test_collections-1048', 'test_collections-105', 'test_collections-1050', 'test_collections-1053', 'test_collections-1061', 'test_collections-1063', 'test_collections-107', 'test_collections-1073', 'test_collections-1075', 'test_collections-1076', 'test_collections-1080', 'test_collections-1084', 'test_collections-1085', 'test_collections-1086', 'test_collections-1088', 'test_collections-1097', 'test_collections-1104', 'test_collections-1106', 'test_collections-1109', 'test_collections-111', 'test_collections-1113', 'test_collections-1115', 'test_collections-1122', 'test_collections-1124', 'test_collections-1127', 'test_collections-1130', 'test_collections-1133', 'test_collections-114', 'test_collections-1142', 'test_collections-1145', 'test_collections-1151', 'test_collections-1152', 'test_collections-1153', 'test_collections-1159', 'test_collections-116', 'test_collections-1164', 'test_collections-1166', 'test_collections-1169', 'test_collections-1170', 'test_collections-1182', 'test_collections-1185', 'test_collections-1186', 'test_collections-119', 'test_collections-1195', 'test_collections-1198', 'test_collections-1205', 'test_collections-1209', 'test_collections-1216', 'test_collections-1222', 'test_collections-1225', 'test_collections-123', 'test_collections-1231', 'test_collections-1240', 'test_collections-1252', 'test_collections-1258', 'test_collections-1261', 'test_collections-1263', 'test_collections-1267', 'test_collections-1270', 'test_collections-1271', 'test_collections-1276', 'test_collections-1279', 'test_collections-128', 'test_collections-1280', 'test_collections-1287', 'test_collections-1289', 'test_collections-1290', 'test_collections-1292', 'test_collections-1294', 'test_collections-1297', 'test_collections-1299', 'test_collections-13', 'test_collections-1302', 'test_collections-131', 'test_collections-1310', 'test_collections-1312', 'test_collections-1314', 'test_collections-1322', 'test_collections-1323', 'test_collections-1330', 'test_collections-1333', 'test_collections-1339', 'test_collections-1341', 'test_collections-1344', 'test_collections-1348', 'test_collections-1350', 'test_collections-1357', 'test_collections-1359', 'test_collections-136', 'test_collections-1360', 'test_collections-1364', 'test_collections-1369', 'test_collections-1379', 'test_collections-1382', 'test_collections-1384', 'test_collections-1385', 'test_collections-1395', 'test_collections-14', 'test_collections-1402', 'test_collections-1403', 'test_collections-1405', 'test_collections-1410', 'test_collections-1416', 'test_collections-1419', 'test_collections-1426', 'test_collections-1429', 'test_collections-143', 'test_collections-1436', 'test_collections-1440', 'test_collections-1444', 'test_collections-1446', 'test_collections-1449', 'test_collections-1453', 'test_collections-1455', 'test_collections-1456', 'test_collections-146', 'test_collections-1462', 'test_collections-1465', 'test_collections-147', 'test_collections-1475', 'test_collections-1476', 'test_collections-1481', 'test_collections-1482', 'test_collections-1485', 'test_collections-1492', 'test_collections-150', 'test_collections-1500', 'test_collections-1501', 'test_collections-1503', 'test_collections-1505', 'test_collections-1507', 'test_collections-1508', 'test_collections-1509', 'test_collections-1512', 'test_collections-1514', 'test_collections-1527', 'test_collections-1530', 'test_collections-1535', 'test_collections-1539', 'test_collections-154', 'test_collections-1542', 'test_collections-1543', 'test_collections-1549', 'test_collections-155', 'test_collections-1551', 'test_collections-1552', 'test_collections-1553', 'test_collections-1561', 'test_collections-1578', 'test_collections-1588', 'test_collections-1597', 'test_collections-1598', 'test_collections-1601', 'test_collections-1604', 'test_collections-1607', 'test_collections-1612', 'test_collections-1614', 'test_collections-1619', 'test_collections-1622', 'test_collections-1623', 'test_collections-1624', 'test_collections-1627', 'test_collections-1630', 'test_collections-1631', 'test_collections-1634', 'test_collections-1636', 'test_collections-1641', 'test_collections-1643', 'test_collections-1645', 'test_collections-165', 'test_collections-1650', 'test_collections-1653', 'test_collections-1654', 'test_collections-166', 'test_collections-1660', 'test_collections-1666', 'test_collections-167', 'test_collections-1674', 'test_collections-1676', 'test_collections-1684', 'test_collections-1685', 'test_collections-1686', 'test_collections-169', 'test_collections-1693', 'test_collections-1695', 'test_collections-1696', 'test_collections-1697', 'test_collections-1699', 'test_collections-1703', 'test_collections-1710', 'test_collections-1715'] 2020-10-14 00:35:56,540 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:145] RUN QUERY SAVEPOINT a0 2020-10-14 00:35:56,546 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 322.274µs 2020-10-14 00:35:56,552 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:145] RUN QUERY DELETE FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE ['Development'] in skills LIMIT 200 RETURNING meta().id 2020-10-14 00:35:56,556 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:145] RUN QUERY DELETE FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE job_title='Engineer' and 'Testing' in skills LIMIT 200 RETURNING meta().id 2020-10-14 00:35:56,566 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 22.05161ms 2020-10-14 00:35:56,568 | test | INFO | Thread-199 | [N1qlBase:validate_delete_results:423] delete result is [] 2020-10-14 00:35:56,568 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 5.762356ms 2020-10-14 00:35:56,579 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:145] RUN QUERY SAVEPOINT a1 2020-10-14 00:35:56,581 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:145] RUN QUERY SELECT META().id,* from default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE META().id in [] 2020-10-14 00:35:56,584 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 368.215µs 2020-10-14 00:35:56,588 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 2.2941ms 2020-10-14 00:35:56,588 | test | INFO | Thread-200 | [N1qlBase:validate_delete_results:423] delete result is [] 2020-10-14 00:35:56,588 | test | INFO | Thread-200 | [N1qlBase:end_txn:102] commit work for txn {'txid': u'2fedd231-8683-4111-963e-985d361876ef', 'scan_consistency': 'REQUEST_PLUS'} 2020-10-14 00:35:56,596 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:145] RUN QUERY INSERT INTO default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` (KEY k1, value t) SELECT DISTINCT t.name AS k1,t FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` t WHERE citizen_of='INDIA' LIMIT 10 RETURNING * 2020-10-14 00:35:56,599 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:145] RUN QUERY ROLLBACK TO SAVEPOINT a0 2020-10-14 00:35:56,605 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 3.933067ms 2020-10-14 00:35:56,605 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 394.19µs 2020-10-14 00:35:56,618 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:145] RUN QUERY SELECT * from default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE META().id in [] 2020-10-14 00:35:56,618 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:145] RUN QUERY SELECT * FROM system:transactions 2020-10-14 00:35:56,628 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 4.822375ms 2020-10-14 00:35:56,640 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 15.749134ms 2020-10-14 00:35:56,640 | test | INFO | Thread-200 | [N1qlBase:end_txn:102] commit work for txn {'txid': u'2fedd231-8683-4111-963e-985d361876ef', 'scan_consistency': 'REQUEST_PLUS'} 2020-10-14 00:35:56,641 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:145] RUN QUERY SAVEPOINT a0 2020-10-14 00:35:56,644 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 443.755µs 2020-10-14 00:35:56,670 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:145] RUN QUERY COMMIT WORK 2020-10-14 00:35:56,674 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:145] RUN QUERY DELETE FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE join_yr > 2016 OR job_title='Engineer' LIMIT 200 RETURNING meta().id 2020-10-14 00:35:56,676 | test | INFO | Thread-200 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 587.135µs 2020-10-14 00:35:56,677 | test | INFO | Thread-200 | [N1qlBase:thread_txn:797] queries executed in txn are {u'2fedd231-8683-4111-963e-985d361876ef': ["DELETE FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE job_title='Support' LIMIT 200 RETURNING meta().id", {u'signature': u'json', u'requestID': u'd2f20512-5d61-4f89-b9b2-218d8d225ff4', u'metrics': {u'resultCount': 0, u'executionTime': u'279.577\xb5s', u'serviceLoad': 4, u'resultSize': 0, u'elapsedTime': u'384.197\xb5s'}, u'results': [], u'status': u'success'}, "INSERT INTO default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` (KEY k1, value t) SELECT DISTINCT t.name AS k1,t FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` t WHERE job_title='Support' LIMIT 10 RETURNING *", {u'signature': u'json', u'requestID': u'c168682c-5732-4d42-ae03-3739b2ffb839', u'metrics': {u'resultCount': 0, u'executionTime': u'254.567\xb5s', u'serviceLoad': 3, u'resultSize': 0, u'elapsedTime': u'322.274\xb5s'}, u'results': [], u'status': u'success'}, "DELETE FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE job_title='Engineer' and 'Testing' in skills LIMIT 200 RETURNING meta().id", 'ROLLBACK TO SAVEPOINT a0', 'COMMIT WORK']} 2020-10-14 00:35:56,687 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 6.828459ms 2020-10-14 00:35:56,698 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:145] RUN QUERY SELECT META().id,* from default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE META().id in [] 2020-10-14 00:35:56,707 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 3.576876ms 2020-10-14 00:35:56,707 | test | INFO | Thread-199 | [N1qlBase:validate_delete_results:423] delete result is [] 2020-10-14 00:35:56,707 | test | INFO | Thread-199 | [N1qlBase:end_txn:102] commit work for txn {'txid': u'fcf20ba2-54df-45ab-aede-429dde04db8d', 'scan_consistency': 'REQUEST_PLUS'} 2020-10-14 00:35:56,719 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:145] RUN QUERY ROLLBACK TO SAVEPOINT a1 2020-10-14 00:35:56,724 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 689.894µs 2020-10-14 00:35:56,736 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:145] RUN QUERY SELECT * FROM system:transactions 2020-10-14 00:35:56,742 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 901.863µs 2020-10-14 00:35:56,742 | test | INFO | Thread-199 | [N1qlBase:end_txn:102] commit work for txn {'txid': u'fcf20ba2-54df-45ab-aede-429dde04db8d', 'scan_consistency': 'REQUEST_PLUS'} 2020-10-14 00:35:56,744 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 185.006322ms 2020-10-14 00:35:56,753 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:145] RUN QUERY COMMIT WORK 2020-10-14 00:35:56,756 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:145] RUN QUERY SELECT META().id,* from default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE META().id in [] 2020-10-14 00:35:56,786 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 25.701145ms 2020-10-14 00:35:56,786 | test | INFO | Thread-201 | [N1qlBase:validate_delete_results:423] delete result is [] 2020-10-14 00:35:56,798 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:145] RUN QUERY DELETE FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE join_mo =1 LIMIT 200 RETURNING meta().id 2020-10-14 00:35:56,977 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 174.69644ms 2020-10-14 00:35:56,989 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:145] RUN QUERY SELECT META().id,* from default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE META().id in ['test_collections-10', 'test_collections-1027', 'test_collections-1034', 'test_collections-1037', 'test_collections-1041', 'test_collections-1048', 'test_collections-1062', 'test_collections-1065', 'test_collections-1076', 'test_collections-1087', 'test_collections-1127', 'test_collections-1639', 'test_collections-63', 'test_collections-792', 'test_collections-1155', 'test_collections-1262', 'test_collections-13', 'test_collections-394', 'test_collections-987', 'test_collections-436', 'test_collections-152', 'test_collections-38', 'test_collections-1283', 'test_collections-1176', 'test_collections-643', 'test_collections-1215', 'test_collections-778', 'test_collections-91', 'test_collections-1134', 'test_collections-1297', 'test_collections-1660', 'test_collections-1162', 'test_collections-1574', 'test_collections-575', 'test_collections-1895', 'test_collections-308', 'test_collections-622', 'test_collections-24', 'test_collections-397', 'test_collections-297', 'test_collections-1958', 'test_collections-450', 'test_collections-1190', 'test_collections-553', 'test_collections-80', 'test_collections-525', 'test_collections-848', 'test_collections-219', 'test_collections-522', 'test_collections-681', 'test_collections-1290', 'test_collections-1204', 'test_collections-1343', 'test_collections-41', 'test_collections-1588', 'test_collections-208', 'test_collections-387', 'test_collections-191', 'test_collections-1716', 'test_collections-1318', 'test_collections-425', 'test_collections-906', 'test_collections-806', 'test_collections-1809', 'test_collections-1833', 'test_collections-464', 'test_collections-180', 'test_collections-1321', 'test_collections-1795', 'test_collections-529', 'test_collections-720', 'test_collections-1432', 'test_collections-1816', 'test_collections-319', 'test_collections-1169', 'test_collections-937', 'test_collections-1677', 'test_collections-771', 'test_collections-169', 'test_collections-1802', 'test_collections-1674', 'test_collections-1767', 'test_collections-1546', 'test_collections-1549', 'test_collections-515', 'test_collections-347', 'test_collections-1193', 'test_collections-266', 'test_collections-934', 'test_collections-1332', 'test_collections-909', 'test_collections-1446', 'test_collections-920', 'test_collections-141', 'test_collections-536', 'test_collections-52', 'test_collections-1855', 'test_collections-280', 'test_collections-1418', 'test_collections-1471', 'test_collections-653', 'test_collections-1930', 'test_collections-1304', 'test_collections-913', 'test_collections-1902', 'test_collections-1460', 'test_collections-899', 'test_collections-1727', 'test_collections-1488', 'test_collections-1599', 'test_collections-703', 'test_collections-1553', 'test_collections-1923', 'test_collections-1944', 'test_collections-959', 'test_collections-1933', 'test_collections-750', 'test_collections-1688', 'test_collections-678', 'test_collections-17', 'test_collections-269', 'test_collections-1293', 'test_collections-650', 'test_collections-820', 'test_collections-259', 'test_collections-1390', 'test_collections-1646', 'test_collections-1518', 'test_collections-294', 'test_collections-475', 'test_collections-408', 'test_collections-138', 'test_collections-1411', 'test_collections-1961', 'test_collections-336', 'test_collections-785', 'test_collections-1360', 'test_collections-1449', 'test_collections-592', 'test_collections-1937', 'test_collections-664', 'test_collections-1983', 'test_collections-447', 'test_collections-550', 'test_collections-692', 'test_collections-1560', 'test_collections-1972', 'test_collections-166', 'test_collections-564', 'test_collections-1702', 'test_collections-1421', 'test_collections-1805', 'test_collections-976', 'test_collections-781', 'test_collections-422', 'test_collections-3', 'test_collections-1165', 'test_collections-1667', 'test_collections-1830', 'test_collections-131', 'test_collections-948', 'test_collections-1425', 'test_collections-1539', 'test_collections-809', 'test_collections-1681', 'test_collections-657', 'test_collections-831', 'test_collections-1844', 'test_collections-1774'] 2020-10-14 00:35:57,045 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 49.905206ms 2020-10-14 00:35:57,045 | test | INFO | Thread-201 | [N1qlBase:validate_delete_results:423] delete result is [] 2020-10-14 00:35:57,045 | test | INFO | Thread-201 | [N1qlBase:end_txn:102] commit work for txn {'txid': u'47db7c00-a6d7-466f-8835-3c2137874ea9', 'scan_consistency': 'REQUEST_PLUS'} 2020-10-14 00:35:57,056 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:145] RUN QUERY ROLLBACK TO SAVEPOINT a1 2020-10-14 00:35:57,062 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 517.615µs 2020-10-14 00:35:57,073 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:145] RUN QUERY SELECT * FROM system:transactions 2020-10-14 00:35:57,079 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 1.002003ms 2020-10-14 00:35:57,079 | test | INFO | Thread-201 | [N1qlBase:end_txn:102] commit work for txn {'txid': u'47db7c00-a6d7-466f-8835-3c2137874ea9', 'scan_consistency': 'REQUEST_PLUS'} 2020-10-14 00:35:57,091 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:145] RUN QUERY COMMIT WORK 2020-10-14 00:35:57,197 | test | INFO | Thread-199 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 437.392184ms 2020-10-14 00:35:57,197 | test | INFO | Thread-199 | [N1qlBase:thread_txn:797] queries executed in txn are {u'fcf20ba2-54df-45ab-aede-429dde04db8d': ["DELETE FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE Working_country='USA' LIMIT 200 RETURNING meta().id", {u'signature': u'json', u'requestID': u'3dfb7c9e-0b02-4e89-84fd-178eac107a05', u'metrics': {u'resultCount': 0, u'executionTime': u'274.258\xb5s', u'serviceLoad': 3, u'resultSize': 0, u'elapsedTime': u'368.215\xb5s'}, u'results': [], u'status': u'success'}, "INSERT INTO default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` (KEY k1, value t) SELECT DISTINCT t.name AS k1,t FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` t WHERE citizen_of='INDIA' LIMIT 10 RETURNING *", {u'signature': u'json', u'requestID': u'90845e5d-fe0f-4d93-8d75-df67995b0739', u'metrics': {u'resultCount': 0, u'executionTime': u'349.667\xb5s', u'serviceLoad': 3, u'resultSize': 0, u'elapsedTime': u'443.755\xb5s'}, u'results': [], u'status': u'success'}, "DELETE FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE join_yr > 2016 OR job_title='Engineer' LIMIT 200 RETURNING meta().id", 'ROLLBACK TO SAVEPOINT a1', 'COMMIT WORK']} 2020-10-14 00:35:57,200 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 104.580092ms 2020-10-14 00:35:57,200 | test | INFO | Thread-201 | [N1qlBase:run_cbq_query:215] txn failed with error {u'signature': u'json', u'requestID': u'f089ff0f-87b9-4857-a460-1f0daea870a3', u'metrics': {u'resultCount': 0, u'executionTime': u'104.471625ms', u'serviceLoad': 1, u'resultSize': 0, u'errorCount': 1, u'elapsedTime': u'104.580092ms'}, u'results': [], u'errors': [{u'msg': u'Commit Transaction statement error: transaction operation failed | document not found | {"status_code":1,"bucket":"boXC0MfdMbL0U-42-484000","scope":"_default","collection":"EQMB-42-485000","collection_id":10,"error_name":"KEY_ENOENT","error_description":"Not Found","opaque":184,"last_dispatched_to":"172.23.105.229:11210","last_dispatched_from":"172.23.105.229:37858","last_connection_id":"ba4f4c21fec4d29d/e7c8b18a6fe9c1d1"}', u'code': 17007}], u'status': u'errors'} 2020-10-14 00:35:57,200 | test | INFO | Thread-201 | [N1qlBase:full_execute_query:619] got document not found error when doc exist 2020-10-14 00:35:57,201 | test | INFO | Thread-201 | [N1qlBase:thread_txn:797] queries executed in txn are {u'47db7c00-a6d7-466f-8835-3c2137874ea9': [{u'signature': u'json', u'requestID': u'693971a7-9824-4a18-b809-0e67021f3889', u'metrics': {u'resultCount': 0, u'executionTime': u'252.625\xb5s', u'serviceLoad': 3, u'resultSize': 0, u'elapsedTime': u'339.347\xb5s'}, u'results': [], u'status': u'success'}, {u'signature': u'json', u'requestID': u'69dba32d-5f9a-44ba-8ac5-8c75cd4767c6', u'metrics': {u'resultCount': 0, u'executionTime': u'217.771\xb5s', u'serviceLoad': 6, u'resultSize': 0, u'elapsedTime': u'291.329\xb5s'}, u'results': [], u'status': u'success'}, 'INSERT INTO default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` (KEY k1, value t) SELECT DISTINCT t.name AS k1,t FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` t WHERE join_mo=9 LIMIT 10 RETURNING *', "DELETE FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE ['Development'] in skills LIMIT 200 RETURNING meta().id", 'DELETE FROM default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000` WHERE join_mo =1 LIMIT 200 RETURNING meta().id', 'ROLLBACK TO SAVEPOINT a1']} 2020-10-14 00:35:57,201 | test | INFO | MainThread | [N1qlBase:get_stmt_for_threads:844] got document not found error when doc exist 2020-10-14 00:35:57,203 | test | INFO | MainThread | [basic_ops:test_concurrent_txn:48] result is [[{}, []], [{'a0': {'boXC0MfdMbL0U-42-484000._default.EQMB-42-485000': {'DELETE': [], 'INSERT': {}, 'UPDATE': {}}}, 'a1': {'boXC0MfdMbL0U-42-484000._default.EQMB-42-485000': {'DELETE': [], 'INSERT': {}, 'UPDATE': {}}}}, ['a1', 'a0']], [{'a0': {'boXC0MfdMbL0U-42-484000._default.EQMB-42-485000': {'DELETE': [], 'INSERT': {}, 'UPDATE': {}}}, 'a1': {'boXC0MfdMbL0U-42-484000._default.EQMB-42-485000': {'DELETE': ['test_collections-1000', 'test_collections-1008', 'test_collections-1011', 'test_collections-1013', 'test_collections-1015', 'test_collections-1020', 'test_collections-1027', 'test_collections-1032', 'test_collections-1047', 'test_collections-1048', 'test_collections-105', 'test_collections-1050', 'test_collections-1053', 'test_collections-1061', 'test_collections-1063', 'test_collections-107', 'test_collections-1073', 'test_collections-1075', 'test_collections-1076', 'test_collections-1080', 'test_collections-1084', 'test_collections-1085', 'test_collections-1086', 'test_collections-1088', 'test_collections-1097', 'test_collections-1104', 'test_collections-1106', 'test_collections-1109', 'test_collections-111', 'test_collections-1113', 'test_collections-1115', 'test_collections-1122', 'test_collections-1124', 'test_collections-1127', 'test_collections-1130', 'test_collections-1133', 'test_collections-114', 'test_collections-1142', 'test_collections-1145', 'test_collections-1151', 'test_collections-1152', 'test_collections-1153', 'test_collections-1159', 'test_collections-116', 'test_collections-1164', 'test_collections-1166', 'test_collections-1169', 'test_collections-1170', 'test_collections-1182', 'test_collections-1185', 'test_collections-1186', 'test_collections-119', 'test_collections-1195', 'test_collections-1198', 'test_collections-1205', 'test_collections-1209', 'test_collections-1216', 'test_collections-1222', 'test_collections-1225', 'test_collections-123', 'test_collections-1231', 'test_collections-1240', 'test_collections-1252', 'test_collections-1258', 'test_collections-1261', 'test_collections-1263', 'test_collections-1267', 'test_collections-1270', 'test_collections-1271', 'test_collections-1276', 'test_collections-1279', 'test_collections-128', 'test_collections-1280', 'test_collections-1287', 'test_collections-1289', 'test_collections-1290', 'test_collections-1292', 'test_collections-1294', 'test_collections-1297', 'test_collections-1299', 'test_collections-13', 'test_collections-1302', 'test_collections-131', 'test_collections-1310', 'test_collections-1312', 'test_collections-1314', 'test_collections-1322', 'test_collections-1323', 'test_collections-1330', 'test_collections-1333', 'test_collections-1339', 'test_collections-1341', 'test_collections-1344', 'test_collections-1348', 'test_collections-1350', 'test_collections-1357', 'test_collections-1359', 'test_collections-136', 'test_collections-1360', 'test_collections-1364', 'test_collections-1369', 'test_collections-1379', 'test_collections-1382', 'test_collections-1384', 'test_collections-1385', 'test_collections-1395', 'test_collections-14', 'test_collections-1402', 'test_collections-1403', 'test_collections-1405', 'test_collections-1410', 'test_collections-1416', 'test_collections-1419', 'test_collections-1426', 'test_collections-1429', 'test_collections-143', 'test_collections-1436', 'test_collections-1440', 'test_collections-1444', 'test_collections-1446', 'test_collections-1449', 'test_collections-1453', 'test_collections-1455', 'test_collections-1456', 'test_collections-146', 'test_collections-1462', 'test_collections-1465', 'test_collections-147', 'test_collections-1475', 'test_collections-1476', 'test_collections-1481', 'test_collections-1482', 'test_collections-1485', 'test_collections-1492', 'test_collections-150', 'test_collections-1500', 'test_collections-1501', 'test_collections-1503', 'test_collections-1505', 'test_collections-1507', 'test_collections-1508', 'test_collections-1509', 'test_collections-1512', 'test_collections-1514', 'test_collections-1527', 'test_collections-1530', 'test_collections-1535', 'test_collections-1539', 'test_collections-154', 'test_collections-1542', 'test_collections-1543', 'test_collections-1549', 'test_collections-155', 'test_collections-1551', 'test_collections-1552', 'test_collections-1553', 'test_collections-1561', 'test_collections-1578', 'test_collections-1588', 'test_collections-1597', 'test_collections-1598', 'test_collections-1601', 'test_collections-1604', 'test_collections-1607', 'test_collections-1612', 'test_collections-1614', 'test_collections-1619', 'test_collections-1622', 'test_collections-1623', 'test_collections-1624', 'test_collections-1627', 'test_collections-1630', 'test_collections-1631', 'test_collections-1634', 'test_collections-1636', 'test_collections-1641', 'test_collections-1643', 'test_collections-1645', 'test_collections-165', 'test_collections-1650', 'test_collections-1653', 'test_collections-1654', 'test_collections-166', 'test_collections-1660', 'test_collections-1666', 'test_collections-167', 'test_collections-1674', 'test_collections-1676', 'test_collections-1684', 'test_collections-1685', 'test_collections-1686', 'test_collections-169', 'test_collections-1693', 'test_collections-1695', 'test_collections-1696', 'test_collections-1697', 'test_collections-1699', 'test_collections-1703', 'test_collections-1710', 'test_collections-1715'], 'INSERT': {}, 'UPDATE': {}}}}, ['a1']]] 2020-10-14 00:35:57,513 | test | INFO | MainThread | [N1qlBase:validate_keys:686] Expected keys: 1800, Actual: 2000, Deleted: 200 FAIL 2020-10-14 00:35:57,526 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY DROP INDEX default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`.`tl2-28-900000` USING GSI 2020-10-14 00:35:57,549 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 18.569928ms 2020-10-14 00:35:57,562 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY DROP INDEX default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`.`7UD-31-809000` USING GSI 2020-10-14 00:35:57,595 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 29.663894ms 2020-10-14 00:35:57,608 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY DROP INDEX default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`.`xsa1enpO-34-513000` USING GSI 2020-10-14 00:35:57,651 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 38.480528ms 2020-10-14 00:35:57,663 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY DROP INDEX default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`.`U-37-192000` USING GSI 2020-10-14 00:35:57,701 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 27.942082ms 2020-10-14 00:35:57,713 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY DROP INDEX default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`.`3u-uiaYj_1hQyr-39-917000` USING GSI 2020-10-14 00:35:57,736 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 18.545128ms 2020-10-14 00:35:57,747 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY DROP INDEX default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`.`8UFvVUpRR-42-611000` USING GSI 2020-10-14 00:35:57,782 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 30.216261ms 2020-10-14 00:35:57,793 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY DROP INDEX default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`.`iK5kIATONzFh-45-341000` USING GSI 2020-10-14 00:35:57,822 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 19.927073ms 2020-10-14 00:35:57,834 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY DROP INDEX default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`.`z527ALaQ-48-34000` USING GSI 2020-10-14 00:35:57,872 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 33.734132ms 2020-10-14 00:35:57,885 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY DROP INDEX default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`.`xBq4mrBHnM-50-786000` USING GSI 2020-10-14 00:35:57,924 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 35.054493ms 2020-10-14 00:35:57,936 | test | INFO | MainThread | [N1qlBase:run_cbq_query:145] RUN QUERY DROP INDEX default:`boXC0MfdMbL0U-42-484000`.`_default`.`EQMB-42-485000`.`pqqY-PYFkqAYEN6nH-53-514000` USING GSI 2020-10-14 00:35:57,976 | test | INFO | MainThread | [N1qlBase:run_cbq_query:201] TOTAL ELAPSED TIME: 34.503585ms 2020-10-14 00:35:58,529 | test | INFO | MainThread | [collections_base:tearDown:86] Bucket: boXC0MfdMbL0U-42-484000, Resident ratio(DGM): 100% 2020-10-14 00:36:01,095 | test | INFO | MainThread | [basetestcase:check_coredump_exist:712] 172.23.105.229 : SSH Successful 2020-10-14 00:36:01,095 | test | INFO | MainThread | [basetestcase:check_coredump_exist:713] 172.23.105.229 : Looking for crash dump files 2020-10-14 00:36:01,111 | test | INFO | MainThread | [basetestcase:check_coredump_exist:732] 172.23.105.229 : No crash files found 2020-10-14 00:36:01,111 | test | INFO | MainThread | [basetestcase:check_coredump_exist:734] 172.23.105.229 : Looking for CRITICAL messages in log 2020-10-14 00:36:02,069 | test | INFO | MainThread | [basetestcase:check_coredump_exist:712] 172.23.105.230 : SSH Successful 2020-10-14 00:36:02,071 | test | INFO | MainThread | [basetestcase:check_coredump_exist:713] 172.23.105.230 : Looking for crash dump files 2020-10-14 00:36:02,085 | test | INFO | MainThread | [basetestcase:check_coredump_exist:732] 172.23.105.230 : No crash files found 2020-10-14 00:36:02,085 | test | INFO | MainThread | [basetestcase:check_coredump_exist:734] 172.23.105.230 : Looking for CRITICAL messages in log 2020-10-14 00:36:02,733 | test | CRITICAL | MainThread | [basetestcase:tearDownEverything:492] Skipping get_trace !! 2020-10-14 00:36:15,506 | test | INFO | MainThread | [rest_client:monitorRebalance:1433] Rebalance done. Taken 11.0690000057 seconds to complete 2020-10-14 00:36:15,516 | test | INFO | MainThread | [common_lib:sleep:22] Sleep 5 seconds. Reason: Wait after rebalance complete ====================================================================== FAIL: test_concurrent_txn (N1qlTransaction.basic_ops.BasicOps) ---------------------------------------------------------------------- Traceback (most recent call last): File "pytests/N1qlTransaction/basic_ops.py", line 51, in test_concurrent_txn self.fail("One of the thread failed with unexpected errors") AssertionError: One of the thread failed with unexpected errors ---------------------------------------------------------------------- Ran 1 test in 260.989s FAILED (failures=1) During the test, Remote Connections: 110, Disconnections: 98 SDK Connections: 120, Disconnections: 120 summary so far suite N1qlTransaction.basic_ops.BasicOps , pass 3 , fail 1