Details
-
Bug
-
Resolution: Not a Bug
-
Major
-
Cheshire-Cat
-
Untriaged
-
1
-
No
Description
On build 7.0.0-4226
When Query node is not part of master node, randomly commit work fails with "Durability Impossible" exception
No.of replica : 2
No of nodes: 4
durability level is default, which is Majority in this case.
Queries Ran are:
"INSERT INTO default:`L5VT2_xKXtFB-58-406000`.`QuHJ7IU_xuFW-58-410000`.`996_U5WrL9xNFOXQw-58-411000` (KEY k1, value t) SELECT DISTINCT t.name AS k1,t FROM default:`L5VT2_xKXtFB-58-406000`.`QuHJ7IU_xuFW-58-410000`.`996_U5WrL9xNFOXQw-58-411000` t WHERE citizen_of='USA' AND job_title='Sales' LIMIT 10 RETURNING *", "INSERT INTO default:`L5VT2_xKXtFB-58-406000`.`QuHJ7IU_xuFW-58-410000`.`996_U5WrL9xNFOXQw-58-411000` (KEY k1, value t) SELECT DISTINCT t.name AS k1,t FROM default:`L5VT2_xKXtFB-58-406000`.`QuHJ7IU_xuFW-58-410000`.`996_U5WrL9xNFOXQw-58-411000` t WHERE citizen_of='INDIA' LIMIT 10 RETURNING *", 'SAVEPOINT a0', "DELETE FROM default:`L5VT2_xKXtFB-58-406000`.`QuHJ7IU_xuFW-58-410000`.`996_U5WrL9xNFOXQw-58-411000` USE KEYS ['test_collections-5352', 'test_collections-271', 'test_collections-16157', 'test_collections-17772', 'test_collections-2571', 'test_collections-14694', 'test_collections-16659', 'test_collections-2217', 'test_collections-8716', 'test_collections-14310', 'test_collections-4039', 'test_collections-19675', 'test_collections-4487', 'test_collections-5556', 'test_collections-14982', 'test_collections-14312', 'test_collections-8442', 'test_collections-15463', 'test_collections-18506', 'test_collections-9445'] RETURNING meta().id", 'SAVEPOINT a1', "DELETE FROM default:`L5VT2_xKXtFB-58-406000`.`QuHJ7IU_xuFW-58-410000`.`996_U5WrL9xNFOXQw-58-411000` USE KEYS ['test_collections-15160', 'test_collections-7870', 'test_collections-14133', 'test_collections-6884', 'test_collections-14782', 'test_collections-4312', 'test_collections-13839', 'test_collections-1479', 'test_collections-12507', 'test_collections-11506', 'test_collections-3391', 'test_collections-7096', 'test_collections-10863', 'test_collections-12369', 'test_collections-5736', 'test_collections-585', 'test_collections-12424', 'test_collections-8159', 'test_collections-16796', 'test_collections-6246'] RETURNING meta().id", "DELETE FROM default:`L5VT2_xKXtFB-58-406000`.`QuHJ7IU_xuFW-58-410000`.`996_U5WrL9xNFOXQw-58-411000` USE KEYS ['test_collections-6134', 'test_collections-5589', 'test_collections-12295', 'test_collections-4905', 'test_collections-16528', 'test_collections-4655', 'test_collections-13202', 'test_collections-18888', 'test_collections-1855', 'test_collections-456', 'test_collections-6904', 'test_collections-17042', 'test_collections-4484', 'test_collections-5415', 'test_collections-11397', 'test_collections-2389', 'test_collections-4966', 'test_collections-7073', 'test_collections-613', 'test_collections-9093'] RETURNING meta().id", 'SELECT * FROM system:transactions']
|
Error message:
2021-01-17 23:35:50,255 | test | INFO | MainThread | [tuq_helper:run_cbq_query:147] RUN QUERY COMMIT WORK
|
2021-01-17 23:35:50,255 | test | INFO | MainThread | [tuq_helper:run_cbq_query:163] query_params is {'txid': u'2af0de0b-f216-4d9e-b6ca-d2d639e7a3af', 'creds': [{'pass': 'password', 'user': 'Administrator'}, {'pass': u'8b66838a2bb1871d0bac6fb018c0e9b2', 'user': 'local:L5VT2_xKXtFB-58-406000'}], 'scan_consistency': 'REQUEST_PLUS'}
|
2021-01-17 23:35:50,265 | test | INFO | MainThread | [tuq_helper:run_cbq_query:204] TOTAL ELAPSED TIME: 2.049293ms
|
2021-01-17 23:35:50,266 | test | INFO | MainThread | [N1qlBase:full_execute_query:366] txn failed with unexpected errors {u'signature': u'json', u'requestID': u'bfbbee62-b264-43c1-803c-efd4f7259ed6', u'metrics': {u'resultCount': 0, u'executionTime': u'1.978552ms', u'serviceLoad': 1, u'resultSize': 0, u'errorCount': 1, u'elapsedTime': u'2.049293ms'}, u'results': [], u'errors': [{u'msg': u'Commit Transaction statement error', u'code': 17007, u'cause': {u'rollback': False, u'cause': u'durability impossible | {"status_code":161,"document_key":"_txn:atr-275-#128e","bucket":"L5VT2_xKXtFB-58-406000","scope":"MlRjeslzKEinxfizSjz-58-413000","collection":"qnuho-9-58-415000","collection_id":22,"error_name":"DurabilityImpossible","error_description":"Durability requirements are impossible to achieve","opaque":8,"last_dispatched_to":"172.23.100.12:11210","last_dispatched_from":"172.23.100.25:43898","last_connection_id":"4956d10c48164c0b/edc44fe41a8447d2"}', u'raise': u'failed', u'class': u'other', u'retry': False}}], u'status': u'errors'}
|
Test case:
guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/testexec.6343.ini rerun=False,data_spec_name=initial_load_N1ql,get-cbcollect-info=True,upgrade_version=7.0.0-4226 -t N1qlTransaction.basic_ops.BasicOps.test_with_use_keys,nodes_init=4,num_stmt_txn=5,num_savepoints=2,atrcollection=True,services_init=kv-n1ql-index-fts,GROUP=P0,bucket_spec=single_bucket.def_scope_fifty_collections'
atrcollection parameter is set as "'atrcollection': '`L5VT2_xKXtFB-58-406000`.`MlRjeslzKEinxfizSjz-58-413000`.`qnuho-9-58-415000`'"
I dont see this issue, if N1ql node is part of master node. I am not sure if its a MB or TXNG issue.
Cbcollect logs:
https://cb-jira.s3.us-east-2.amazonaws.com/logs/commit_failure/collectinfo-2021-01-18T073559-ns_1@172.23.100.12.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/commit_failure/collectinfo-2021-01-18T073559-ns_1@172.23.100.25.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/commit_failure/collectinfo-2021-01-18T073559-ns_1@172.23.100.20.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/commit_failure/collectinfo-2021-01-18T073559-ns_1@172.23.98.16.zip