Description
Build: 7.1.0-1903
Seeing "server write timeout" error while create/delete indexes in the test with collection crud and index create/delete loop.
Test steps can be found in : MB-43690
Index create/delete loop and collection crud (collection / scope create/delete) on bucket4 and bucket5
Below are the instances where server write timeout seen:
{"log":"2021-12-16 18:47:07,027 - ftsindexmanager - INFO - Creating FTS index bucket_bucket4_idx_hnbec_15-country-free_parking-public_likes-Overall on ['P0docRVsGHF7cVlWXZ1D.EpO1hdwphUfvBjw'] with 2 replicas and 10 partitions\n","stream":"stderr","time":"2021-12-17T02:47:07.028617855Z"}
|
{"log":"2021-12-16 18:48:07,036 - ftsindexmanager - INFO - Content = b'{\"status\":\"fail\", \"error\": \"server write timeout\"}' \n","stream":"stderr","time":"2021-12-17T02:48:07.037001781Z"}
|
|
|
|
|
{"log":"2021-12-16 19:12:08,177 - ftsindexmanager - INFO - Creating FTS index bucket_bucket4_idx_gmiww_25-free_parking-Overall-price-country on ['JDBu5SeNmupX0oIoln.xMlKzbD5FVPbxps6', 'JDBu5SeNmupX0oIoln.jJHWqTUXt7sM7wwtIGSV'] with 1 replicas and 20 partitions\n","stream":"stderr","time":"2021-12-17T03:12:08.177648286Z"}
|
{"log":"2021-12-16 19:13:08,198 - ftsindexmanager - INFO - Content = b'{\"status\":\"fail\", \"error\": \"server write timeout\"}' \n","stream":"stderr","time":"2021-12-17T03:13:08.199634998Z"}
|
|
|
|
|
{"log":"2021-12-16 20:29:13,776 - ftsindexmanager - INFO - Creating FTS index bucket_bucket4_idx_rinna_43-price-free_parking-country-public_likes-type on ['2mnhkwXVvKFG.xTD2drSb3JlYd7DqFSP5'] with 2 replicas and 18 partitions\n","stream":"stderr","time":"2021-12-17T04:29:13.77763704Z"}
|
{"log":"2021-12-16 20:30:13,787 - ftsindexmanager - INFO - Content = b'{\"status\":\"fail\", \"error\": \"server write timeout\"}' \n","stream":"stderr","time":"2021-12-17T04:30:13.788609777Z"}
|
|
|
|
|
{"log":"2021-12-16 18:47:07,027 - ftsindexmanager - INFO - Creating FTS index bucket_bucket4_idx_hnbec_15-country-free_parking-public_likes-Overall on ['P0docRVsGHF7cVlWXZ1D.EpO1hdwphUfvBjw'] with 2 replicas and 10 partitions\n","stream":"stderr","time":"2021-12-17T02:47:07.028617855Z"}
|
{"log":"2021-12-16 18:48:07,036 - ftsindexmanager - INFO - Content = b'{\"status\":\"fail\", \"error\": \"server write timeout\"}' \n","stream":"stderr","time":"2021-12-17T02:48:07.037001781Z"}
|
|
|
|
|
{"log":"2021-12-16 19:12:08,177 - ftsindexmanager - INFO - Creating FTS index bucket_bucket4_idx_gmiww_25-free_parking-Overall-price-country on ['JDBu5SeNmupX0oIoln.xMlKzbD5FVPbxps6', 'JDBu5SeNmupX0oIoln.jJHWqTUXt7sM7wwtIGSV'] with 1 replicas and 20 partitions\n","stream":"stderr","time":"2021-12-17T03:12:08.177648286Z"}
|
{"log":"2021-12-16 19:13:08,198 - ftsindexmanager - INFO - Content = b'{\"status\":\"fail\", \"error\": \"server write timeout\"}' \n","stream":"stderr","time":"2021-12-17T03:13:08.199634998Z"}
|
|
|
{"log":"2021-12-16 18:45:12,276 - ftsindexmanager - INFO - Deleting index bucket_bucket5_idx_pyedl_12-free_parking-price-public_likes\n","stream":"stderr","time":"2021-12-17T02:45:12.27793499Z"}
|
{"log":"2021-12-16 18:46:12,280 - ftsindexmanager - INFO - Status : False \n","stream":"stderr","time":"2021-12-17T02:46:12.280717414Z"}
|
{"log":"Response : {'date': 'Fri, 17 Dec 2021 02:46:12 GMT', 'content-length': '50', 'content-type': 'text/plain; charset=utf-8', 'status': '503'} \n","stream":"stderr","time":"2021-12-17T02:46:12.280736843Z"}
|
{"log":"Content : b'{\"status\":\"fail\", \"error\": \"server write timeout\"}'\n","stream":"stderr","time":"2021-12-17T02:46:12.280745965Z"}
|
{"log":"2021-12-16 18:46:12,280 - ftsindexmanager - INFO - Index bucket_bucket5_idx_pyedl_12-free_parking-price-public_likes not deleted\n","stream":"stderr","time":"2021-12-17T02:46:12.280752402Z"}
|
|
Cluster spec:
########## Cluster config ##################
|
###### kv : 4 ===== > [172.23.106.242:8091 172.23.106.253:8091 172.23.106.255:8091 172.23.107.89:8091] ###########
|
###### n1ql : 2 ===== > [172.23.105.185:8091 172.23.106.182:8091] ###########
|
###### fts : 6 ===== > [172.23.105.186:8091 172.23.105.190:8091 172.23.106.154:8091 172.23.106.243:8091 172.23.97.213:8091 172.23.97.214:8091] ###########
|
Logs:
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1639712066/collectinfo-2021-12-17T033427-ns_1%40172.23.105.185.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1639712066/collectinfo-2021-12-17T033427-ns_1%40172.23.105.186.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1639712066/collectinfo-2021-12-17T033427-ns_1%40172.23.105.190.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1639712066/collectinfo-2021-12-17T033427-ns_1%40172.23.106.154.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1639712066/collectinfo-2021-12-17T033427-ns_1%40172.23.106.182.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1639712066/collectinfo-2021-12-17T033427-ns_1%40172.23.106.242.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1639712066/collectinfo-2021-12-17T033427-ns_1%40172.23.106.243.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1639712066/collectinfo-2021-12-17T033427-ns_1%40172.23.106.253.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1639712066/collectinfo-2021-12-17T033427-ns_1%40172.23.106.255.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1639712066/collectinfo-2021-12-17T033427-ns_1%40172.23.107.89.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1639712066/collectinfo-2021-12-17T033427-ns_1%40172.23.97.213.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1639712066/collectinfo-2021-12-17T033427-ns_1%40172.23.97.214.zip
Attachments
Issue Links
- duplicates
-
MB-48848 Search: 1K indexes: some indexes' create/delete requests fail with server write time out
-
- Closed
-