Details
Major Description
What's the issue?
We're hitting our one minute timeout trying to backup Analytics metadata, we should understand:
- Why that is?
- Is it expected?
- Why are we hitting this now, we haven't changed this timeout?
- Can we reduce the time to backup/restore for Analytics?
- Should we further increase the timeouts for Analytics backup/restore?
- What would sensible timeouts be?
2022-06-18T10:00:49.522-07:00 (REST) (Attempt 1) (GET) Dispatching request to 'http://172.23.106.188:8095/api/v1/backup'
|
2022-06-18T10:01:49.523-07:00 ERRO: (REST) (Attempt 1) (GET) Failed to perform request to 'http://172.23.106.188:8095/api/v1/backup': Get "http://172.23.106.188:8095/api/v1/backup": context deadline exceeded (Client.Timeout exceeded while awaiting headers) – logging.(*ToolsCommonLogger).Log() at tools_common.go:30
|
2022-06-18T10:01:49.523-07:00 WARN: (REST) (Attempt 1) (GET) Request to endpoint '/api/v1/backup' failed due to error: failed to perform request: Get "http://172.23.106.188:8095/api/v1/backup": context deadline exceeded (Client.Timeout exceeded while awaiting headers) – logging.(*ToolsCommonLogger).Log() at tools_common.go:28
|
2022-06-18T10:01:49.523-07:00 (Cmd) Error backing up cluster: failed to execute cluster operations: failed to transfer Analytics metadata: failed to get Analytics metadata: failed to get analytics metadata: failed to execute request: failed to execute request: failed to perform request: Get "http://172.23.106.188:8095/api/v1/backup": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
|
Server Logs
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.104.137.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.104.155.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.104.5.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.104.67.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.104.69.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.104.70.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.105.107.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.105.111.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.105.168.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.106.100.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.106.188.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.108.103.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.120.107.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.120.245.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.123.28.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.96.148.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.96.192.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.96.251.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.96.252.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.96.253.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.97.119.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.97.121.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.97.122.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.97.239.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.99.11.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.99.20.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.99.21.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1655616906/collectinfo-2022-06-19T053508-ns_1%40172.23.99.25.zip