Details
-
Bug
-
Resolution: Not a Bug
-
Critical
-
7.6.0
-
Untriaged
-
0
-
Unknown
Description
The following test was done on Capella -
After the node auto failover, it was unable to get added back into the cluster and the below error was visible in the logs.
Failed to add node svc-s-node-010.zumnyloovvbb6uxi.sandbox.nonprod-project-avengers.com:18091 to cluster. Prepare join failed. Failed to establish TLS connection to svc-s-node-010.zumnyloovvbb6uxi.sandbox.nonprod-project-avengers.com:18091. The certificate is issued by unknown CA or some of the intermediate certificates are missing (TLS client: In state wait_cert_cr at ssl_handshake.erl:2111 generated CLIENT ALERT: Fatal - Unknown CA ). Please review the CAs available on the cluster (ns_1@svc-d-node-004.zumnyloovvbb6uxi.sandbox.nonprod-project-avengers.com) and add a new one if required
the node got successfully added into the cluster again after about 6 hours.
the node to faillover was - svc-s-node-010.zumnyloovvbb6uxi.sandbox.nonprod-project-avengers.com
server logs -
https://cb-engineering.s3.amazonaws.com/Aman/collectinfo-2024-02-02T125628-ns_1%40svc-d-node-004.zumnyloovvbb6uxi.sandbox.nonprod-project-avengers.com-redacted.zip
https://cb-engineering.s3.amazonaws.com/Aman/collectinfo-2024-02-02T125628-ns_1%40svc-d-node-005.zumnyloovvbb6uxi.sandbox.nonprod-project-avengers.com-redacted.zip
https://cb-engineering.s3.amazonaws.com/Aman/collectinfo-2024-02-02T125628-ns_1%40svc-d-node-006.zumnyloovvbb6uxi.sandbox.nonprod-project-avengers.com-redacted.zip
https://cb-engineering.s3.amazonaws.com/Aman/collectinfo-2024-02-02T125628-ns_1%40svc-s-node-007.zumnyloovvbb6uxi.sandbox.nonprod-project-avengers.com-redacted.zip
https://cb-engineering.s3.amazonaws.com/Aman/collectinfo-2024-02-02T125628-ns_1%40svc-s-node-008.zumnyloovvbb6uxi.sandbox.nonprod-project-avengers.com-redacted.zip
https://cb-engineering.s3.amazonaws.com/Aman/collectinfo-2024-02-02T125628-ns_1%40svc-s-node-009.zumnyloovvbb6uxi.sandbox.nonprod-project-avengers.com-redacted.zip
https://cb-engineering.s3.amazonaws.com/Aman/collectinfo-2024-02-02T125628-ns_1%40svc-s-node-010.zumnyloovvbb6uxi.sandbox.nonprod-project-avengers.com-redacted.zip
https://cb-engineering.s3.amazonaws.com/Aman/collectinfo-2024-02-02T125628-ns_1%40svc-s-node-011.zumnyloovvbb6uxi.sandbox.nonprod-project-avengers.com-redacted.zip
cluster configs -
KV Nodes - 3
FTS Nodes - 5
16vCPUS, 32GB RAM for each node