Rebalance failed in windows runs on build 7.6.3-4047

Chris Hillery I suspect it's the same issue we saw in MB-61846. Can you take a look? The query service (zeus-srv-05) didn't start on this system. BTW, it's the first time we run windows tests using 7.6.3 build.

2024-07-19T13:15:26 [ERROR] Rebalance failed with message Rebalance exited with reason {service_rebalance_failed,n1ql, {{badmatch, {error, {bad_nodes,n1ql,set_service_manager, [{'ns_1@zeus-srv-05.perf.couchbase.com', {exit, {{linked_process_died,<0.12581.0>, {'ns_1@zeus-srv-05.perf.couchbase.com',

Unknown macro: {no_connection, "cbq-engine-service_api"}

}}, {gen_server,call, [

Unknown macro: {'service_agent-n1ql', 'ns_1@zeus-srv-05.perf.couchbase.com'}

, {set_service_manager,<0.12635.0>}, infinity]}}}}]}}}, [{service_manager,set_service_manager,1, [

Unknown macro: {file,"src/service_manager.erl"}

, {line,188}]}, {service_manager,run_op,1, [

, {line,146}]}, {proc_lib,init_p,3, [

Unknown macro: {file,"proc_lib.erl"}

,{line,225}]}]}}.

Service 'n1ql' exited with status 1. Restarting. Messages: 2024-07-19T13:20:29.084-07:00 [INFO] FFDC: Found 0 existing dump file(s); 0 bytes. 2024-07-19T13:20:29.084-07:00 [Info] GSIClient DeploymentModel is set to: default, input: default 2024-07-19T13:20:29.084-07:00 [ERROR] Attempt to set relative temporary path: C:\Windows\TEMP 2024-07-19T13:20:29.085-07:00 [INFO] Initialization of cbauth succeeded 2024-07-19T13:20:30.081-07:00 DEBU REGU.impl.init.0.func1() at aggrecorder.go:57 [id 44] will report aggregate recorder stats every 5m0s 2024-07-19T13:20:37.822-07:00 [ERROR] Cannot connect to default pool: Namespace not found in CB datastore: default - cause: HTTP error 500 Internal Server Error getting "http://127.0.0.1:8091/pools/default?uuid=d90cf8fe0efe888de6502c653b0dbc1d": ["Unexpected server error, request logged."] 2024-07-19T13:20:37.822-07:00 [ERROR] Namespace not found in CB datastore: default - cause: HTTP error 500 Internal Server Error getting "http://127.0.0.1:8091/pools/default?uuid=d90cf8fe0efe888de6502c653b0dbc1d": ["Unexpected server error, request logged."] 2024-07-19T13:20:37.822-07:00 [ERROR] Shutting down.

Build: 7.6.3-4047
Job: https://perf.jenkins.couchbase.com/job/zeus/13270/

Logs:
https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2024-07-19T201926-ns_1%40zeus-srv-01.perf.couchbase.com.zip
https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2024-07-19T201926-ns_1%40zeus-srv-02.perf.couchbase.com.zip
https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2024-07-19T201926-ns_1%40zeus-srv-03.perf.couchbase.com.zip
https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2024-07-19T201926-ns_1%40zeus-srv-04.perf.couchbase.com.zip
https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2024-07-19T201926-ns_1%40zeus-srv-05.perf.couchbase.com.zip
https://s3.amazonaws.com/bugdb/jira/qe/collectinfo-2024-07-19T201926-ns_1%40zeus-srv-06.perf.couchbase.com.zip