[System Test] Rebalance from 4 to 8 nodes took almost 1 hour to complete

There are 2 observations -

Rebalance triggered during a scale operation ( 4 nodes to 8 nodes) took almost one hour to complete. The query workload that I have running shouldn't really have that big an impact since the queries are run with a timeout of 10 minutes.

Rebalance Id - 1a6c93c7b58e41e39d81895b6ece9d08

"startTime":"2024-06-30T13:56:24.905Z","completedTime":"2024-06-30T14:59:49.588Z","timeTaken":3804683}

Post completion of the first rebalance, another rebalance gets triggered. Not sure if this is intentional since the first rebalance was successful.

"rebalanceId":"43e687c67a4b31a90e267114add4cd57" 

"startTime":"2024-06-30T14:59:51.738Z","completedTime":"2024-06-30T14:59:53.010Z","timeTaken":1272

cbcollect ->

https://cb-engineering.s3.amazonaws.com/SysTestColumnarJun28/collectinfo-2024-06-30T155358-ns_1%40svc-da-node-001.bks3edqzezfgtl1s.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJun28/collectinfo-2024-06-30T155358-ns_1%40svc-da-node-002.bks3edqzezfgtl1s.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJun28/collectinfo-2024-06-30T155358-ns_1%40svc-da-node-003.bks3edqzezfgtl1s.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJun28/collectinfo-2024-06-30T155358-ns_1%40svc-da-node-004.bks3edqzezfgtl1s.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJun28/collectinfo-2024-06-30T155358-ns_1%40svc-da-node-005.bks3edqzezfgtl1s.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJun28/collectinfo-2024-06-30T155358-ns_1%40svc-da-node-006.bks3edqzezfgtl1s.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJun28/collectinfo-2024-06-30T155358-ns_1%40svc-da-node-007.bks3edqzezfgtl1s.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJun28/collectinfo-2024-06-30T155358-ns_1%40svc-da-node-008.bks3edqzezfgtl1s.sandbox.nonprod-project-avengers.com.zip