Details
Critical Description
The cluster was deployed as 7.2.3, with 3 nodes initially, it was scaled-out to 5 nodes, and then an upgrade to 7.6.2-3721 (Agent: d8f694d4) was triggered, when the node with 7.6.2 came in to replace nodes, the cluster got stuck at the ANALYTICS rebalance stage.
(Logs attached below)
Specifications :
- AMI upgrade from : 7.2.3-1026 to 7.6.2-3721
- Capella cluster stuck in upgarding state
- Cluster specs :
- CSP - AWS
- Nodes - 5
- Services : All services colocated on all nodes
- Buckets - 2
- (attached below)
- Scopes : 5
- Collections : 5
- Error (while rebalance) :
- Rebalance exited with reason {service_rebalance_failed,cbas, {worker_died, {'EXIT',<0.14304.34>, {task_failed,rebalance,
{service_error, <<"Rebalance 2bc1ae1f94e873d84c7bf0e29041c47b failed: CBAS0001: Analytics collection `travel-sample`.inventory.airline in different partitions has different DCP states. Seqno gap = 24. User action: Try again later">>}
}}}}. Rebalance Operation Id = 5d35cd6bb1639727e4de7cff8f6e2244
- Rebalance exited with reason {service_rebalance_failed,cbas, {worker_died, {'EXIT',<0.14304.34>, {task_failed,rebalance,
{service_error, <<"Rebalance 2bc1ae1f94e873d84c7bf0e29041c47b failed: CBAS0001: Analytics collection `travel-sample`.inventory.airline in different partitions has different DCP states. Seqno gap = 24. User action: Try again later">>}
