Details
-
Bug
-
Resolution: Duplicate
-
Critical
-
7.6.0
-
7.6.0-1786
-
Untriaged
-
0
-
Unknown
Description
Rebalance failure -
{"stageInfo":{"index":{"totalProgress":32.77529496151838,"perNodeProgress":{"ns_1@172.23.106.30":0.3277529496151839,"ns_1@172.23.106.171":0.3277529496151839,"ns_1@172.23.105.122":0.3277529496151839,"ns_1@172.23.106.176":0.3277529496151839,"ns_1@172.23.97.108":0.3277529496151839},"startTime":"2023-11-13T13:03:13.848-08:00","completedTime":false,"timeTaken":121158},"data":{"totalProgress":100,"perNodeProgress":{"ns_1@172.23.96.230":1,"ns_1@172.23.96.245":1,"ns_1@172.23.97.66":1,"ns_1@172.23.96.198":1},"startTime":"2023-11-13T13:03:10.527-08:00","completedTime":"2023-11-13T13:03:13.839-08:00","timeTaken":3312},"query":{"totalProgress":100,"perNodeProgress":{"ns_1@172.23.97.100":1,"ns_1@172.23.97.67":1},"startTime":"2023-11-13T13:03:13.840-08:00","completedTime":"2023-11-13T13:03:13.848-08:00","timeTaken":8}},"rebalanceId":"4b3633defda44c21c2265cd27526985b","nodesInfo":{"active_nodes":["ns_1@172.23.105.122","ns_1@172.23.106.171","ns_1@172.23.106.176","ns_1@172.23.106.30","ns_1@172.23.96.198","ns_1@172.23.96.230","ns_1@172.23.96.245","ns_1@172.23.97.100","ns_1@172.23.97.108","ns_1@172.23.97.66","ns_1@172.23.97.67"],"keep_nodes":["ns_1@172.23.105.122","ns_1@172.23.106.171","ns_1@172.23.106.176","ns_1@172.23.106.30","ns_1@172.23.96.198","ns_1@172.23.96.230","ns_1@172.23.96.245","ns_1@172.23.97.100","ns_1@172.23.97.108","ns_1@172.23.97.66","ns_1@172.23.97.67"],"eject_nodes":[],"delta_nodes":[],"failed_nodes":["ns_1@172.23.97.109"]},"masterNode":"ns_1@172.23.97.67","startTime":"2023-11-13T13:03:10.523-08:00","completedTime":"2023-11-13T13:05:15.006-08:00","timeTaken":124482,"completionMessage":"Rebalance exited with reason {service_rebalance_failed,index,\n {worker_died,\n {'EXIT',<0.11982.234>,\n {task_failed,rebalance,\n {service_error,\n <<\"error locking shard, shardId 5495828417914836485 not present\">>}}}}}."} |
|
Cbcollect logs:
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1699909124/collectinfo-2023-11-13T211146-ns_1%40172.23.105.122.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1699909124/collectinfo-2023-11-13T211146-ns_1%40172.23.106.171.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1699909124/collectinfo-2023-11-13T211146-ns_1%40172.23.106.176.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1699909124/collectinfo-2023-11-13T211146-ns_1%40172.23.106.30.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1699909124/collectinfo-2023-11-13T211146-ns_1%40172.23.96.198.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1699909124/collectinfo-2023-11-13T211146-ns_1%40172.23.96.230.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1699909124/collectinfo-2023-11-13T211146-ns_1%40172.23.96.245.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1699909124/collectinfo-2023-11-13T211146-ns_1%40172.23.97.100.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1699909124/collectinfo-2023-11-13T211146-ns_1%40172.23.97.108.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1699909124/collectinfo-2023-11-13T211146-ns_1%40172.23.97.66.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1699909124/collectinfo-2023-11-13T211146-ns_1%40172.23.97.67.zip
Attachments
Issue Links
- duplicates
-
MB-59602 don't schedule move tokens before copy finishes
- Closed