Details
-
Bug
-
Resolution: Duplicate
-
Critical
-
Cheshire-Cat
-
Untriaged
-
1
-
Unknown
Description
Build : 7.0.0-2663
Test : -test tests/integration/test_allFeatures_madhatter_durability.yml -scope tests/integration/scope_Xattrs_Madhatter.yml
Scale : 2
Iteration : Iteration 3 (day 1)
The test step was to remove 2 index nodes from the cluster - 172.23.97.105 & 172.23.96.18. As part of this rebalance operation, indexes were being moved across the remaining nodes. One of the index - default_result - is stuck in "replicating" state, and rebalance is still not complete after 29 hrs.
This index default_result is in replicating state on 172.23.106.134 & 172.23.97.105, and its replica is in ready state on 172.23.97.110.
The rebalance operation started at 2020-07-23T03:02:39. Sharing 2 sets of logs from
Set 1 (2020-07-23 18:06 ) :
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.106.134.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.120.73.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.120.74.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.120.77.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.120.86.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.123.25.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.123.26.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.123.33.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.96.18.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.96.243.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.96.254.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.96.48.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.97.105.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.97.110.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.97.148.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.97.149.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.97.150.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.97.151.zip
|
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1595552811/collectinfo-2020-07-24T010652-ns_1%40172.23.97.74.zip
|
Set 2 (2020-07-24 9 AM) :
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.106.134.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.120.73.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.120.74.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.120.77.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.120.86.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.123.25.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.123.26.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.123.33.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.96.18.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.96.243.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.96.254.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.96.48.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.97.105.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.97.110.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.97.148.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.97.149.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.97.150.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.97.151.zip
|
https://uploads.couchbase.com/idx_build_hang_072420/collectinfo-2020-07-24T155917-ns_1%40172.23.97.74.zip
|