Loading...

XML

Word

Printable

Details

Type: Bug
Resolution: Cannot Reproduce
Priority: Critical
Fix Version/s: 7.0.0
Affects Version/s: Cheshire-Cat
Component/s: secondary-index
Labels:

Triage:
Untriaged
Link to Log File, atop/blg, CBCollectInfo, Core dump:

Hide
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.16.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.17.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.18.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.19.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.21.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.23.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.25.zip (index node)
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.93.zip (index node)
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.94.zip (index node)
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.96.30.zip (index node)
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.96.31.zip (index node)
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.96.96.zip (index node)

Show
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.16.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.17.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.18.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.19.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.21.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.23.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.25.zip (index node) url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.93.zip (index node) url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.104.94.zip (index node) url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.96.30.zip (index node) url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.96.31.zip (index node) url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1602137356/collectinfo-2020-10-08T060918-ns_1%40172.23.96.96.zip (index node)
Story Points:
1
Is this a Regression?:
Unknown

Description

Build : 7.0.0-3291
Test : -test tests/2i/test_idx_clusterops_cheshire_cat.yml -scope tests/2i/scope_idx_cheshire_cat.yml
Scale : 2
Iteration : 1st

This is a new system test with indexes on collections, and cluster ops. There are 20 scopes, 200 collections, and ~1000 index instances in the cluster. The first rebalance operation was to add a new index node to the cluster. This failed due to ~~MB-41909~~. The subsequent rebalance was started after this, and was to rebalance out the index node 172.23.104.25. This operation started at 2020-10-07T20:00:28 and is still going on since 22 hrs.

Attaching logs from ~11 PM on 2020-10-07. Let me know if you need logs from after this time.

Attachments

Gerrit Reviews

- Issue Only
- Show All Reviews
- Show Open Reviews
- Show All Issues
- Show Open Issues

No reviews matched the request. Check your Options in the drop-down menu of this sections header.

Activity

People

Assignee:: Mihir Kamdar (Inactive)

Reporter:: Mihir Kamdar (Inactive)

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 08/Oct/20 6:47 PM

Updated:: 22/Nov/21 8:58 AM

Resolved:: 13/Jan/21 9:52 PM

Gerrit Reviews

There are no open Gerrit changes

[System Test] : Index rebalance stuck for ~22 hrs

Details

Description

Attachments

Gerrit Reviews

Activity

People

Dates

Gerrit Reviews

PagerDuty