Loading...

Details

Type: Bug
Resolution: Known Error
Priority: Critical
Fix Version/s: 7.6.0
Affects Version/s: 7.6.0
Component/s: eventing
Labels:
- system-test
Environment:
7.6.0-2119

Triage:
Untriaged
Operating System:
Linux x86_64
Link to Log File, atop/blg, CBCollectInfo, Core dump:

Hide
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.104.213.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.104.215.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.104.227.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.105.237.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.105.238.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.105.63.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.106.109.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.106.110.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.106.121.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.106.124.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.106.164.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.121.72.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.121.87.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.121.94.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.96.186.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.96.203.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.96.253.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.97.189.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.97.226.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.97.229.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.97.242.zip
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.97.245.zip

Show
url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.104.213.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.104.215.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.104.227.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.105.237.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.105.238.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.105.63.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.106.109.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.106.110.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.106.121.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.106.124.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.106.164.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.121.72.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.121.87.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.121.94.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.96.186.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.96.203.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.96.253.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.97.189.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.97.226.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.97.229.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.97.242.zip url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1707801509/collectinfo-2024-02-13T054821-ns_1%40172.23.97.245.zip
Story Points:
0
Is this a Regression?:
Unknown

Description

This bug looks similar to ~~MB-60533~~

Script to Repro

./sequoia -client 172.23.110.181:2375 -provider file:debian_pine.yml -test tests/integration/7.6/test_7.6.yml -scope tests/integration/7.6/scope_7.6_magma.yml -scale 3 -repeat 0 -log_level 0 -version 7.6.0-2119 -skip_setup=false -skip_test=false -skip_teardown=true -skip_cleanup=false -continue=false -collect_on_error=false -stop_on_error=false -duration=1209600 -show_topology=true

+172.23.96.203 17:03:02 10 Feb, 2024

Rebalance exited with reason {service_rebalance_failed,eventing,

{worker_died,

{'EXIT',<0.16769.1002>,

{task_failed,rebalance,

 {service_error,

  <<"eventing rebalance hasn't made progress for past 1200 secs">>}}}}}.

Rebalance Operation Id = bf2f5d2f824fef6fd78f490eff3cb4fd

172.23.104.213, 172.23.104.215, 172.23.104.227 are the eventing nodes in cluster.

Attachments

Gerrit Reviews

- Issue Only
- Show All Reviews
- Show Open Reviews
- Show All Issues
- Show Open Issues

No reviews matched the request. Check your Options in the drop-down menu of this sections header.

Eventing Rebalance exited with reason {service_rebalance_failed,eventing, {worker_died

Details

Description

Attachments

Gerrit Reviews

Activity

People

Dates

Gerrit Reviews

PagerDuty