Loading...

Details

Type: Bug
Resolution: Duplicate
Priority: Critical
Fix Version/s: 7.1.0
Affects Version/s: 7.1.0
Component/s: secondary-index
Labels:
- system-test
Environment:
Enterprise Edition 7.1.0 build 2298

Triage:
Untriaged
Operating System:
Centos 64-bit
Link to Log File, atop/blg, CBCollectInfo, Core dump:

Hide
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.104.249.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.105.0.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.105.38.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.105.39.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.106.37.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.106.54.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.107.236.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.107.25.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.132.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.134.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.136.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.138.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.139.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.140.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.141.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.142.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.143.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.144.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.145.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.146.zip
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.148.zip

Show
         url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.104.249.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.105.0.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.105.38.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.105.39.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.106.37.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.106.54.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.107.236.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.107.25.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.132.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.134.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.136.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.138.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.139.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.140.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.141.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.142.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.143.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.144.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.145.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.146.zip          url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1644827768/collectinfo-2022-02-14T083609-ns_1%40172.23.108.148.zip
Story Points:
1
Is this a Regression?:
Unknown

Description

Test -

-test tests/integration/neo/test_neo_magma_milestone4.yml -scope tests/integration/neo/scope_neo_magma.yml

Day - 1
Cycle - 1
Scale - 3

TEST STEP
Rebalance in indexer node.

[2022-02-13T17:01:23-08:00, sequoiatools/couchbase-cli:7.1:48cbc7] server-add -c 172.23.108.139:8091 --server-add https://172.23.106.54 -u Administrator -p password --server-add-username Administrator --server-add-password password --services index

[2022-02-13T17:01:38-08:00, sequoiatools/couchbase-cli:7.1:d94c32] rebalance -c 172.23.108.139:8091 -u Administrator -p password

→  Error while waiting for container:%!(EXTRA *docker.NoSuchContainer=No such container: 550e427e4f664ec8ee84e31926dbad770e0435095804f21c1edea45b2c994578)

→  Error while waiting for container:%!(EXTRA *docker.NoSuchContainer=No such container: af8a65172f49d6741697c3ab5b3fd432c2535ab4d648a51d127b81999233d419)

→  Error while waiting for container:%!(EXTRA *docker.NoSuchContainer=No such container: 4f6a406dfe607eb0d05429d250e0c73dbdc619f618178baeeff11ccae83d0183)

→

Error occurred on container - sequoiatools/couchbase-cli:7.1:[rebalance -c 172.23.108.139:8091 -u Administrator -p password]

docker logs d94c32

docker start d94c32

*Unable to display progress bar on this os

JERROR: Rebalance failed. See logs for detailed reason. You can try again.

Rebalance failure

2022-02-14T00:04:40.574-08:00, ns_orchestrator:0:critical:message(ns_1@172.23.108.139) - Rebalance exited with reason {service_rebalance_failed,index,

                              {agent_died,<32792.30952.1>,

                               {lost_connection,

                                {'ns_1@172.23.108.132',shutdown}}}}.

Rebalance Operation Id = d3ea380ad59cf649459a2e3ac0f66260

List of indexer nodes

index : 6 ===== > [172.23.104.249:8091 172.23.105.0:8091 172.23.105.38:8091 172.23.105.39:8091 172.23.108.132:8091 172.23.108.140:8091]

Attachments

Gerrit Reviews

- Issue Only
- Show All Reviews
- Show Open Reviews
- Show All Issues
- Show Open Issues

No reviews matched the request. Check your Options in the drop-down menu of this sections header.

[System Test] Rebalance exited with reason {service_rebalance_failed, index, {agent_died, lost_connection

Details

Description

Attachments

Gerrit Reviews

Activity

People

Dates

Gerrit Reviews

PagerDuty