[BP MB-52790 to 7.2.0] - perf tests stuck due to failed cbindex

Description

While running experiments on aether cluster for , I noticed that cbindex fails to execute build index and the test gets stuck.

For example, in aether/2081:

In indexer log at the same timestamp:

 

aether runs that got stuck:

  1. aether/2181 - logs: http://supportal.couchbase.com/snapshot/00f716993c837f142ce7be66d795d3a6::0

    1. I was able to ssh into the machine and successfully execute the cbindex build. Logs are from before this.

  2. aether/2080 - logs: no logs

  3. aether/2179 - logs: http://supportal.couchbase.com/snapshot/8a7321512e5e867a7b0fc1499f37d232::0

 

These experiments were with various toy builds built on top of 7.1.1-3097

Components

Affects versions

Fix versions

Labels

Environment

None

Link to Log File, atop/blg, CBCollectInfo, Core dump

None

Release Notes Description

None

Activity

Show:

Yash Dodderi February 27, 2023 at 5:34 PM

Verified on 7.2.0-5120

repro steps

  1. start a cluster with more than 1 index node

  2. run DDL

  3. wait for around 5 mins

  4. check for the error msg "[Error] watcher:ClientAuth cluster Ver (6)/Internal Version () not yet initialised"

Closing the ticket

CB robot January 31, 2023 at 9:21 AM

Build couchbase-server-7.2.0-5117 contains indexing commit 212bece with commit message:
- initialise indexer internal verison

Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Is this a Regression?

Unknown

Triage

Untriaged

Due date

Story Points

Priority

Instabug

Open Instabug

PagerDuty

Sentry

Zendesk Support

Created January 24, 2023 at 5:56 AM
Updated August 31, 2024 at 11:06 AM
Resolved January 31, 2023 at 8:03 AM
Instabug