[BP 7.2.4] - XDCR Checkpoint manager and pipeline stop in goroutine

Description

Observing checkpoint manager stop and pipeline stop log in goroutines in recent run, leading to small memory leak:

goroutine file:

Steps to reproduce:
1: Setup two 2-node clusters with 10 buckets each.
2. Start loading documents in all buckets.
3. Setup 100 replications between the clusters.
4. Introduce network connectivity issues between the clusters (block incoming traffic from target cluster).
5. Slight memory leak observed.

Attaching logs below:
Source cluster logs:
https://cb-engineering.s3.amazonaws.com/MB-58539_src/collectinfo-2023-09-14T134940-ns_1%40172.23.104.19.zip
https://cb-engineering.s3.amazonaws.com/MB-58539_src/collectinfo-2023-09-14T134940-ns_1%40172.23.104.21.zip
https://cb-engineering.s3.amazonaws.com/MB-58539_src/collectinfo-2023-09-14T134940-ns_1%40172.23.104.23.zip

Target cluster logs:
https://cb-engineering.s3.amazonaws.com/MB-58539_dest/collectinfo-2023-09-14T135006-ns_1%40172.23.104.18.zip
https://cb-engineering.s3.amazonaws.com/MB-58539_dest/collectinfo-2023-09-14T135006-ns_1%40172.23.104.17.zip
https://cb-engineering.s3.amazonaws.com/MB-58539_dest/collectinfo-2023-09-14T135006-ns_1%40172.23.104.16.zip

Components

Affects versions

Fix versions

Labels

Environment

None

Link to Log File, atop/blg, CBCollectInfo, Core dump

None

Release Notes Description

None

Activity

Show:

Neil Huang January 3, 2024 at 6:25 PM

Release Notes
Problem Description: Erroneous network conditions could lead to checkpoint manager slow at stopping
Resolution: Ensure checkpoint manager stops even if it had trouble starting due to network issues

CB robot September 20, 2023 at 11:15 PM

Build couchbase-server-7.2.3-6601 contains goxdcr commit 446c01f with commit message:
: ckptMgr to not wait on waitGrp in background

Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Is this a Regression?

Unknown

Triage

Untriaged

Story Points

Priority

Instabug

Open Instabug

PagerDuty

Sentry

Zendesk Support

Created September 20, 2023 at 6:53 PM
Updated January 3, 2024 at 6:25 PM
Resolved September 21, 2023 at 5:49 PM
Instabug