Loading...

Details

Type: Bug
Resolution: Fixed
Priority: Critical
Fix Version/s: 7.1.0
Affects Version/s: 7.1.0
Component/s: XDCR
Labels:
- eagle-eye
- system-test

Triage:
Untriaged
Operating System:
Centos 64-bit
Link to Log File, atop/blg, CBCollectInfo, Core dump:

Hide
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.106.134.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.120.58.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.120.73.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.120.74.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.120.75.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.120.77.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.120.81.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.120.86.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.121.77.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.123.24.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.123.25.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.123.26.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.123.31.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.123.32.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.123.33.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.96.122.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.96.243.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.96.254.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.96.48.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.105.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.110.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.112.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.148.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.149.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.150.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.151.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.241.zip
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.74.zip

Show
https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.106.134.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.120.58.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.120.73.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.120.74.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.120.75.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.120.77.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.120.81.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.120.86.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.121.77.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.123.24.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.123.25.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.123.26.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.123.31.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.123.32.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.123.33.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.96.122.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.96.243.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.96.254.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.96.48.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.105.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.110.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.112.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.148.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.149.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.150.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.151.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.241.zip https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1630538920/collectinfo-2021-09-01T232841-ns_1%40172.23.97.74.zip
Story Points:
1
Is this a Regression?:
Unknown

Description

Build - 7.1.0 - 1231
Test :

-test tests/integration/cheshirecat/test_cheshirecat_kv_gsi_coll_xdcr_backup_sgw_fts_itemct_txns_eventing_cbas_scale3.yml -scope tests/integration/cheshirecat/scope_cheshirecat_with_backup.yml

Day - 1
Cycle - 1
Scale - 3

On 172.23.120.73
diag.log

2021-09-01T15:10:55.649-07:00, ns_log:0:info:message(ns_1@172.23.120.73) - Service 'goxdcr' exited with status 2. Restarting. Messages:

	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/pipeline_svc/statistics_manager.go:578 +0x6ca

github.com/couchbase/goxdcr/pipeline_svc.(*StatisticsManager).processRawStats(0xc0000bec00, 0xe, 0xce4685)

	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/pipeline_svc/statistics_manager.go:509 +0x99a

github.com/couchbase/goxdcr/pipeline_svc.(*StatisticsManager).updateStatsOnce(0xc0000bec00, 0xc001093dc0, 0x4)

	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/pipeline_svc/statistics_manager.go:340 +0x1b6

github.com/couchbase/goxdcr/pipeline_svc.(*StatisticsManager).updateStats(0xc0000bec00, 0x0, 0x0)

	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/pipeline_svc/statistics_manager.go:294 +0x4a5

created by github.com/couchbase/goxdcr/pipeline_svc.(*StatisticsManager).Start

	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/pipeline_svc/statistics_manager.go:788 +0x15e

goxdcr.log

2021-09-01T15:10:55.640-07:00 INFO GOXDCR.StatsMgr: feb818db2815996b8e50a66fb171e6d7/bucket4/bucket4-422695262 updateStats exited

panic: runtime error: invalid memory address or nil pointer dereference

[signal SIGSEGV: segmentation violation code=0x1 addr=0x8 pc=0x7e8aad]

goroutine 3531 [running]:

github.com/couchbase/goxdcr/base.(*SeqnoWithLock).getSeqno(0x0, 0xc000b40001, 0x0)

	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/base/types.go:763 +0x4d

github.com/couchbase/goxdcr/base.(*SeqnoWithLock).GetSeqno(...)

	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/base/types.go:737

github.com/couchbase/goxdcr/pipeline_svc.(*StatisticsManager).calculateDocsChecked(0xc0000bec00, 0x0)

	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/pipeline_svc/statistics_manager.go:617 +0x15e

github.com/couchbase/goxdcr/pipeline_svc.(*StatisticsManager).processCalculatedStats(0xc0000bec00, 0xc00130cd80, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0)

	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/pipeline_svc/statistics_manager.go:578 +0x6ca

github.com/couchbase/goxdcr/pipeline_svc.(*StatisticsManager).processRawStats(0xc0000bec00, 0xe, 0xce4685)

	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/pipeline_svc/statistics_manager.go:509 +0x99a

github.com/couchbase/goxdcr/pipeline_svc.(*StatisticsManager).updateStatsOnce(0xc0000bec00, 0xc001093dc0, 0x4)

	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/pipeline_svc/statistics_manager.go:340 +0x1b6

github.com/couchbase/goxdcr/pipeline_svc.(*StatisticsManager).updateStats(0xc0000bec00, 0x0, 0x0)

	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/pipeline_svc/statistics_manager.go:294 +0x4a5

created by github.com/couchbase/goxdcr/pipeline_svc.(*StatisticsManager).Start

	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/pipeline_svc/statistics_manager.go:788 +0x15e

Attachments

Gerrit Reviews

- Issue Only
- Show All Reviews
- Show Open Reviews
- Show All Issues
- Show Open Issues

No reviews matched the request. Check your Options in the drop-down menu of this sections header.

[System Test] Service 'goxdcr' exited with status 2.

Details

Description

Attachments

Gerrit Reviews

Activity

People

Dates

Gerrit Reviews

PagerDuty