[SGW]TestSyncGatewayCreateLocalTLS fails with "context deadline exceeded: document count zero"

Description

Suite: P0

Stack Trace:

--- FAIL: TestOperator (856.43s) --- FAIL: TestOperator/TestSyncGatewayCreateLocalTLS (217.10s) crd_util.go:26: creating couchbase cluster: test-couchbase-x0rfg util.go:1304: context deadline exceeded: document count zero util.go:1305: goroutine 440 [running]: runtime/debug.Stack(0xc0006d3200, 0xc000905d20, 0x1) /jenkins/workspace/cbop-gke-p0-2.0.x/go/src/runtime/debug/stack.go:24 +0x9d github.com/couchbase/couchbase-operator/test/e2e/e2eutil.Die(0xc0006d3200, 0x19741c0, 0xc000592310) /jenkins/workspace/cbop-gke-p0-2.0.x/gopath/src/github.com/couchbase/couchbase-operator/test/e2e/e2eutil/util.go:1305 +0x77 github.com/couchbase/couchbase-operator/test/e2e/e2eutil.MustVerifyDocCountInBucketNonZero(0xc0006d3200, 0xc000315700, 0xc000683200, 0x171c334, 0x7, 0xdf8475800) jenkins/workspace/cbop-gke-p0-2.0.x/gopath/src/github.com/couchbase/couchbase-operator/test/e2e/e2eutil/xdcr_util.go:150 +0x92 github.com/couchbase/couchbase-operator/test/e2e.testSyncGatewayCreate(0xc0006d3200, 0xc000315700, 0xc000315700, 0x0, 0xc000476e60, 0x0) /jenkins/workspace/cbop-gke-p0-2.0.x/gopath/src/github.com/couchbase/couchbase-operator/test/e2e/sync-gateway.go:50 +0x208 github.com/couchbase/couchbase-operator/test/e2e.TestSyncGatewayCreateLocalTLS(0xc0006d3200) /jenkins/workspace/cbop-gke-p0-2.0.x/gopath/src/github.com/couchbase/couchbase-operator/test/e2e/sync-gateway.go:67 +0x17c github.com/couchbase/couchbase-operator/test/e2e/framework.RecoverDecorator.func1(0xc0006d3200) /jenkins/workspace/cbop-gke-p0-2.0.x/gopath/src/github.com/couchbase/couchbase-operator/test/e2e/framework/test_util.go:347 +0x69 testing.tRunner(0xc0006d3200, 0xc000439d40) /jenkins/workspace/cbop-gke-p0-2.0.x/go/src/testing/testing.go:909 +0xc9 created by testing.(*T).Run /jenkins/workspace/cbop-gke-p0-2.0.x/go/src/testing/testing.go:960 +0x350
Images Used: couchbase sync gateway: couchbase/sync-gateway:2.7.3-enterprise couchbase operator: couchbase/couchbase-operator-internal:2.0.2-110 couchbase admission controller: couchbase/couchbase-admission-internal:2.0.2-110 couchbase server: couchbase/server:6.5.1 couchbase server upgrade: couchbase/server:6.5.1

TestCase:  https://github.com/couchbase/couchbase-operator/blob/49172cbaab0f9ae227b86ac6cfe7cc62551a7988/test/e2e/sync-gateway.go#L63

Job URL:  http://qa.sc.couchbase.com/view/Cloud/job/cbop-gke-p0-2.0.x/147/console

 The same behaviour is observed for these Sync Gateway test cases as well:

TestSyncGatewayCreateLocalMutualTLS TestSyncGatewayCreateLocalMandatoryMutualTLS TestSyncGatewayCreateRemoteTLS TestSyncGatewayCreateRemoteMutualTLS TestSyncGatewayCreateRemoteMandatoryMutualTLS

Job URL:  http://qa.sc.couchbase.com/view/Cloud/job/cbop-gke-p0-2.0.x/146/console

Logs attached.(archive.tgz contains logs of TestSyncGatewayCreateLocalTLS failure, archive_SGW.tgz contains logs of all SGW test case failures)

Environment

None

Release Notes Description

None

Attachments

6
  • 23 Jul 2020, 11:27 AM
  • 23 Jul 2020, 11:27 AM
  • 23 Jul 2020, 11:27 AM
  • 23 Jul 2020, 11:27 AM
  • 21 Jul 2020, 01:03 PM
  • 21 Jul 2020, 12:59 PM

Activity

Show:

Eric Schneider September 4, 2020 at 10:29 PM
Edited

Description for release notes:

*Summary:* When running applications (such as Sync Gateway) that are using DNS SRV over TLS to connect to a Couchbase Cluster in the same Kubernetes cluster, lookup may fail hostname validation checks. *Workaround:* Add wildcard matches to the Subject Alternate Names (SANs) in the certificate for the Kubernetes-based host names.Specifically, add `DNS:*.$\{cluster}.$\{namespace}.svc` and `DNS:$\{cluster}-srv.$\{namespace}.svc` as discussed in the xref:tutorial-tls.adoc#creating-a-couchbase-cluster-server-certificate[Creating TLS Certificates] tutorial.

Priya Rajagopal August 25, 2020 at 11:37 PM

Thanks for the subtask .

Matt Ingenthron August 25, 2020 at 9:52 PM

agreed on the docs link, thanks for the clarification. I'll defer to on how to handle the footnote. I took the liberty of opening a subtask so we don't forget the RN since this is closed.

Priya Rajagopal August 21, 2020 at 1:28 PM

, I agree with the suggestion of including release notes but to also point to the docs link that Simon has mentioned
In notes .In addition, IIRC there was a docs page that discussed compatibility between different clients (XDCR, Sync Gatewat etc). Can we please add a footnote to that as well - people are likely going to miss this in release specific notes that are more point in time

Simon Murray August 19, 2020 at 4:15 PM

Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Story Points

Fix versions

Affects versions

Priority

Instabug

Open Instabug

PagerDuty

Sentry

Zendesk Support

Created July 21, 2020 at 1:04 PM
Updated September 4, 2020 at 10:37 PM
Resolved August 21, 2020 at 12:35 PM
Instabug