Uploaded image for project: 'Couchbase Monitoring and Observability Stack'
  1. Couchbase Monitoring and Observability Stack
  2. CMOS-386

manager.TestAddNewCluster potentially flakey

    XMLWordPrintable

Details

    • Bug
    • Resolution: Unresolved
    • Minor
    • 0.3
    • 0.2
    • cluster-monitor
    • None

    Description

      Got a failure in http://cv.jenkins.couchbase.com/job/cbmultimanager-cv/job/master/1450/ which was fixed by a retrigger:

      === RUN   TestAddNewCluster/OK
      2022-03-23T13:38:51.178Z WARN Single Cluster Manager Cluster heartbeat failed {"cluster": "uuid-0", "err": "could not create REST client: failed to bootstrap client: failed to connect to any host(s) from the connection string, check username and password"}
      2022-03-23T13:38:51.178Z WARN Check Runner Error running checker {"checker": "bucketEndpointCheckers", "cluster": "uuid-0", "error": "could not create client to communicate with clsuter: could not create REST client: failed to bootstrap client: failed to connect to any host(s) from the connection string, check username and password"}
      2022-03-23T13:38:51.185Z WARN Check Runner Error running checker {"checker": "sharedClientChecks", "cluster": "uuid-0", "error": "could not create client to communicate with cluster: could not create REST client: failed to bootstrap client: failed to connect to any host(s) from the connection string, check username and password"}
      2022-03-23T13:38:51.186Z WARN Check Runner Error running checker {"checker": "bucketStatCheckers", "cluster": "uuid-0", "error": "could not create client to communicate with cluster: could not create REST client: failed to bootstrap client: failed to connect to any host(s) from the connection string, check username and password"}
      2022-03-23T13:38:51.186Z WARN Check Runner Error running checker {"checker": "serviceCheck", "cluster": "uuid-0", "error": "could not create client: could not create REST client: failed to bootstrap client: failed to connect to any host(s) from the connection string, check username and password"}
      2022-03-23T13:38:51.187Z WARN Check Runner Error running checker {"checker": "nodeSelfChecks", "cluster": "uuid-0", "error": "could not create client: could not create REST client: failed to bootstrap client: failed to connect to any host(s) from the connection string, check username and password"}
      2022-03-23T13:38:51.187Z WARN Check Runner Error running checker {"checker": "bucketMemcachedStatsCheckers", "cluster": "uuid-0", "error": "could not create memcached client for cluster: could not create client to communicate with data nodes: could not create REST client: failed to bootstrap client: failed to connect to any host(s) from the connection string, check username and password"}
      2022-03-23T13:38:51.431Z ERROR Single Cluster Manager Failed to initialise agent port, will retry {"cluster": "uuid-0", "host": "127.0.0.1", "error": "failed to initialize agent: could not ping agent: failed to execute request: Get \"http://127.0.0.1:9092/agent/api/v1/ping\": dial tcp 127.0.0.1:9092: connect: connection refused"}
          cluster_handlers_test.go:796: 
              	Error Trace:	cluster_handlers_test.go:796
              	Error:      	Not equal: 
              	            	expected: &values.CouchbaseCluster{UUID:"uuid-0", Name:"", Alias:"", User:"user", Password:"pass", Enterprise:true, NodesSummary:values.NodesSummary{values.NodeSummary{NodeUUID:"node-0", Version:"7.0.0-0000-enterprise", Host:"https://127.0.0.1:19000", OS:"", Status:"healthy", ClusterMembership:"active", Services:[]string{"kv", "backup"}, SwapUsed:0x0, SwapTotal:0x0, CPUUtil:0, MemTotal:0x0, MemFree:0x0, CPUCount:0, Uptime:""}}, BucketsSummary:values.BucketsSummary{}, ClusterInfo:(*values.ClusterInfo)(0xc0004de1b0), HeartBeatIssue:0x0, LastUpdate:time.Time{wall:0xaa3cd20, ext:63783639531, loc:(*time.Location)(nil)}, CaCert:[]uint8{}, StatusSummary:(*values.ClusterStatusSummary)(nil), StatusProgress:(*values.ClusterProgress)(nil)}
              	            	actual  : &values.CouchbaseCluster{UUID:"uuid-0", Name:"", Alias:"", User:"user", Password:"pass", Enterprise:true, NodesSummary:values.NodesSummary{values.NodeSummary{NodeUUID:"node-0", Version:"7.0.0-0000-enterprise", Host:"https://127.0.0.1:19000", OS:"", Status:"healthy", ClusterMembership:"active", Services:[]string{"kv", "backup"}, SwapUsed:0x0, SwapTotal:0x0, CPUUtil:0, MemTotal:0x0, MemFree:0x0, CPUCount:0, Uptime:""}}, BucketsSummary:values.BucketsSummary{}, ClusterInfo:(*values.ClusterInfo)(0xc0003b2000), HeartBeatIssue:0x2, LastUpdate:time.Time{wall:0xaa3cd20, ext:63783639531, loc:(*time.Location)(nil)}, CaCert:[]uint8{}, StatusSummary:(*values.ClusterStatusSummary)(nil), StatusProgress:(*values.ClusterProgress)(nil)}
              	            	
              	            	Diff:
              	            	--- Expected
              	            	+++ Actual
              	            	@@ -37,3 +37,3 @@
              	            	  }),
              	            	- HeartBeatIssue: (values.HeartIssue) 0,
              	            	+ HeartBeatIssue: (values.HeartIssue) 2,
              	            	  LastUpdate: (time.Time) {
              	Test:       	TestAddNewCluster/OK
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            Unassigned Unassigned
            marks.polakovs Marks Polakovs (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty