Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-48245

CE: fetchClient err: gocbcore_utils: fetchClient (1), setup err: agent setup failed, err: unambiguous timeout

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      Build: 7.0.2-6611 - Community Edition

      • 4 node cluster with kv,fts,index,query services
      • Load default bucket with 30000 docs
      • Create a FTS index
      • FTS index created but no pindexes created

      From the logs of 172.23.97.212, we see below errors:

      2021-08-30T23:09:40.823-07:00 [WARN] ns_server: retrieve partition seqs: CBPartitionSeqs, fetchClient err: gocbcore_utils: fetchClient (1), setup err: agent setup failed, err: unambiguous timeout | {"InnerError":{"InnerError":{"InnerError":{},"Message":"unambiguous timeout"}},"OperationID":"WaitUntilReady","Opaque":"","TimeObserved":10000114597,"RetryReasons":["NOT_READY"],"RetryAttempts":15,"LastDispatchedTo":"","LastDispatchedFrom":"","LastConnectionID":""} -- cbft.RunSourcePartitionSeqs() at ns_server.go:1115
      		 
      2021-08-30T23:10:00.824-07:00 [INFO] (GOCBCORE) SDK Version: gocbcore/v9.1.6
      		 
      2021-08-30T23:10:00.824-07:00 [INFO] (GOCBCORE) Creating new agent: &{MemdAddrs:[] HTTPAddrs:[127.0.0.1:8091] BucketName:default UserAgent:stats UseTLS:true NetworkType:default Auth:0x1d76e00 TLSRootCAProvider:0xa70360 InitialBootstrapNonTLS:true UseMutationTokens:false UseCompression:false UseDurations:false DisableDecompression:false UseOutOfOrderResponses:false DisableXErrors:false DisableJSONHello:false DisableSyncReplicationHello:false UseCollections:true CompressionMinSize:0 CompressionMinRatio:0 HTTPRedialPeriod:0s HTTPRetryDelay:0s HTTPMaxWait:0s CccpMaxWait:0s CccpPollPeriod:0s ConnectTimeout:1m0s KVConnectTimeout:7s KvPoolSize:0 MaxQueueSize:0 HTTPMaxIdleConns:0 HTTPMaxIdleConnsPerHost:0 HTTPIdleConnectionTimeout:0s Tracer:<nil> NoRootTraceSpans:false DefaultRetryStrategy:<nil> CircuitBreakerConfig:{Enabled:false VolumeThreshold:0 ErrorThresholdPercentage:0 SleepWindow:0s RollingWindow:0s CompletionCallback:<nil> CanaryTimeout:0s} UseZombieLogger:false ZombieLoggerInterval:0s ZombieLoggerSampleSize:0 AuthMechanisms:[]}
      		 
      2021-08-30T23:10:00.824-07:00 [INFO] (GOCBCORE) CCCPPOLL: No nodes available to poll, return upstream
      		 
      2021-08-30T23:10:10.824-07:00 [WARN] ns_server: retrieve partition seqs: CBPartitionSeqs, fetchClient err: gocbcore_utils: fetchClient (1), setup err: agent setup failed, err: unambiguous timeout | {"InnerError":{"InnerError":{"InnerError":{},"Message":"unambiguous timeout"}},"OperationID":"WaitUntilReady","Opaque":"","TimeObserved":10000153060,"RetryReasons":["NOT_READY"],"RetryAttempts":15,"LastDispatchedTo":"","LastDispatchedFrom":"","LastConnectionID":""} -- cbft.RunSourcePartitionSeqs() at ns_server.go:1115
      		 
      2021-08-30T23:10:30.825-07:00 [INFO] (GOCBCORE) SDK Version: gocbcore/v9.1.6
      		 
      2021-08-30T23:10:30.825-07:00 [INFO] (GOCBCORE) Creating new agent: &{MemdAddrs:[] HTTPAddrs:[127.0.0.1:8091] BucketName:default UserAgent:stats UseTLS:true NetworkType:default Auth:0x1d76e00 TLSRootCAProvider:0xa70360 InitialBootstrapNonTLS:true UseMutationTokens:false UseCompression:false UseDurations:false DisableDecompression:false UseOutOfOrderResponses:false DisableXErrors:false DisableJSONHello:false DisableSyncReplicationHello:false UseCollections:true CompressionMinSize:0 CompressionMinRatio:0 HTTPRedialPeriod:0s HTTPRetryDelay:0s HTTPMaxWait:0s CccpMaxWait:0s CccpPollPeriod:0s ConnectTimeout:1m0s KVConnectTimeout:7s KvPoolSize:0 MaxQueueSize:0 HTTPMaxIdleConns:0 HTTPMaxIdleConnsPerHost:0 HTTPIdleConnectionTimeout:0s Tracer:<nil> NoRootTraceSpans:false DefaultRetryStrategy:<nil> CircuitBreakerConfig:{Enabled:false VolumeThreshold:0 ErrorThresholdPercentage:0 SleepWindow:0s RollingWindow:0s CompletionCallback:<nil> CanaryTimeout:0s} UseZombieLogger:false ZombieLoggerInterval:0s ZombieLoggerSampleSize:0 AuthMechanisms:[]}
      		 
      2021-08-30T23:10:30.825-07:00 [INFO] (GOCBCORE) CCCPPOLL: No nodes available to poll, return upstream
      		 
      2021-08-30T23:10:40.825-07:00 [WARN] ns_server: retrieve partition seqs: CBPartitionSeqs, fetchClient err: gocbcore_utils: fetchClient (1), setup err: agent setup failed, err: unambiguous timeout | {"InnerError":{"InnerError":{"InnerError":{},"Message":"unambiguous timeout"}},"OperationID":"WaitUntilReady","Opaque":"","TimeObserved":10000115653,"RetryReasons":["NOT_READY"],"RetryAttempts":15,"LastDispatchedTo":"","LastDispatchedFrom":"","LastConnectionID":""} -- cbft.RunSourcePartitionSeqs() at ns_server.go:1115
      		 
      2

      https://cb-jira.s3.us-east-2.amazonaws.com/logs/test/collectinfo-2021-08-31T060349-ns_1%40172.23.120.174.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/test/collectinfo-2021-08-31T060349-ns_1%40172.23.96.141.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/test/collectinfo-2021-08-31T060349-ns_1%40172.23.97.211.zip
      https://cb-jira.s3.us-east-2.amazonaws.com/logs/test/collectinfo-2021-08-31T060349-ns_1%40172.23.97.212.zip

      Attachments

        For Gerrit Dashboard: MB-48245
        # Subject Branch Project Status CR V
        160525,5 MB-48245: UseTLS for gocbcore Agents/DCPAgents only when able cheshire-cat cbgt Status: MERGED +2 +1
        160544,1 Merge remote-tracking branch 'couchbase/cheshire-cat' master cbgt Status: MERGED +2 +1

        Activity

          People

            girish.benakappa Girish Benakappa
            girish.benakappa Girish Benakappa
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty