Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-41580

[XDCR] panic observed in build sanity

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      Issue observed in 7.0.0-3163

      Testcases:
      ./testrunner -i node_conf.ini -p get-cbcollect-info=True,get-couch-dbinfo=True,skip_cleanup=False -t xdcr.filterXDCR.XDCRFilterTests.test_xdcr_with_filter,items=5000,rdirection=unidirection,ctopology=chain,replication_type=xmem,default@C1=filter_expression:REGEXP_CONTAINS(META()dotidcomma '0$'),skip_key_validation=True

      ./testrunner -i node_conf.ini -p get-cbcollect-info=True,get-couch-dbinfo=True,skip_cleanup=False -t xdcr.uniXDCR.unidirectional.load_with_ops,items=5000,ctopology=chain,rdirection=unidirection,update=C1,delete=C1,java_sdk_client=True

      From goxdcr log:

      2020-09-21T04:23:01.968-07:00 INFO GOXDCR.ReplSpecSvc: ReplicationSpecServiceCallback called on path = /replicationSpec/3fa5a92e01df27aae6c7cbba30c573dd/default/default
      		 
      2020-09-21T04:23:02.027-07:00 WARN GOXDCR.Utils: ExponentialBackoffExecutor for RequestRemoteMonitoring encountered error (unknown remote cluster : uuid - 3fa5a92e01df27aae6c7cbba30c573dd). Sleeping 200ms
      		 
      2020-09-21T04:23:02.228-07:00 WARN GOXDCR.Utils: ExponentialBackoffExecutor for RequestRemoteMonitoring encountered error (unknown remote cluster : uuid - 3fa5a92e01df27aae6c7cbba30c573dd). Sleeping 400ms
      		 
      2020-09-21T04:23:02.628-07:00 WARN GOXDCR.Utils: ExponentialBackoffExecutor for RequestRemoteMonitoring encountered error (unknown remote cluster : uuid - 3fa5a92e01df27aae6c7cbba30c573dd). Sleeping 800ms
      		 
      2020-09-21T04:23:03.428-07:00 WARN GOXDCR.Utils: ExponentialBackoffExecutor for RequestRemoteMonitoring encountered error (unknown remote cluster : uuid - 3fa5a92e01df27aae6c7cbba30c573dd). Sleeping 1.6s
      		 
      panic: Cannot continue without requesting remote monitoring
      		 
       
      		 
      goroutine 197 [running]:
      		 
      github.com/couchbase/goxdcr/metadata_svc.(*ReplicationSpecService).updateCacheInternal(0xc00030c0c0, 0xc0001b81a1, 0x30, 0xc0002f85a0, 0x1, 0x0, 0x0)
      		 
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/metadata_svc/replication_spec_service.go:1132 +0x59b
      		 
      github.com/couchbase/goxdcr/metadata_svc.(*ReplicationSpecService).updateCache(0xc00030c0c0, 0xc0001b81a1, 0x30, 0xc0002f85a0, 0x30, 0xc0001b6740)
      		 
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/metadata_svc/replication_spec_service.go:1091 +0x4e
      		 
      github.com/couchbase/goxdcr/metadata_svc.(*ReplicationSpecService).ReplicationSpecServiceCallback(0xc00030c0c0, 0xc0001b8190, 0x41, 0xc0002c2000, 0x521, 0x522, 0xb85640, 0xc0001b6740, 0xc000303f08, 0x440b6f)
      		 
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/metadata_svc/replication_spec_service.go:1054 +0x305
      		 
      github.com/couchbase/goxdcr/service_def.ReplicationSpecSvc.ReplicationSpecServiceCallback-fm(0xc0001b8190, 0x41, 0xc0002c2000, 0x521, 0x522, 0xb85640, 0xc0001b6740, 0xc000303f68, 0x472e25)
      		 
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/replication_manager/metakv_change_listener.go:147 +0x82
      		 
      github.com/couchbase/goxdcr/replication_manager.(*MetakvChangeListener).metakvCallback_async(0xc0001a1a40, 0xc0001b8190, 0x41, 0xc0002c2000, 0x521, 0x522, 0xb85640, 0xc0001b6740)
      		 
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/replication_manager/metakv_change_listener.go:98 +0x9a
      		 
      created by github.com/couchbase/goxdcr/replication_manager.(*MetakvChangeListener).metakvCallback
      		 
      	/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/replication_manager/metakv_change_listener.go:91 +0x19a
      		 
      2020-09-21T04:23:05.291-07:00 INFO GOXDCR.ReplMgr: GOMAXPROCS=4
      		 
      2020-09-21T04:23:05.298-07:00 INFO GOXDCR.AuditSvc: Created audit service.
      		 
      2020-09-21T04:23:05.298-07:00 INFO GOXDCR.UILogSvc: Created ui log service.
      		 
      2020-09-21T04:23:05.849-07:00 INFO GOXDCR.RemClusterSvc: Agent remoteCluster/c_2jTqr3mToElpPOGM7CRMYor9nfepXA5D8sHjZbWh4= remote_cluster_C1-C2 started for cluster: 3fa5a92e01df27aae6c7cbba30c573dd synchronously? false
      		 
      2020-09-21T04:23:05.850-07:00 INFO GOXDCR.ReplSpecSvc: Cache has been initialized for ReplicationSpecService

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. MB-41318 [XDCR] panic: Cannot continue without requesting remote monitoring

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. MB-42628 [XDCR] Intermittent panic: Cannot continue without requesting remote monitoring

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              neil.huang Neil Huang
              arunkumar Arunkumar Senthilnathan (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty