Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-15962

GoXDCR: Panic from /goxdcr/pipeline.(*ReplicationStatus).Storage

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 4.0.0
    • 4.0.0
    • XDCR
    • Security Level: Public
    • None
    • Untriaged
    • Centos 64-bit
    • Unknown

    Description

      Build


      4.0.0-4019 RC2 build

      Is not consistently reproducible. After deletion of replications, deletion of remote cluster reference fails.

      [2015-08-04 20:27:15,276] - [xdcrnewbasetests:2325] INFO - ====  XDCRNewbasetests cleanup is started for test #8 replication_with_pause_and_resume ====
      [2015-08-04 20:27:15,276] - [xdcrnewbasetests:1085] INFO - removing xdcr/nodes settings
      [2015-08-04 20:27:15,300] - [rest_client:921] INFO - Deleting replication /controller/cancelXDCR/73c8d76313bcba9cd24e400767cb95af%2Fdefault%2Fdefault
      [2015-08-04 20:27:15,321] - [rest_client:921] INFO - Deleting replication /controller/cancelXDCR/73c8d76313bcba9cd24e400767cb95af%2Fsasl_bucket_1%2Fsasl_bucket_1
      [2015-08-04 20:27:15,348] - [rest_client:921] INFO - Deleting replication /controller/cancelXDCR/73c8d76313bcba9cd24e400767cb95af%2Fstandard_bucket_1%2Fstandard_bucket_1
      [2015-08-04 20:27:15,413] - [rest_client:869] INFO - removing remote cluster name:remote_cluster_C1-C2
      [2015-08-04 20:27:24,005] - [rest_client:731] ERROR - http://172.23.105.3:8091/pools/default/remoteClusters/remote_cluster_C1-C2? error 500 reason: unknown ["Unexpected server error, request logged."]
      [2015-08-04 20:27:24,006] - [rest_client:875] ERROR - failed to remove remote cluster: status:False,content:["Unexpected server error, request logged."]
      

      On .3, I see panic soon after deletion of replication on standard bucket

       
      CheckpointService 2015-08-04T20:20:00.640-07:00 [INFO] DelCheckpointsDocs is done for 73c8d76313bcba9cd24e400767cb95af/default/default
      ConnPoolMgr 2015-08-04T20:20:00.640-07:00 [INFO] Pool 73c8d76313bcba9cd24e400767cb95af/default/default/Couch_Xmem_172.23.105.20:11210/default is removed, all connections are released
      PipelineManager 2015-08-04T20:20:00.674-07:00 [ERROR] Invalid replication status 73c8d76313bcba9cd24e400767cb95af/standard_bucket_1/standard_bucket_1, failed to retrieve spec. err=Requested resource not found
      PipelineManager 2015-08-04T20:20:00.674-07:00 [ERROR] Invalid replication status 73c8d76313bcba9cd24e400767cb95af/standard_bucket_1/standard_bucket_1, failed to retrieve spec. err=Requested resource not found
      ReplicationManager 2015-08-04T20:20:00.674-07:00 [INFO] replication 73c8d76313bcba9cd24e400767cb95af/standard_bucket_1/standard_bucket_1 has been deleted, skip updating stats
      panic: runtime error: invalid memory address or nil pointer dereference
      [signal 0xb code=0x1 addr=0x0 pc=0x65455a]
       
      goroutine 42 [running]:
      github.com/couchbase/goxdcr/pipeline.(*ReplicationStatus).Storage(0x0, 0x30)
      	/home/couchbase/jenkins/workspace/sherlock-unix/goproj/src/github.com/couchbase/goxdcr/pipeline/ReplicationStatus.go:167 +0x19a
      github.com/couchbase/goxdcr/pipeline.(*ReplicationStatus).GetStats(0x0, 0x9e46f0, 0x8, 0xc208134070)
      	/home/couchbase/jenkins/workspace/sherlock-unix/goproj/src/github.com/couchbase/goxdcr/pipeline/ReplicationStatus.go:179 +0x28
      github.com/couchbase/goxdcr/pipeline.(*ReplicationStatus).GetOverviewStats(0x0, 0x30)
      	/home/couchbase/jenkins/workspace/sherlock-unix/goproj/src/github.com/couchbase/goxdcr/pipeline/ReplicationStatus.go:191 +0x40
      github.com/couchbase/goxdcr/pipeline_svc.UpdateStats(0x7f2ee28b9850, 0xc20803a0f0, 0x7f2ee28b98a0, 0xc20801f440, 0x7f2ee28bb068, 0xc20812c2a0, 0xc20802b380)
      	/home/couchbase/jenkins/workspace/sherlock-unix/goproj/src/github.com/couchbase/goxdcr/pipeline_svc/statistics_manager.go:1134 +0x100
      github.com/couchbase/goxdcr/replication_manager.(*replicationManager).checkReplicationStatus(0xeaf000, 0xc208134700)
      	/home/couchbase/jenkins/workspace/sherlock-unix/goproj/src/github.com/couchbase/goxdcr/replication_manager/replication_manager.go:211 +0x1fe
      created by github.com/couchbase/goxdcr/replication_manager.func·001
      	/home/couchbase/jenkins/workspace/sherlock-unix/goproj/src/github.com/couchbase/goxdcr/replication_manager/replication_manager.go:137 +0x287
       
      goroutine 1 [chan receive, 197 minutes]:
      main.main()
      	/home/couchbase/jenkins/workspace/sherlock-unix/goproj/src/github.com/couchbase/goxdcr/main/main.go:142 +0x14c8
      

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              apiravi Aruna Piravi (Inactive)
              apiravi Aruna Piravi (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty