Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-49407

[System Test][XDCR] goxdcr keeps crashing with panic in FetchLatestReplicationsInfo

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 7.1.0
    • 7.1.0
    • XDCR
    • Untriaged
    • 1
    • No

    Description

      I started two longevity runs on nov 5, one with weekly build 7.1.0-1650 and other with 7.1.0-1653 that has the debug messages for MB-48884 - goxdcr constantly keeps crashing in both with the following panic:

      Service 'goxdcr' exited with status 2. Restarting. Messages:
      2021-11-07T12:34:12.514-08:00 INFO GOXDCR.StatsMgr: 2efd4229cbfacfbf3d171c718d20e5f4/bucket4/bucket4 total_docs=3267688, docs_processed=3267627, changes_left=61
      panic: runtime error: invalid memory address or nil pointer dereference
      [signal SIGSEGV: segmentation violation code=0x1 addr=0x18 pc=0x91b3a8]

      goroutine 1737 [running]:
      github.com/couchbase/goxdcr/peerToPeer.(*ReplicatorAgentImpl).FetchLatestReplicationsInfo(0xc0033c63c0, 0xc007476600, 0x0, 0x0)
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/peerToPeer/replicaReplicator.go:444 +0x68
      github.com/couchbase/goxdcr/peerToPeer.(*ReplicatorAgentImpl).run(0xc0033c63c0)
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/peerToPeer/replicaReplicator.go:427 +0x29b
      created by github.com/couchbase/goxdcr/peerToPeer.(*ReplicatorAgentImpl).Start.func1
      /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/goxdcr/peerToPeer/replicaReplicator.go:368 +0x3e

      Logs:
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.106.134.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.120.58.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.120.73.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.120.74.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.120.75.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.120.77.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.120.86.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.121.77.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.123.24.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.123.25.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.123.26.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.123.31.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.123.32.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.123.33.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.96.122.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.96.14.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.96.243.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.96.254.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.96.48.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.97.105.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.97.110.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.97.112.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.97.148.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.97.150.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.97.151.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.97.241.zip
      url : https://cb-jira.s3.us-east-2.amazonaws.com/logs/systestmon-1636311442/collectinfo-2021-11-07T185724-ns_1%40172.23.97.74.zip

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              arunkumar Arunkumar Senthilnathan (Inactive)
              arunkumar Arunkumar Senthilnathan (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty