Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-53207

[BP to 6.6.6 of MB-47655] feed gen-server crashed: runtime error: invalid memory address or nil pointer dereference

    XMLWordPrintable

Details

    • Untriaged
    • Centos 64-bit
    • 1
    • No

    Description

      Steps to reproduce:

      1. Create a 6 node cluster 3KV-2index-1query.
      2. Create about 7 buckets and indexes with replica.
      3. Load the docs until all of the buckets have data greater than memory.
      4. Kill memcached (by kill -9) and check that 1 KV node auto fails over.
      5. Do a full recovery and rebalance.

      Honestly I don't know which of these steps I was doing at the point of the panic as I only found out about it from the log_parser run that Pavan PB had started.

      172.23.100.34

      2022-08-01T05:39:40.858-07:00 [Error] FEED[<=>MAINT_STREAM_TOPIC_eb12e1aeafb2cb873a3497fa53119e82(127.0.0.1:8091)] feed gen-server crashed: runtime error: invalid memory address or nil pointer dereference
      2022-08-01T05:39:40.858-07:00 [Error]   /home/couchbase/jenkins/workspace/toy-unix/goproj/src/github.com/couchbase/indexing/secondary/logging/logging.go:312 +0x22
      github.com/couchbase/indexing/secondary/projector.(*Feed).genServer.func1(0xc00168ac00)
              /home/couchbase/jenkins/workspace/toy-unix/goproj/src/github.com/couchbase/indexing/secondary/projector/feed.go:484 +0x124
      panic(0xbea400, 0x16e01d0)
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.13.7/go/src/runtime/panic.go:679 +0x1b2
      github.com/couchbase/indexing/secondary/dcp.queryRestAPIOnLocalhost(0x0, 0xc037f7a387, 0x5, 0x0, 0x0, 0xcb3ba0, 0xc0497a8000, 0xc0007acf98, 0x0, 0x0)
              /home/couchbase/jenkins/workspace/toy-unix/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:315 +0x86
      github.com/couchbase/indexing/secondary/dcp.(*Client).parseURLResponse(...)
              /home/couchbase/jenkins/workspace/toy-unix/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:444
      github.com/couchbase/indexing/secondary/dcp.(*Pool).getTerseBucket(0xc000430568, 0xc037f7a387, 0x5, 0x7f6da307a460, 0x0, 0x4f77796741667a6e, 0x3035693163707048)
              /home/couchbase/jenkins/workspace/toy-unix/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:585 +0x14c
      github.com/couchbase/indexing/secondary/dcp.(*Pool).RefreshBucket(0xc000430568, 0xc037f7a387, 0x5, 0x7f6da307a400, 0x0, 0x30)
              /home/couchbase/jenkins/workspace/toy-unix/goproj/src/github.com/couchbase/indexing/secondary/dcp/pools.go:605 +0x147
      github.com/couchbase/indexing/secondary/common.(*ClusterInfoCache).FetchBucketInfo(0xc000430480, 0xc037f7a387, 0x5, 0x0, 0x0)
              /home/couchbase/jenkins/workspace/toy-unix/goproj/src/github.com/couchbase/indexing/secondary/common/cluster_info.go:385 +0x9f
      github.com/couchbase/indexing/secondary/projector.(*Feed).getLocalVbuckets(0xc00168ac00, 0xc037f7a380, 0x7, 0xc037f7a387, 0x5, 0x51, 0x0, 0x0, 0x0, 0x0, ...)
              /home/couchbase/jenkins/workspace/toy-unix/goproj/src/github.com/couchbase/indexing/secondary/projector/feed.go:1666 +0xad
      github.com/couchbase/indexing/secondary/projector.(*Feed).shutdownVbuckets(0xc00168ac00, 0xc042789500, 0xc038030051, 0xc0007ad630, 0x4174f3)
              /home/couchbase/jenkins/workspace/toy-unix/goproj/src/github.com/couchbase/indexing/secondary/projector/feed.go:1071 +0x124
      github.com/couchbase/indexing/secondary/projector.(*Feed).handleCommand(0xc00168ac00, 0xc042789f80, 0x4, 0x4, 0xcfd101, 0x2)
              /home/couchbase/jenkins/workspace/toy-unix/goproj/src/github.com/couchbase/indexing/secondary/projector/feed.go:706 +0x1792
      github.com/couchbase/indexing/secondary/projector.(*Feed).genServer(0xc00168ac00)
              /home/couchbase/jenkins/workspace/toy-unix/goproj/src/github.com/couchbase/indexing/secondary/projector/feed.go:503 +0x2437
      created by github.com/couchbase/indexing/secondary/projector.NewFeed
              /home/couchbase/jenkins/workspace/toy-unix/goproj/src/github.com/couchbase/indexing/secondary/projector/feed.go:134 +0x72c
      

      cbcollect_info attached.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              sai.teja Sai Krishna Teja
              Balakumaran.Gopal Balakumaran Gopal
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty