Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-28789

panic in indexer during centos longevity test

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 5.5.0
    • 5.5.0
    • secondary-index
    • Centos longevity cluster

    Description

      5.5.0 build 2211

      Seeing the following panic in indexer during centos longevity test 

      2018-03-17T20:30:30.474-07:00 [Warn] Timekeeper::handleStreamBegin Received StreamBegin for Inactive Bucket default Stream MAINT_STREAM. Ignored.
      2018-03-17T20:30:30.499-07:00 [Fatal] MutationStreamReader::panicHandler Received Panic for Stream MAINT_STREAM
      2018-03-17T20:30:30.499-07:00 [Fatal] StreamReader Panic Err runtime error: index out of range
      2018-03-17T20:30:30.500-07:00 [Fatal]   /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/logging/logging.go:304 +0x22
      github.com/couchbase/indexing/secondary/indexer.(*mutationStreamReader).panicHandler(0xc42609a780)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_reader.go:335 +0x1f9
      panic(0xdf6660, 0xc4200160c0)
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/panic.go:458 +0x243
      github.com/couchbase/indexing/secondary/indexer.(*streamWorker).handleSingleKeyVersion(0xc42384dd00, 0xc44cb97c08, 0x7, 0xc4000003de, 0x927f67e6d738, 0xc4e1cca9a0)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_reader.go:618 +0x82e
      github.com/couchbase/indexing/secondary/indexer.(*streamWorker).handleKeyVersions(0xc42384dd00, 0xc44cb97c08, 0x7, 0x3de, 0x927f67e6d738, 0xc44cb97c40, 0x2, 0x2)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_reader.go:557 +0x7d
      github.com/couchbase/indexing/secondary/indexer.(*streamWorker).start(0xc42384dd00)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_reader.go:542 +0x175
      created by github.com/couchbase/indexing/secondary/indexer.CreateMutationStreamReader
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_reader.go:117 +0x684

      And

      2018-03-17T20:30:30.500-07:00 [Error] MutationMgr::listenWorkerMsgs Stream Reader Received for StreamId: MAINT_STREAM, Err: runtime error: index out of range
      2018-03-17T20:30:30.500-07:00 [Fatal] Indexer::handleWorkerMsgs Fatal Error On Worker Channel &{streamId:1 err:{code:9 severity:0 category:4 cause:index out of range msg:}}
      panic: interface conversion: indexer.Message is *indexer.MsgStreamError, not *indexer.MsgError
       
      goroutine 1 [running]:
      panic(0xdfb6e0, 0xc42e2c9dc0)
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/panic.go:500 +0x1a1 fp=0xc42ab4ca80 sp=0xc42ab4c9f0
      runtime.panicdottype(0xe08bc0, 0xe08940, 0xe00300)
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/iface.go:201 +0x11f fp=0xc42ab4cae0 sp=0xc42ab4ca80
      github.com/couchbase/indexing/secondary/indexer.(*indexer).handleWorkerMsgs(0xc4201d3180, 0x179c9c0, 0xc424462db0)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:929 +0x215 fp=0xc42ab4ce08 sp=0xc42ab4cae0
      github.com/couchbase/indexing/secondary/indexer.(*indexer).run(0xc4201d3180)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:636 +0x17b fp=0xc42ab4cf38 sp=0xc42ab4ce08
      github.com/couchbase/indexing/secondary/indexer.NewIndexer(0xc4201744b0, 0x24, 0xc42015bde8, 0x1, 0x1)
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:493 +0x32c2 fp=0xc42ab4dc78 sp=0xc42ab4cf38
      main.main()
              /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/cmd/indexer/main.go:165 +0x12e1 fp=0xc42ab4df38 sp=0xc42ab4dc78
      runtime.main()
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/proc.go:183 +0x1f4 fp=0xc42ab4df90 sp=0xc42ab4df38
      runtime.goexit()
              /home/couchbase/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/asm_amd64.s:2086 +0x1 fp=0xc42ab4df98 sp=0xc42ab4df90
      
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            deepkaran.salooja Deepkaran Salooja
            vikas.chaudhary Vikas Chaudhary
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty