Details
-
Bug
-
Resolution: Fixed
-
Critical
-
5.5.0
-
Centos longevity cluster
-
Untriaged
-
-
Unknown
Description
5.5.0 build 2211
Seeing the following panic in indexer during centos longevity test
2018-03-17T20:30:30.474-07:00 [Warn] Timekeeper::handleStreamBegin Received StreamBegin for Inactive Bucket default Stream MAINT_STREAM. Ignored. |
2018-03-17T20:30:30.499-07:00 [Fatal] MutationStreamReader::panicHandler Received Panic for Stream MAINT_STREAM |
2018-03-17T20:30:30.499-07:00 [Fatal] StreamReader Panic Err runtime error: index out of range |
2018-03-17T20:30:30.500-07:00 [Fatal] /home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/logging/logging.go:304 +0x22 |
github.com/couchbase/indexing/secondary/indexer.(*mutationStreamReader).panicHandler(0xc42609a780) |
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_reader.go:335 +0x1f9 |
panic(0xdf6660, 0xc4200160c0) |
/home/couchbase/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/panic.go:458 +0x243 |
github.com/couchbase/indexing/secondary/indexer.(*streamWorker).handleSingleKeyVersion(0xc42384dd00, 0xc44cb97c08, 0x7, 0xc4000003de, 0x927f67e6d738, 0xc4e1cca9a0) |
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_reader.go:618 +0x82e |
github.com/couchbase/indexing/secondary/indexer.(*streamWorker).handleKeyVersions(0xc42384dd00, 0xc44cb97c08, 0x7, 0x3de, 0x927f67e6d738, 0xc44cb97c40, 0x2, 0x2) |
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_reader.go:557 +0x7d |
github.com/couchbase/indexing/secondary/indexer.(*streamWorker).start(0xc42384dd00) |
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_reader.go:542 +0x175 |
created by github.com/couchbase/indexing/secondary/indexer.CreateMutationStreamReader
|
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/stream_reader.go:117 +0x684 |
And
2018-03-17T20:30:30.500-07:00 [Error] MutationMgr::listenWorkerMsgs Stream Reader Received for StreamId: MAINT_STREAM, Err: runtime error: index out of range |
2018-03-17T20:30:30.500-07:00 [Fatal] Indexer::handleWorkerMsgs Fatal Error On Worker Channel &{streamId:1 err:{code:9 severity:0 category:4 cause:index out of range msg:}} |
panic: interface conversion: indexer.Message is *indexer.MsgStreamError, not *indexer.MsgError |
|
goroutine 1 [running]: |
panic(0xdfb6e0, 0xc42e2c9dc0) |
/home/couchbase/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/panic.go:500 +0x1a1 fp=0xc42ab4ca80 sp=0xc42ab4c9f0 |
runtime.panicdottype(0xe08bc0, 0xe08940, 0xe00300) |
/home/couchbase/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/iface.go:201 +0x11f fp=0xc42ab4cae0 sp=0xc42ab4ca80 |
github.com/couchbase/indexing/secondary/indexer.(*indexer).handleWorkerMsgs(0xc4201d3180, 0x179c9c0, 0xc424462db0) |
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:929 +0x215 fp=0xc42ab4ce08 sp=0xc42ab4cae0 |
github.com/couchbase/indexing/secondary/indexer.(*indexer).run(0xc4201d3180) |
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:636 +0x17b fp=0xc42ab4cf38 sp=0xc42ab4ce08 |
github.com/couchbase/indexing/secondary/indexer.NewIndexer(0xc4201744b0, 0x24, 0xc42015bde8, 0x1, 0x1) |
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/indexer.go:493 +0x32c2 fp=0xc42ab4dc78 sp=0xc42ab4cf38 |
main.main()
|
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/cmd/indexer/main.go:165 +0x12e1 fp=0xc42ab4df38 sp=0xc42ab4dc78 |
runtime.main()
|
/home/couchbase/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/proc.go:183 +0x1f4 fp=0xc42ab4df90 sp=0xc42ab4df38 |
runtime.goexit()
|
/home/couchbase/.cbdepscache/exploded/x86_64/go-1.7.6/go/src/runtime/asm_amd64.s:2086 +0x1 fp=0xc42ab4df98 sp=0xc42ab4df90 |
|