Details
Description
In 2i CI runs, the test case TestConcurrentScans_MultipleIndexes is failing due to indexer crash. From indexer log:
2016-03-24T09:33:07.876+05:30 [Info] logReaderStat:: MAINT_STREAM MutationCount 10000
fatal error: unexpected signal during runtime execution
[signal 0xb code=0x1 addr=0x2 pc=0x7fc45967cf14]
runtime stack:
runtime.throw(0x11e7880, 0x2a)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/panic.go:530 +0x90 fp=0x7fc454f5bc50 sp=0x7fc454f5bc38
runtime.sigpanic()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/sigpanic_unix.go:12 +0x5a fp=0x7fc454f5bca0 sp=0x7fc454f5bc50
goroutine 90 [syscall, locked to thread]:
runtime.cgocall(0xc68492, 0xc824291a48, 0x0)
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/cgocall.go:123 +0x11b fp=0xc8242919f8 sp=0xc8242919c8
github.com/couchbase/indexing/secondary/fdb._Cfunc_fdb_set_kv(0x7fc454418dc0, 0xc82689e660, 0x25, 0x0, 0x0, 0x0)
??:0 +0x41 fp=0xc824291a48 sp=0xc8242919f8
github.com/couchbase/indexing/secondary/fdb.(*KVStore).SetKV(0xc82319c720, 0xc82689e660, 0x25, 0x30, 0x0, 0x0, 0x0, 0x0, 0x0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/fdb/kv.go:65 +0x208 fp=0xc824291ad8 sp=0xc824291a48
github.com/couchbase/indexing/secondary/indexer.(*fdbSlice).insertSecIndex(0xc820138c80, 0xc82689e660, 0x25, 0x30, 0xc823f6f8e0, 0x19, 0x19, 0x0, 0x0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/indexer/forestdb_slice_writer.go:464 +0x171a fp=0xc824291ce0 sp=0xc824291ad8
github.com/couchbase/indexing/secondary/indexer.(*fdbSlice).insert(0xc820138c80, 0xc82689e660, 0x25, 0x30, 0xc823f71590, 0xa, 0xa, 0xc823f6f8e0, 0x19, 0x19, ...)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/indexer/forestdb_slice_writer.go:353 +0xeb fp=0xc824291d50 sp=0xc824291ce0
github.com/couchbase/indexing/secondary/indexer.(*fdbSlice).handleCommandsWorker(0xc820138c80, 0x0)
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/indexer/forestdb_slice_writer.go:314 +0x4c6 fp=0xc824291fa0 sp=0xc824291d50
runtime.goexit()
/home/buildbot/.cbdepscache/exploded/x86_64/go-1.6/go/src/runtime/asm_amd64.s:1998 +0x1 fp=0xc824291fa8 sp=0xc824291fa0
created by github.com/couchbase/indexing/secondary/indexer.NewForestDBSlice
/opt/build/goproj/src/github.com/couchbase/indexing/secondary/indexer/forestdb_slice_writer.go:158 +0x190d
This test is failing consistently. Also the last pass was observed on 3/22