Details
-
Bug
-
Resolution: Duplicate
-
Critical
-
4.0.0
-
Security Level: Public
-
400-2093
-
Untriaged
-
Unknown
Description
I have created a cluster w/ KV only nodes ( attached screenshot for service description)
On a cluster reboot, I noticed the Projector process restarted w/ a core-dump.
No other process exhibited likewise restart.
PID TID MINFLT MAJFLT VSTEXT VSLIBS VDATA VSTACK VSIZE RSIZE VGROW RGROW SWAPSZ RUID EUID MEM CMD 1/14
1431 - 492626 28 332K 19144K 1.7G 88K 1.8G 1.5G 1.8G 1.5G 0K couchbas couchbas 7% memcached
1205 - 669027 2 2200K 4412K 1.9G 96K 1.9G 261.1M 1.9G 261.1M 0K couchbas couchbas 1% beam.smp
1263 - 277310 70 2200K 15548K 2.1G 100K 2.2G 114.3M 2.2G 114.3M 0K couchbas couchbas 0% beam.smp
1112 - 42025 1 2200K 2480K 1.2G 88K 1.3G 35208K 1.3G 35208K 0K couchbas couchbas 0% beam.smp
1196 - 11784 0 4K 8480K 41228K 280K 125.2M 33816K 125.2M 33816K 0K root root 0% chef-client
1372 - 9906 0 2200K 4372K 929.7M 92K 958.7M 28588K 958.7M 28588K 0K couchbas couchbas 0% beam.smp
1488 - 1715 2 3992K 1796K 202.1M 88K 216.5M 6620K 216.5M 6620K 0K couchbas couchbas 0% goxdcr
1501 - 1679 4 13028K 1796K 192.1M 88K 210.9M 6520K 210.9M 6520K 0K couchbas couchbas 0% projector
Also, output from projector shows a panic w/ cbq-engine connection - Wondering why does it try this when there is no Query component associated w/ any node on the cluster.
2015/05/20 11:16:14 revrpc: Got error (dial tcp 127.0.0.1:8091: connection refused) and will retry in 1s
panic: Post http://127.0.0.1:8091/_metakv: CBAuth database is stale: last reason: dial tcp 127.0.0.1:8091: connection refused
goroutine 1 [running]:
runtime.gopanic(0xad14e0, 0xc20807d020)
/usr/local/go/src/runtime/panic.go:425 +0x2a3 fp=0xc2080d5ba0 sp=0xc2080d5b38
github.com/couchbase/indexing/secondary/common.CrashOnError(0x7fb73fa66120, 0xc20807d020)
/home/couchbase/jenkins/workspace/sherlock-unix/goproj/src/github.com/couchbase/indexing/secondary/common/util.go:352 +0x50 fp=0xc2080d5bc8 sp=0xc2080d5ba0
github.com/couchbase/indexing/secondary/projector.NewProjector(0x400, 0xc20807cea0, 0xc2080d5f50)
/home/couchbase/jenkins/workspace/sherlock-unix/goproj/src/github.com/couchbase/indexing/secondary/projector/projector.go:49 +0x16e fp=0xc2080d5e80 sp=0xc2080d5bc8
main.main()
/home/couchbase/jenkins/workspace/sherlock-unix/goproj/src/github.com/couchbase/indexing/secondary/cmd/projector/main.go:95 +0x848 fp=0xc2080d5f98 sp=0xc2080d5e80
runtime.main()
/usr/local/go/src/runtime/proc.go:63 +0xf3 fp=0xc2080d5fe0 sp=0xc2080d5f98
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:2232 +0x1 fp=0xc2080d5fe8 sp=0xc2080d5fe0
goroutine 2 [force gc (idle)]:
runtime.gopark(0x439310, 0x12ea2c0, 0xc50b10, 0xf)
/usr/local/go/src/runtime/proc.go:130 +0x105 fp=0xc20801a798 sp=0xc20801a768
Attaching logs.