Details
-
Bug
-
Resolution: Fixed
-
Critical
-
4.0.0
-
Security Level: Public
-
400-3502 - View Indexes
▪ Machine configuration:
⁃ SSDs
⁃ 24GB Ram
⁃ 250GB /data and /index disks
⁃ 8 Core CPU
⁃ Individual VMs ( non-shared)
▪ Indexer Settings : ( see attached settings.json)
⁃ Index Ram Quota on Index Nodes : 21GB,
⁃ 8 Indexer Threads
⁃ indexer.settings.scan_timeout:1400000 No index settings changed at any point on the test.
▪ 8 Node cluster
⁃ 4 Index nodes,
⁃ 2 Query nodes,
⁃ 4 KV nodes
▪ 10 Buckets
▪ 100 warehouses for tppc(9) buckets and 10M items for default.
▪ 36 GSI indexes across 10 buckets ( 18 active, 18 replica)
400-3502 - View Indexes ▪ Machine configuration: ⁃ SSDs ⁃ 24GB Ram ⁃ 250GB /data and /index disks ⁃ 8 Core CPU ⁃ Individual VMs ( non-shared) ▪ Indexer Settings : ( see attached settings.json) ⁃ Index Ram Quota on Index Nodes : 21GB, ⁃ 8 Indexer Threads ⁃ indexer.settings.scan_timeout:1400000 No index settings changed at any point on the test. ▪ 8 Node cluster ⁃ 4 Index nodes, ⁃ 2 Query nodes, ⁃ 4 KV nodes ▪ 10 Buckets ▪ 100 warehouses for tppc(9) buckets and 10M items for default. ▪ 36 GSI indexes across 10 buckets ( 18 active, 18 replica)
-
Untriaged
-
Unknown
Description
Mutations + Rebalance in/out of query+kv nodes.
1. Keep querying on the system (select, update, delete, inserts)
2. Rebalance out Query node 194
3. Rebalance In Query node 194 as KV+Query service node.
Seeing some crashes like below on existing Query node 195.
panic: runtime error: invalid memory address or nil pointer dereference
|
panic: runtime error: invalid memory address or nil pointer dereference
|
[signal 0xb code=0x1 addr=0x0 pc=0x87bce7]
|
|
|
goroutine 2330812 [running]:
|
github.com/couchbase/go-couchbase.Bucket.getConnPools(0x1, 0xc20819ee88, 0x4, 0xc20808c900, 0x7, 0x9, 0x174e248, 0x0, 0xc20819ee80, 0x7, ...)
|
/home/couchbase/jenkins/workspace/sherlock-unix/godeps/src/github.com/couchbase/go-couchbase/pools.go:251 +0xa7
|
github.com/couchbase/go-couchbase.(*Bucket).UpdateBucket(0xc280f664e0, 0x0, 0x0)
|
/home/couchbase/jenkins/workspace/sherlock-unix/godeps/src/github.com/couchbase/go-couchbase/streaming.go:153 +0xe50
|
github.com/couchbase/go-couchbase.func·021()
|
/home/couchbase/jenkins/workspace/sherlock-unix/godeps/src/github.com/couchbase/go-couchbase/streaming.go:62 +0x3b
|
created by github.com/couchbase/go-couchbase.(*Bucket).RunBucketUpdater
|
/home/couchbase/jenkins/workspace/sherlock-unix/godeps/src/github.com/couchbase/go-couchbase/streaming.go:69 +0xd2
|
|
|
goroutine 1 [chan receive, 331 minutes]:
|
main.signalCatcher(0xc208226000, 0xc20808ca20)
|
/home/couchbase/jenkins/workspace/sherlock-unix/goproj/src/github.com/couchbase/query/server/cbq-engine/main.go:196 +0x1b8
|
main.main()
|
/home/couchbase/jenkins/workspace/sherlock-unix/goproj/src/github.com/couchbase/query/server/cbq-engine/main.go:186 +0x1457
|
|
|
goroutine 5 [syscall, 331 minutes]:
|
os/signal.loop()
|
/usr/local/go/src/os/signal/signal_unix.go:21 +0x1f
|
created by os/signal.init·1
|
/usr/local/go/src/os/signal/signal_unix.go:27 +0x35
|
|
|
goroutine 9 [IO wait, 53 minutes]:
|
net.(*pollDesc).Wait(0xc20800b090, 0x72, 0x0, 0x0)
|
adding query and cluster logs.