Details
-
Bug
-
Resolution: Fixed
-
Critical
-
7.6.0
-
7.6.0-1616
-
Untriaged
-
0
-
Unknown
Description
- Create a 3KV, 2GSI,N1QL node cluster.
- Create a couchstore bucket, 10 collection, load data.
- Change indexer setting:
curl -k -u 'couchbase-cloud-admin':'nACvCf8P@khY475FYp7ezJ@5' https://svc-qi-node-005.pnkzlblxm4ilxlw5.sandbox.nonprod-project-avengers.com:19102/settings -X POST -d '{"indexer.settings.enable_shard_affinity":true}'OK - Build GSI indexes.
- Do a swap rebalance by changing the disk size from Capella. Index crashed while KV swap rebalance is running:
Starting rebalance, KeepNodes = ['ns_1@svc-d-node-011.pnkzlblxm4ilxlw5.sandbox.nonprod-project-avengers.com','ns_1@svc-d-node-012.pnkzlblxm4ilxlw5.sandbox.nonprod-project-avengers.com','ns_1@svc-d-node-015.pnkzlblxm4ilxlw5.sandbox.nonprod-project-avengers.com','ns_1@svc-qi-node-013.pnkzlblxm4ilxlw5.sandbox.nonprod-project-avengers.com','ns_1@svc-qi-node-014.pnkzlblxm4ilxlw5.sandbox.nonprod-project-avengers.com'], EjectNodes = ['ns_1@svc-d-node-010.pnkzlblxm4ilxlw5.sandbox.nonprod-project-avengers.com'], Failed over and being ejected nodes = []; no delta recovery nodes; Operation Id = f977d5e875308b74907e02366936690c
Service 'index' exited with status 2. Restarting. Messages:
|
2023-10-11T02:16:07.672+00:00 [Info] ShardRebalancer::sendPeerCommand:monitor: command STOP_PEER_SERVER successful for rebalance f681cbd07d91b97784ab78036749abed
|
panic: sync: WaitGroup is reused before previous Wait has returned
|
|
|
goroutine 56755084 [running]:
|
sync.(*WaitGroup).Wait(0xc02b772240?)
|
/home/couchbase/.cbdepscache/exploded/x86_64/go-1.20.8/go/src/sync/waitgroup.go:118 +0x7f
|
github.com/couchbase/indexing/secondary/indexer.(*ShardRebalancer).Cancel(0xc03feda900)
|
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/shard_rebalancer.go:2983 +0x89
|
github.com/couchbase/indexing/secondary/indexer.(*RebalanceServiceManager).cancelPrepareTaskLOCKED(0xc00090e7e0)
|
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/rebalance_service_manager.go:2564 +0xbc
|
github.com/couchbase/indexing/secondary/indexer.(*RebalanceServiceManager).cancelActualTask(0xc00090e7e0, 0xc06f40d950)
|
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/indexing/secondary/indexer/rebalance_service_manager.go:2543 +0x16e
|