Details
-
Bug
-
Resolution: Not a Bug
-
Critical
-
7.2.0
-
7.2.0-5268
-
Untriaged
-
Centos 64-bit
-
-
0
-
Unknown
Description
Steps:
- Create a 2 KV and 1 index/query node cluster.
- Create a magma bucket(replicas=1) and collections(total collection count including default collections is 51)
- Create 500000000 items sequentially(After creation of few thousands of documents update bucket_history_retention_seconds=259200,bucket_history_retention_bytes=10000000000000)
- Update 500000000 created in above step
- Create 500000000 items sequentially
- Update 500000000 created in above step
- Create five indexes Wait for index building.
- Rebalance in KV with Loading of docs. (Rebalance completed successfully)
- Rebalance Out KV with Loading of docs.(Rebalance completed successfully)
- Rebalance In_Out KV with Loading of docs. (Rebalance completed successfully)
- Swap KV node with Loading of docs.
- Rebalance exited with reason {service_rebalance_failed,index, {agent_died,<34339.6088.0> (MB-56170)
- System was in idle state for more than 24 hours
- And observed Service 'n1ql' exited with status 2
Note:
Cluster is still in same state
http://172.23.110.64:8091/ui/index.html#/servers/list?commonBucket=GleamBookUsers0&scenarioZoom=minute&scenario=6fitqfa3g (Will keep this in the same state until March 30 2023, 8:30 AM IST, Please let me know if it is required for more duration)
Found on node 172.23.110.67
ERROR:
Service 'n1ql' exited with status 2. Restarting. Messages:
|
2023-03-29T06:52:55.294-07:00 [WARN] Keyspace GleamBookUsers0 not configured on this server
|
2023-03-29T06:52:55.295-07:00 [WARN] Keyspace GleamBookUsers0 not configured on this server
|
panic: runtime error: invalid memory address or nil pointer dereference
|
[signal SIGSEGV: segmentation violation code=0x1 addr=0x19 pc=0x1701041]
|
|
|
goroutine 824368 [running]:
|
github.com/couchbase/query/primitives/couchbase.(*Bucket).UpdateBucket2(0xc0044d4480, 0xc00958fd00)
|
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/primitives/couchbase/streaming.go:338 +0x1061
|
github.com/couchbase/query/primitives/couchbase.(*Bucket).RunBucketUpdater2.func1()
|
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/primitives/couchbase/streaming.go:206 +0x33
|
created by github.com/couchbase/query/primitives/couchbase.(*Bucket).RunBucketUpdater2
|
/home/couchbase/jenkins/workspace/couchbase-server-unix/goproj/src/github.com/couchbase/query/primitives/couchbase/streaming.go:205 +0xf8
|
QE-TEST:
guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/ankush_temp_job3.ini -p bucket_storage=magma,bucket_eviction_policy=fullEviction,rerun=False -t aGoodDoctor.Hospital.Murphy.ClusterOpsVolume,nodes_init=2,graceful=True,skip_cleanup=True,num_items=50000000,num_buckets=1,bucket_names=GleamBook,doc_size=1024,bucket_type=membase,eviction_policy=fullEviction,iterations=5,batch_size=1000,sdk_timeout=60,log_level=info,infra_log_level=error,rerun=False,skip_cleanup=True,key_size=18,randomize_doc_size=False,randomize_value=True,assert_crashes_on_load=True,num_collections=50,maxttl=10,num_indexes=5,pc=10,index_nodes=1,cbas_nodes=0,fts_nodes=0,ops_rate=200000,ramQuota=102400,doc_ops=create:update:delete:read,mutation_perc=100,rebl_ops_rate=30000,key_type=RandomKey -m rest'
|