Details
-
Bug
-
Resolution: Not a Bug
-
Major
-
None
-
7.2.0
-
Enterprise Edition 7.2.0 build 5263
-
Untriaged
-
0
-
No
-
Analytics Sprint 16
Description
Script to Repro
./sequoia -client 172.23.104.27:2375 -provider file:centos_pine.yml -test tests/integration/7.2/test_7.2.yml -scope tests/integration/7.2/scope_7.2_magma.yml -scale 3 -repeat 0 -log_level 0 -version 7.2.0-5263 -skip_setup=false -skip_test=false -skip_teardown=true -skip_cleanup=false -continue=false -collect_on_error=false -stop_on_error=false -duration=604800 -show_topology=true
|
After running longevity test on 7.2 with CDC enabled buckets saw the following FATAL messages in analytics.log
172.23.99.11 : analytics
2023-03-20T06:21:22.728-07:00 FATA CBAS.nc.CcConnection [Executor-176:56606bb578635385629c0926b9e46616] Registering with ClusterControllerRemoteProxy [/172.23.106.188:9112] failed with exception
|
2023-03-20T06:21:22.731-07:00 FATA CBAS.util.ExitUtil [Executor-176:56606bb578635385629c0926b9e46616] JVM halting with status 15 (halting thread Thread[Executor-176:56606bb578635385629c0926b9e46616,10,main], interrupted false)
|
2023-03-20T06:21:23.081-07:00 FATA CBAS.util.ExitUtil [pool-2-thread-1] Thread dump at halt:
|
Full trace
2023-03-20T06:21:22.728-07:00 FATA CBAS.nc.CcConnection [Executor-176:56606bb578635385629c0926b9e46616] Registering with ClusterControllerRemoteProxy [/172.23.106.188:9112] failed with exception
|
org.apache.hyracks.api.exceptions.HyracksException: HYR0010: Node 56606bb578635385629c0926b9e46616 does not exist
|
at org.apache.hyracks.api.exceptions.HyracksException.create(HyracksException.java:58) ~[hyracks-api-7.2.0-5263.jar:7.2.0-5263]
|
at org.apache.hyracks.control.cc.cluster.NodeManager.addNode(NodeManager.java:106) ~[hyracks-control-cc-7.2.0-5263.jar:7.2.0-5263]
|
at org.apache.hyracks.control.cc.work.RegisterNodeWork.doRun(RegisterNodeWork.java:64) ~[hyracks-control-cc-7.2.0-5263.jar:7.2.0-5263]
|
at org.apache.hyracks.control.common.work.SynchronizableWork.run(SynchronizableWork.java:43) ~[hyracks-control-common-7.2.0-5263.jar:7.2.0-5263]
|
at org.apache.hyracks.control.common.work.WorkQueue$WorkerThread.run(WorkQueue.java:127) ~[hyracks-control-common-7.2.0-5263.jar:7.2.0-5263]
|
2023-03-20T06:21:22.731-07:00 FATA CBAS.util.ExitUtil [Executor-176:56606bb578635385629c0926b9e46616] JVM halting with status 15 (halting thread Thread[Executor-176:56606bb578635385629c0926b9e46616,10,main], interrupted false)
|
2023-03-20T06:21:23.081-07:00 FATA CBAS.util.ExitUtil [pool-2-thread-1] Thread dump at halt:
|
"main" [tid=1 state=WAITING lock=java.util.concurrent.Semaphore$NonfairSync@344e1350]
|
at java.base@11.0.18/jdk.internal.misc.Unsafe.park(Native Method)
|
at java.base@11.0.18/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
|
at java.base@11.0.18/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
|
at java.base@11.0.18/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
|
at java.base@11.0.18/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
|
at java.base@11.0.18/java.util.concurrent.Semaphore.acquire(Semaphore.java:318)
|
at app//com.couchbase.analytics.control.AnalyticsDriver.main(AnalyticsDriver.java:99)
|
cbcollect_info attached.