Details
-
Bug
-
Resolution: Duplicate
-
Critical
-
Columnar 1.0.0
-
Columnar Edition 1.0.0 build 2190
-
Untriaged
-
0
-
Unknown
-
Analytics Sprint 45
Description
Seen on nodes 004, 008, 009 -
2024-07-04T01:51:14.311+00:00 ERRO CBAS.replication.NcLifecycleCoordinator [Executor-31:ClusterController] Node 8a75487dc5032078e1b6f6353e71a7b8 failed to complete startup |
java.lang.IllegalStateException: Read unexpected number of bytes: [expected: 52439, actual: 52430, file: /var/cb-cache/@analytics/v_iodevice_11/storage/partition_27/Database9bcLrawaf/scope0AqHQozvI/standaloneRTGFKCmi/0/standaloneRTGFKCmi/0_5_b] |
at org.apache.hyracks.storage.common.buffercache.AbstractBufferedFileIOManager.throwException(AbstractBufferedFileIOManager.java:324) ~[hyracks-storage-common.jar:1.0.0-2190] |
at org.apache.hyracks.storage.common.buffercache.AbstractBufferedFileIOManager.verifyBytesRead(AbstractBufferedFileIOManager.java:316) ~[hyracks-storage-common.jar:1.0.0-2190] |
at org.apache.hyracks.storage.common.file.CompressedBufferedFileHandle.read(CompressedBufferedFileHandle.java:60) ~[hyracks-storage-common.jar:1.0.0-2190] |
at org.apache.hyracks.storage.common.buffercache.BufferCache.read(BufferCache.java:571) ~[hyracks-storage-common.jar:1.0.0-2190] |
at org.apache.hyracks.storage.common.buffercache.BufferCache.tryRead(BufferCache.java:541) ~[hyracks-storage-common.jar:1.0.0-2190] |
at org.apache.hyracks.storage.common.buffercache.BufferCache.pin(BufferCache.java:215) ~[hyracks-storage-common.jar:1.0.0-2190] |
at org.apache.hyracks.storage.common.buffercache.BufferCache.pin(BufferCache.java:177) ~[hyracks-storage-common.jar:1.0.0-2190] |
at org.apache.hyracks.storage.am.common.freepage.AppendOnlyLinkedMetadataPageManager.getRootPageId(AppendOnlyLinkedMetadataPageManager.java:287) ~[hyracks-storage-am-common.jar:1.0.0-2190] |
at org.apache.hyracks.storage.am.common.impls.AbstractTreeIndex.setRootPage(AbstractTreeIndex.java:104) ~[hyracks-storage-am-common.jar:1.0.0-2190] |
at org.apache.hyracks.storage.am.common.impls.AbstractTreeIndex.activate(AbstractTreeIndex.java:120) ~[hyracks-storage-am-common.jar:1.0.0-2190] |
at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndexFileManager.isValidTreeIndex(AbstractLSMIndexFileManager.java:111) ~[hyracks-storage-am-lsm-common.jar:1.0.0-2190] |
at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndexFileManager.cleanupAndGetValidFilesInternal(AbstractLSMIndexFileManager.java:148) ~[hyracks-storage-am-lsm-common.jar:1.0.0-2190] |
at org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTreeFileManager.cleanupAndGetValidFiles(LSMBTreeFileManager.java:88) ~[hyracks-storage-am-lsm-btree.jar:1.0.0-2190] |
at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndex.loadDiskComponents(AbstractLSMIndex.java:208) ~[hyracks-storage-am-lsm-common.jar:1.0.0-2190] |
at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndex.activate(AbstractLSMIndex.java:202) ~[hyracks-storage-am-lsm-common.jar:1.0.0-2190] |
at org.apache.hyracks.storage.am.lsm.btree.column.impls.lsm.LSMColumnBTree.activate(LSMColumnBTree.java:89) ~[hyracks-storage-am-lsm-btree-column.jar:1.0.0-2190] |
at org.apache.asterix.common.context.DatasetLifecycleManager.open(DatasetLifecycleManager.java:221) ~[asterix-common.jar:1.0.0-2190] |
at com.couchbase.analytics.bootstrap.AnalyticsLocalRecoveryManager.cleanUp(AnalyticsLocalRecoveryManager.java:95) ~[columnar-server.jar:1.0.0-2190] |
at com.couchbase.analytics.bootstrap.AnalyticsLocalRecoveryManager.startLocalRecovery(AnalyticsLocalRecoveryManager.java:58) ~[columnar-server.jar:1.0.0-2190] |
at org.apache.asterix.app.nc.task.LocalRecoveryTask.perform(LocalRecoveryTask.java:45) ~[asterix-app.jar:1.0.0-2190] |
at org.apache.asterix.app.replication.message.RegistrationTasksResponseMessage.handle(RegistrationTasksResponseMessage.java:63) ~[asterix-app.jar:1.0.0-2190] |
at org.apache.asterix.messaging.NCMessageBroker.lambda$receivedMessage$0(NCMessageBroker.java:108) ~[asterix-app.jar:1.0.0-2190] |
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) ~[?:?] |
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?] |
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] |
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] |
at java.base/java.lang.Thread.run(Thread.java:840) [?:?] |
2024-07-04T01:51:14.366+00:00 ERRO CBAS.active.ActiveNotificationHandler [ActiveNotificationHandler] entity not found for event JID:0.9894, EntityId:linkNhKgyLyq/default1, Kind:PARTITION_EVENT-GENERIC_EVENT(IdleThresholdEvent{nodeId='f94c8f062610dbde8ea9414e5a4bcb1b'}) |
cbcollect ->
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-001.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-002.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-003.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-004.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-005.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-006.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-007.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-008.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-009.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-010.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-011.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-012.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-013.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-014.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-015.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-016.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
Supportal snapshot -> http://supportal.couchbase.com/snapshot/b18e5645ce6e07c85b98850b3221e5e4::21
Supportal snapshot -> http://supportal.couchbase.com/snapshot/b18e5645ce6e07c85b98850b3221e5e4::31
Attachments
Issue Links
- duplicates
-
MB-62597 [System Test] Cluster unusable messages seen spanning over 1 hour
-
- Closed
-