Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-62598

[System Test] java.lang.IllegalStateException: Read unexpected number of bytes error seen

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Critical
    • Columnar 1.0.0
    • Columnar 1.0.0
    • analytics
    • Columnar Edition 1.0.0 build 2190
    • Untriaged
    • 0
    • Unknown
    • Analytics Sprint 45

    Description

      Seen on nodes 004, 008, 009 -

      2024-07-04T01:51:14.311+00:00 ERRO CBAS.replication.NcLifecycleCoordinator [Executor-31:ClusterController] Node 8a75487dc5032078e1b6f6353e71a7b8 failed to complete startup
      java.lang.IllegalStateException: Read unexpected number of bytes: [expected: 52439, actual: 52430, file: /var/cb-cache/@analytics/v_iodevice_11/storage/partition_27/Database9bcLrawaf/scope0AqHQozvI/standaloneRTGFKCmi/0/standaloneRTGFKCmi/0_5_b]
      	at org.apache.hyracks.storage.common.buffercache.AbstractBufferedFileIOManager.throwException(AbstractBufferedFileIOManager.java:324) ~[hyracks-storage-common.jar:1.0.0-2190]
      	at org.apache.hyracks.storage.common.buffercache.AbstractBufferedFileIOManager.verifyBytesRead(AbstractBufferedFileIOManager.java:316) ~[hyracks-storage-common.jar:1.0.0-2190]
      	at org.apache.hyracks.storage.common.file.CompressedBufferedFileHandle.read(CompressedBufferedFileHandle.java:60) ~[hyracks-storage-common.jar:1.0.0-2190]
      	at org.apache.hyracks.storage.common.buffercache.BufferCache.read(BufferCache.java:571) ~[hyracks-storage-common.jar:1.0.0-2190]
      	at org.apache.hyracks.storage.common.buffercache.BufferCache.tryRead(BufferCache.java:541) ~[hyracks-storage-common.jar:1.0.0-2190]
      	at org.apache.hyracks.storage.common.buffercache.BufferCache.pin(BufferCache.java:215) ~[hyracks-storage-common.jar:1.0.0-2190]
      	at org.apache.hyracks.storage.common.buffercache.BufferCache.pin(BufferCache.java:177) ~[hyracks-storage-common.jar:1.0.0-2190]
      	at org.apache.hyracks.storage.am.common.freepage.AppendOnlyLinkedMetadataPageManager.getRootPageId(AppendOnlyLinkedMetadataPageManager.java:287) ~[hyracks-storage-am-common.jar:1.0.0-2190]
      	at org.apache.hyracks.storage.am.common.impls.AbstractTreeIndex.setRootPage(AbstractTreeIndex.java:104) ~[hyracks-storage-am-common.jar:1.0.0-2190]
      	at org.apache.hyracks.storage.am.common.impls.AbstractTreeIndex.activate(AbstractTreeIndex.java:120) ~[hyracks-storage-am-common.jar:1.0.0-2190]
      	at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndexFileManager.isValidTreeIndex(AbstractLSMIndexFileManager.java:111) ~[hyracks-storage-am-lsm-common.jar:1.0.0-2190]
      	at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndexFileManager.cleanupAndGetValidFilesInternal(AbstractLSMIndexFileManager.java:148) ~[hyracks-storage-am-lsm-common.jar:1.0.0-2190]
      	at org.apache.hyracks.storage.am.lsm.btree.impls.LSMBTreeFileManager.cleanupAndGetValidFiles(LSMBTreeFileManager.java:88) ~[hyracks-storage-am-lsm-btree.jar:1.0.0-2190]
      	at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndex.loadDiskComponents(AbstractLSMIndex.java:208) ~[hyracks-storage-am-lsm-common.jar:1.0.0-2190]
      	at org.apache.hyracks.storage.am.lsm.common.impls.AbstractLSMIndex.activate(AbstractLSMIndex.java:202) ~[hyracks-storage-am-lsm-common.jar:1.0.0-2190]
      	at org.apache.hyracks.storage.am.lsm.btree.column.impls.lsm.LSMColumnBTree.activate(LSMColumnBTree.java:89) ~[hyracks-storage-am-lsm-btree-column.jar:1.0.0-2190]
      	at org.apache.asterix.common.context.DatasetLifecycleManager.open(DatasetLifecycleManager.java:221) ~[asterix-common.jar:1.0.0-2190]
      	at com.couchbase.analytics.bootstrap.AnalyticsLocalRecoveryManager.cleanUp(AnalyticsLocalRecoveryManager.java:95) ~[columnar-server.jar:1.0.0-2190]
      	at com.couchbase.analytics.bootstrap.AnalyticsLocalRecoveryManager.startLocalRecovery(AnalyticsLocalRecoveryManager.java:58) ~[columnar-server.jar:1.0.0-2190]
      	at org.apache.asterix.app.nc.task.LocalRecoveryTask.perform(LocalRecoveryTask.java:45) ~[asterix-app.jar:1.0.0-2190]
      	at org.apache.asterix.app.replication.message.RegistrationTasksResponseMessage.handle(RegistrationTasksResponseMessage.java:63) ~[asterix-app.jar:1.0.0-2190]
      	at org.apache.asterix.messaging.NCMessageBroker.lambda$receivedMessage$0(NCMessageBroker.java:108) ~[asterix-app.jar:1.0.0-2190]
      	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) ~[?:?]
      	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
      	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
      	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
      	at java.base/java.lang.Thread.run(Thread.java:840) [?:?]
      2024-07-04T01:51:14.366+00:00 ERRO CBAS.active.ActiveNotificationHandler [ActiveNotificationHandler] entity not found for event JID:0.9894, EntityId:linkNhKgyLyq/default1, Kind:PARTITION_EVENT-GENERIC_EVENT(IdleThresholdEvent{nodeId='f94c8f062610dbde8ea9414e5a4bcb1b'})
      

      cbcollect ->

      https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-001.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
      https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-002.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
      https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-003.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
      https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-004.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
      https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-005.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
      https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-006.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
      https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-007.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
      https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-008.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
      https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-009.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
      https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-010.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
      https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-011.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
      https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-012.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
      https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-013.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
      https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-014.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
      https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-015.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip
      https://cb-engineering.s3.amazonaws.com/SysTestColumnarJul3/collectinfo-2024-07-03T194313-ns_1%40svc-da-node-016.b2yoytucmykunsrf.sandbox.nonprod-project-avengers.com.zip

      Supportal snapshot -> http://supportal.couchbase.com/snapshot/b18e5645ce6e07c85b98850b3221e5e4::21

      Supportal snapshot -> http://supportal.couchbase.com/snapshot/b18e5645ce6e07c85b98850b3221e5e4::31

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              wail.alkowaileet Wail Alkowaileet (Inactive)
              pavan.pb Pavan PB
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty