Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-56097

[System test] [CDC]:Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300

    XMLWordPrintable

Details

    • Untriaged
    • Centos 64-bit
    • 0
    • No

    Description

      Script to Repro

      ./sequoia -client 172.23.104.27:2375 -provider file:centos_pine.yml -test tests/integration/7.2/test_7.2.yml -scope tests/integration/7.2/scope_7.2_magma.yml -scale 3 -repeat 0 -log_level 0 -version 7.2.0-5263 -skip_setup=false -skip_test=false -skip_teardown=true -skip_cleanup=false -continue=false -collect_on_error=false -stop_on_error=false -duration=604800 -show_topology=true

      This test runs on magma buckets with CDC enabled. After almost 2 days saw following CRITICAL messages.

      172.23.104.5 : memcached

      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:42.866812-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:42.967058-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:43.058160-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:43.158291-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:43.262348-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:43.362452-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:43.453314-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:43.553464-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:43.609446-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:43.710114-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:43.755528-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:43.855681-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:43.898875-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:43.999057-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:44.047577-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:44.147722-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:44.224817-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:44.324921-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:44.398867-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:44.498996-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:44.545010-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:44.645202-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:44.752570-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:44.852802-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:44.958598-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:45.059528-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:45.132177-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:45.232358-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:45.297623-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:45.397870-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:45.451763-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:45.551892-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:45.618402-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:45.718539-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:45.765102-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:45.865223-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:45.907244-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:46.007398-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:46.053443-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:46.153570-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:46.192475-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:46.292599-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:46.330780-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:46.430894-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:46.474783-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:46.574920-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:46.630153-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:46.730254-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:46.772097-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:46.872212-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:46.911773-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:47.011891-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:47.051955-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:47.152070-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:47.204588-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:47.304709-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:47.347152-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:47.447483-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:47.497252-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:47.597388-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:47.645141-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:47.745499-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:47.803357-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:47.903494-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:47.944350-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:48.044458-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:48.087446-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:48.187934-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:48.247248-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:48.347367-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:48.393486-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:48.493574-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:48.536002-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:48.636154-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:48.691592-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:48.791752-07:00 CRITICAL (ITEM) MagmaKVStore::saveDocs vb:432 WriteDocs failed. Status:Corruption: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300
      		 
      /opt/couchbase/var/lib/couchbase/logs/memcached.log.000076.txt:2023-03-22T10:56:48.848794-07:00 CRITICAL [(ITEM) magma_0]Fatal error: Invalid checksum: sstable: /data/couchbase/ITEM/magma.0/kvstore-432/rev-000000001/seqIndex/sstable.3936.data at offset:2300

      cbcollect_info attached.

      Attachments

        1. consoleText_MB-56097.txt
          2.57 MB
        2. kvstore-404.zip
          8.49 MB
        3. script_output_in_action.png
          script_output_in_action.png
          297 kB
        4. sstable.3936.data.hexdump
          26 kB
        5. write.py
          4 kB

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. MB-47002 [Magma] CRITICAL [(metadata) magma_0/kvstore-980/rev-000000001/seqIndex]Error occured during compaction (Corruption: Invalid checksum

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-56567 CRITICAL [(bucket9) magma_5]Fatal error: Invalid checksum: sstable: /data/couchbase/bucket9/magma.5/kvstore-389/rev-000000001/localIndex/sstable.3466.data at offset:616

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. MB-56567 CRITICAL [(bucket9) magma_5]Fatal error: Invalid checksum: sstable: /data/couchbase/bucket9/magma.5/kvstore-389/rev-000000001/localIndex/sstable.3466.data at offset:616

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-56595 Log and return bad status in case of failure of std::copy during SSTable write

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              Balakumaran.Gopal Balakumaran Gopal
              Balakumaran.Gopal Balakumaran Gopal
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty