[Magma]: state file found: 70 status::Invalid: Invalid sstable:Corruption: sstable:../magma.2/kvstore-2/rev-000000001/seqIndex/sstable.51.data unable to find footer offset

172.23.106.95 : Stack Trace of first crash: 1ba05860-b75b-44e1-c3559ab5-54787eb1.dmp

Core was generated by `/opt/couchbase/bin/memcached -C /opt/couchbase/var/lib/couchbase/config/memcach'.

 #0  0x00007ff5d8bc8337 in raise () from /lib64/libc.so.6

 #0  0x00007ff5d8bc8337 in raise () from /lib64/libc.so.6

 No symbol table info available.

 #1  0x00007ff5d8bc9a28 in abort () from /lib64/libc.so.6

 No symbol table info available.

 #2  0x00007ff5d9726195 in __gnu_cxx::__verbose_terminate_handler() () from /opt/couchbase/bin/../lib/libstdc++.so.6

 No symbol table info available.

 #3  0x000000000055c612 in backtrace_terminate_handler() ()

 No symbol table info available.

 #4  0x00007ff5d9723f86 in __cxxabiv1::__terminate(void (*)()) () from /opt/couchbase/bin/../lib/libstdc++.so.6

 No symbol table info available.

 #5  0x00007ff5d9723fd1 in std::terminate() () from /opt/couchbase/bin/../lib/libstdc++.so.6

 No symbol table info available.

 #6  0x00007ff5d9724213 in __cxa_throw () from /opt/couchbase/bin/../lib/libstdc++.so.6

 No symbol table info available.

 #7  0x00007ff5dd013cfd in MagmaKVStore::MagmaKVStore(MagmaKVStoreConfig&) () from /opt/couchbase/bin/../lib/libep.so

 No symbol table info available.

 #8  0x00007ff5dcf453b1 in KVStoreFactory::create(KVStoreConfig&) () from /opt/couchbase/bin/../lib/libep.so

 No symbol table info available.

 #9  0x00007ff5dcf6478c in KVShard::KVShard(EventuallyPersistentEngine&, unsigned short) () from /opt/couchbase/bin/../lib/libep.so

 No symbol table info available.

 #10 0x00007ff5dcfa97bf in VBucketMap::VBucketMap(Configuration&, KVBucket&) () from /opt/couchbase/bin/../lib/libep.so

 No symbol table info available.

 #11 0x00007ff5dcf52e3e in KVBucket::KVBucket(EventuallyPersistentEngine&) () from /opt/couchbase/bin/../lib/libep.so

 No symbol table info available.

 #12 0x00007ff5dced2eb6 in EPBucket::EPBucket(EventuallyPersistentEngine&) () from /opt/couchbase/bin/../lib/libep.so

 No symbol table info available.

 #13 0x00007ff5dceefe09 in EventuallyPersistentEngine::makeBucket(Configuration&) () from /opt/couchbase/bin/../lib/libep.so

 No symbol table info available.

 #14 0x00007ff5dceff1bc in EventuallyPersistentEngine::initialize(char const*) () from /opt/couchbase/bin/../lib/libep.so

 No symbol table info available.

 #15 0x0000000000424660 in CreateBucketThread::create() ()

 No symbol table info available.

 #16 0x0000000000424c19 in CreateBucketThread::run() ()

 No symbol table info available.

 #17 0x00007ff5db745c8f in Couchbase::Thread::thread_entry() () from /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0

 No symbol table info available.

 #18 0x00007ff5db72f727 in platform_thread_wrap(void*) () from /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0

 No symbol table info available.

 #19 0x00007ff5d8f67e65 in start_thread () from /lib64/libpthread.so.0

 No symbol table info available.

 #20 0x00007ff5d8c9088d in clone () from /lib64/libc.so.6

 No symbol table info available.

2021-02-18T16:39:31.299539-08:00 CRITICAL [(default) magma_2/kvstore-2/rev-000000001/seqIndex]Corrupted state file found: 70 status::Invalid: Invalid sstable:Corruption: sstable:/data/default/magma.2/kvstore-2/rev-000000001/seqIndex/sstable.51.data unable to find footer offset

2021-02-18T16:39:31.299760-08:00 CRITICAL [(default) magma_2]Magma::recovery CreateKVStore(2) failed - Corruption: (default) magma_2/kvstore-2/rev-000000001/seqIndex Corrupted state file found: 70 status::Invalid: Invalid sstable:Corruption: sstable:/data/default/magma.2/kvstore-2/rev-000000001/seqIndex/sstable.51.data unable to find footer offset

2021-02-18T16:39:31.299811-08:00 CRITICAL (default) (default) magma_2 MagmaKVStore Magma open failed. Status:Corruption: Magma::recovery CreateKVStore(2) failed - Corruption: (default) magma_2/kvstore-2/rev-000000001/seqIndex Corrupted state file found: 70 status::Invalid: Invalid sstable:Corruption: sstable:/data/default/magma.2/kvstore-2/rev-000000001/seqIndex/sstable.51.data unable to find footer offset

2021-02-18T16:39:31.300014-08:00 CRITICAL *** Fatal error encountered during exception handling ***

2021-02-18T16:39:31.300068-08:00 CRITICAL Caught unhandled std::exception-derived exception. what(): MagmaKVStore Magma open failed. Status:Corruption: Magma::recovery CreateKVStore(2) failed - Corruption: (default) magma_2/kvstore-2/rev-000000001/seqIndex Corrupted state file found: 70 status::Invalid: Invalid sstable:Corruption: sstable:/data/default/magma.2/kvstore-2/rev-000000001/seqIndex/sstable.51.data unable to find footer offset

2021-02-18T16:39:31.593897-08:00 INFO 7599: Client {"ip":"127.0.0.1","port":48530} authenticated as <ud>@ns_server</ud>

2021-02-18T16:39:31.594162-08:00 INFO 7599: HELO [regular] [ {"ip":"127.0.0.1","port":48530} - {"ip":"127.0.0.1","port":11209} (<ud>@ns_server</ud>) ]

2021-02-18T16:39:31.596654-08:00 CRITICAL Breakpad caught a crash (Couchbase version 7.0.0-4476). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/b5141d8c-e824-4e6c-6d8e7e80-c75515aa.dmp before terminating.

2021-02-18T16:39:31.596688-08:00 CRITICAL Stack backtrace of crashed thread:

2021-02-18T16:39:31.596859-08:00 CRITICAL     #0  /opt/couchbase/bin/memcached() [0x400000+0x14c8fd]

2021-02-18T16:39:31.596878-08:00 CRITICAL     #1  /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ea) [0x400000+0x162cea]

2021-02-18T16:39:31.596888-08:00 CRITICAL     #2  /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x400000+0x163028]

2021-02-18T16:39:31.596896-08:00 CRITICAL     #3  /lib64/libpthread.so.0() [0x7fac9be6d000+0xf5f0]

2021-02-18T16:39:31.596922-08:00 CRITICAL     #4  /lib64/libc.so.6(gsignal+0x37) [0x7fac9ba9f000+0x36337]

2021-02-18T16:39:31.596947-08:00 CRITICAL     #5  /lib64/libc.so.6(abort+0x148) [0x7fac9ba9f000+0x37a28]

2021-02-18T16:39:31.596973-08:00 CRITICAL     #6  /opt/couchbase/bin/../lib/libstdc++.so.6(_ZN9__gnu_cxx27__verbose_terminate_handlerEv+0x125) [0x7fac9c5a2000+0x91195]

2021-02-18T16:39:31.596986-08:00 CRITICAL     #7  /opt/couchbase/bin/memcached() [0x400000+0x15c612]

2021-02-18T16:39:31.597030-08:00 CRITICAL     #8  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fac9c5a2000+0x8ef86]

2021-02-18T16:39:31.597052-08:00 CRITICAL     #9  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fac9c5a2000+0x8efd1]

2021-02-18T16:39:31.597071-08:00 CRITICAL     #10 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fac9c5a2000+0x8f213]

2021-02-18T16:39:31.597086-08:00 CRITICAL     #11 /opt/couchbase/bin/../lib/libep.so() [0x7fac9fccf000+0x251cfd]

2021-02-18T16:39:31.597102-08:00 CRITICAL     #12 /opt/couchbase/bin/../lib/libep.so() [0x7fac9fccf000+0x1833b1]

2021-02-18T16:39:31.597111-08:00 CRITICAL     #13 /opt/couchbase/bin/../lib/libep.so() [0x7fac9fccf000+0x1a278c]

2021-02-18T16:39:31.597119-08:00 CRITICAL     #14 /opt/couchbase/bin/../lib/libep.so() [0x7fac9fccf000+0x1e77bf]

2021-02-18T16:39:31.597127-08:00 CRITICAL     #15 /opt/couchbase/bin/../lib/libep.so() [0x7fac9fccf000+0x190e3e]

2021-02-18T16:39:31.597136-08:00 CRITICAL     #16 /opt/couchbase/bin/../lib/libep.so() [0x7fac9fccf000+0x110eb6]

2021-02-18T16:39:31.597169-08:00 CRITICAL     #17 /opt/couchbase/bin/../lib/libep.so() [0x7fac9fccf000+0x12de09]

2021-02-18T16:39:31.597183-08:00 CRITICAL     #18 /opt/couchbase/bin/../lib/libep.so() [0x7fac9fccf000+0x13d1bc]

2021-02-18T16:39:31.597215-08:00 CRITICAL     #19 /opt/couchbase/bin/memcached() [0x400000+0x24660]

2021-02-18T16:39:31.597223-08:00 CRITICAL     #20 /opt/couchbase/bin/memcached() [0x400000+0x24c19]

2021-02-18T16:39:31.597234-08:00 CRITICAL     #21 /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0(_ZN9Couchbase6Thread12thread_entryEv+0xf) [0x7fac9e626000+0x2cc8f]

2021-02-18T16:39:31.597242-08:00 CRITICAL     #22 /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0() [0x7fac9e626000+0x16727]

2021-02-18T16:39:31.597248-08:00 CRITICAL     #23 /lib64/libpthread.so.0() [0x7fac9be6d000+0x7e65]

2021-02-18T16:39:31.597278-08:00 CRITICAL     #24 /lib64/libc.so.6(clone+0x6d) [0x7fac9ba9f000+0xfe88d]