Details
-
Bug
-
Resolution: Fixed
-
Critical
-
Cheshire-Cat
-
Untriaged
-
-
Unknown
Description
As per discussion with Apaar Gupta, after WAL corruption is detected Magma-Open should fail and should have propagated the error instead after detection magma has proceeded normally. This could lead to data loss.
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:19.828420-08:00 CRITICAL WALIterator corruption error:Corruption: 26:25612288
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.543329-08:00 CRITICAL *** Fatal error encountered during exception handling ***
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.543387-08:00 CRITICAL Caught unhandled std::exception-derived exception. what(): MagmaKVStore vbstate vbid:304 not found. Status:NotFound: MagmaKVStore::readLocalDoc(vbid:vb:304 key:_vbstate not found.
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.627629-08:00 CRITICAL Breakpad caught a crash (Couchbase version 6.5.0-42). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/5aa9cd01-ec01-6bc4-14214b9b-2c78750b.dmp before terminating.
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.627650-08:00 CRITICAL Stack backtrace of crashed thread:
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.627848-08:00 CRITICAL /opt/couchbase/bin/memcached() [0x400000+0x13246d]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.627868-08:00 CRITICAL /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ce) [0x400000+0x14a4ae]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.627878-08:00 CRITICAL /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0x94) [0x400000+0x14a7c4]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.627886-08:00 CRITICAL /lib64/libpthread.so.0() [0x7f1f9bc20000+0xf5d0]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.627910-08:00 CRITICAL /lib64/libc.so.6(gsignal+0x37) [0x7f1f9b853000+0x36207]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.627937-08:00 CRITICAL /lib64/libc.so.6(abort+0x148) [0x7f1f9b853000+0x378f8]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.627966-08:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6(_ZN9__gnu_cxx27__verbose_terminate_handlerEv+0x125) [0x7f1f9c355000+0x91195]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.627985-08:00 CRITICAL /opt/couchbase/bin/memcached() [0x400000+0x145da2]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628001-08:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f1f9c355000+0x8ef86]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628017-08:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f1f9c355000+0x8efd1]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628038-08:00 CRITICAL /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f1f9c355000+0x8f213]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628048-08:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f1f96e6d000+0x21374c]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628057-08:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f1f96e6d000+0x148e17]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628090-08:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f1f96e6d000+0x163344]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628098-08:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f1f96e6d000+0x1a6803]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628104-08:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f1f96e6d000+0x15409e]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628111-08:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f1f96e6d000+0xdbd06]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628118-08:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f1f96e6d000+0xf18f9]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628123-08:00 CRITICAL /opt/couchbase/bin/../lib/../lib/ep.so() [0x7f1f96e6d000+0x104cbf]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628132-08:00 CRITICAL /opt/couchbase/bin/memcached() [0x400000+0x240b8]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628141-08:00 CRITICAL /opt/couchbase/bin/memcached() [0x400000+0x24579]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628153-08:00 CRITICAL /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0(_ZN9Couchbase6Thread12thread_entryEv+0xf) [0x7f1f9e1fe000+0x147bf]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628157-08:00 CRITICAL /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0() [0x7f1f9e1fe000+0x8f17]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628165-08:00 CRITICAL /lib64/libpthread.so.0() [0x7f1f9bc20000+0x7dd5]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000022.txt:2020-02-03T20:33:22.628195-08:00 CRITICAL /lib64/libc.so.6(clone+0x6d) [0x7f1f9b853000+0xfdead]
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000023.txt:2020-02-03T20:33:32.334470-08:00 CRITICAL WALIterator corruption error:Corruption: 26:25612288
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000023.txt:2020-02-03T20:33:35.024694-08:00 CRITICAL *** Fatal error encountered during exception handling ***
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000023.txt:2020-02-03T20:33:35.024751-08:00 CRITICAL Caught unhandled std::exception-derived exception. what(): MagmaKVStore vbstate vbid:304 not found. Status:NotFound: MagmaKVStore::readLocalDoc(vbid:vb:304 key:_vbstate not found.
|
/opt/couchbase/var/lib/couchbase/logs/memcached.log.000023.txt:2020-02-03T20:33:35.107479-08:00 CRITICAL Breakpad caught a crash (Couchbase version 6.5.0-42). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/40e03eac-ebfc-ea32-7f8383db-067adb71.dmp before terminating.
|