Details

    • Technical task
    • Resolution: Duplicate
    • Major
    • None
    • 7.1.0
    • couchbase-bucket
    • None
    • 1

    Description

      Description

      Investigate the second failure.

      Logs

      [^collectinfo-2021-09-14T100403-ns_1@172.23.121.222.zip] (1 Mini dump)

      2021-09-14T02:44:11.281982-07:00 CRITICAL *** Fatal error encountered during exception handling ***
      2021-09-14T02:44:11.282018-07:00 CRITICAL Caught unhandled std::exception-derived exception. what(): Monotonic<m> (unlabelled) invariant failed: new value (0) breaks invariant on current value (4786)
      2021-09-14T02:44:11.282022-07:00 CRITICAL Exception thrown from:
      2021-09-14T02:44:11.282063-07:00 CRITICAL     #0  /opt/couchbase/bin/memcached() [0x400000+0x95207]
      2021-09-14T02:44:11.282138-07:00 CRITICAL     #1  /opt/couchbase/bin/memcached() [0x400000+0xc3c47]
      2021-09-14T02:44:11.282161-07:00 CRITICAL     #2  /opt/couchbase/bin/memcached() [0x400000+0x3ef06d]
      2021-09-14T02:44:11.282178-07:00 CRITICAL     #3  /opt/couchbase/bin/memcached() [0x400000+0x4524f2]
      2021-09-14T02:44:11.282200-07:00 CRITICAL     #4  /opt/couchbase/bin/memcached() [0x400000+0x452f76]
      2021-09-14T02:44:11.282213-07:00 CRITICAL     #5  /opt/couchbase/bin/memcached() [0x400000+0x3eb3ba]
      2021-09-14T02:44:11.282242-07:00 CRITICAL     #6  /opt/couchbase/bin/memcached() [0x400000+0x3ec981]
      2021-09-14T02:44:11.282262-07:00 CRITICAL     #7  /opt/couchbase/bin/memcached() [0x400000+0x306666]
      2021-09-14T02:44:11.282283-07:00 CRITICAL     #8  /opt/couchbase/bin/memcached() [0x400000+0x60ae52]
      2021-09-14T02:44:11.282308-07:00 CRITICAL     #9  /opt/couchbase/bin/memcached() [0x400000+0x607f75]
      2021-09-14T02:44:11.282338-07:00 CRITICAL     #10 /opt/couchbase/bin/memcached() [0x400000+0x759b30]
      2021-09-14T02:44:11.282366-07:00 CRITICAL     #11 /opt/couchbase/bin/memcached() [0x400000+0x7418ea]
      2021-09-14T02:44:11.282387-07:00 CRITICAL     #12 /opt/couchbase/bin/memcached() [0x400000+0x75cae9]
      2021-09-14T02:44:11.282411-07:00 CRITICAL     #13 /opt/couchbase/bin/memcached() [0x400000+0x607c04]
      2021-09-14T02:44:11.282457-07:00 CRITICAL     #14 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f05ff826000+0xcdd40]
      2021-09-14T02:44:11.282470-07:00 CRITICAL     #15 /lib64/libpthread.so.0() [0x7f060170c000+0x7e65]
      2021-09-14T02:44:11.282503-07:00 CRITICAL     #16 /lib64/libc.so.6(clone+0x6d) [0x7f05fef3e000+0xfe88d]
      2021-09-14T02:44:11.887897-07:00 CRITICAL Detected previous crash
      2021-09-14T02:44:11.887943-07:00 CRITICAL Breakpad caught a crash (Couchbase version 7.1.0-1277). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/0257718a-7df2-4f8c-0eca94a4-4c092768.dmp before terminating.
      2021-09-14T02:44:11.887953-07:00 CRITICAL Stack backtrace of crashed thread:
      2021-09-14T02:44:11.887954-07:00 CRITICAL    #0  /opt/couchbase/bin/memcached() [0x400000+0x68c438]
      2021-09-14T02:44:11.887956-07:00 CRITICAL    #1  /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ea) [0x400000+0x6e1a4a]
      2021-09-14T02:44:11.887958-07:00 CRITICAL    #2  /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x400000+0x6e1d88]
      2021-09-14T02:44:11.887959-07:00 CRITICAL    #3  /lib64/libpthread.so.0() [0x7f060170c000+0xf5f0]
      2021-09-14T02:44:11.887961-07:00 CRITICAL    #4  /lib64/libc.so.6(gsignal+0x37) [0x7f05fef3e000+0x36337]
      2021-09-14T02:44:11.887962-07:00 CRITICAL    #5  /lib64/libc.so.6(abort+0x148) [0x7f05fef3e000+0x37a28]
      2021-09-14T02:44:11.887963-07:00 CRITICAL    #6  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f05ff826000+0x9963c]
      2021-09-14T02:44:11.887965-07:00 CRITICAL    #7  /opt/couchbase/bin/memcached() [0x400000+0x699a3b]
      2021-09-14T02:44:11.887966-07:00 CRITICAL    #8  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f05ff826000+0xa48f6]
      2021-09-14T02:44:11.887967-07:00 CRITICAL    #9  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f05ff826000+0xa4961]
      2021-09-14T02:44:11.887969-07:00 CRITICAL    #10 /opt/couchbase/bin/../lib/libstdc++.so.6(__cxa_rethrow+0x46) [0x7f05ff826000+0xa4c46]
      2021-09-14T02:44:11.887981-07:00 CRITICAL    #11 /opt/couchbase/bin/memcached() [0x400000+0xc3efe]
      2021-09-14T02:44:11.888008-07:00 CRITICAL    #12 /opt/couchbase/bin/memcached() [0x400000+0x4524f2]
      2021-09-14T02:44:11.888010-07:00 CRITICAL    #13 /opt/couchbase/bin/memcached() [0x400000+0x452f76]
      2021-09-14T02:44:11.888011-07:00 CRITICAL    #14 /opt/couchbase/bin/memcached() [0x400000+0x3eb3ba]
      2021-09-14T02:44:11.888015-07:00 CRITICAL    #15 /opt/couchbase/bin/memcached() [0x400000+0x3ec981]
      2021-09-14T02:44:11.888037-07:00 CRITICAL    #16 /opt/couchbase/bin/memcached() [0x400000+0x306666]
      2021-09-14T02:44:11.888039-07:00 CRITICAL    #17 /opt/couchbase/bin/memcached() [0x400000+0x60ae52]
      2021-09-14T02:44:11.888040-07:00 CRITICAL    #18 /opt/couchbase/bin/memcached() [0x400000+0x607f75]
      2021-09-14T02:44:11.888064-07:00 CRITICAL    #19 /opt/couchbase/bin/memcached() [0x400000+0x759b30]
      2021-09-14T02:44:11.888087-07:00 CRITICAL    #20 /opt/couchbase/bin/memcached() [0x400000+0x7418ea]
      2021-09-14T02:44:11.888091-07:00 CRITICAL    #21 /opt/couchbase/bin/memcached() [0x400000+0x75cae9]
      2021-09-14T02:44:11.888093-07:00 CRITICAL    #22 /opt/couchbase/bin/memcached() [0x400000+0x607c04]
      2021-09-14T02:44:11.888095-07:00 CRITICAL    #23 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f05ff826000+0xcdd40]
      2021-09-14T02:44:11.888144-07:00 CRITICAL    #24 /lib64/libpthread.so.0() [0x7f060170c000+0x7e65]
      2021-09-14T02:44:11.888145-07:00 CRITICAL    #25 /lib64/libc.so.6(clone+0x6d) [0x7f05fef3e000+0xfe88d]
      2021-09-14T02:45:31.600101-07:00 CRITICAL *** Fatal error encountered during exception handling ***
      2021-09-14T02:45:31.600159-07:00 CRITICAL Caught unhandled std::exception-derived exception. what(): Monotonic<m> (unlabelled) invariant failed: new value (0) breaks invariant on current value (3922)
      2021-09-14T02:45:31.600162-07:00 CRITICAL Exception thrown from:
      2021-09-14T02:45:31.600201-07:00 CRITICAL     #0  /opt/couchbase/bin/memcached() [0x400000+0x95207]
      2021-09-14T02:45:31.600215-07:00 CRITICAL     #1  /opt/couchbase/bin/memcached() [0x400000+0xc3c47]
      2021-09-14T02:45:31.600231-07:00 CRITICAL     #2  /opt/couchbase/bin/memcached() [0x400000+0x3ef06d]
      2021-09-14T02:45:31.600248-07:00 CRITICAL     #3  /opt/couchbase/bin/memcached() [0x400000+0x4524f2]
      2021-09-14T02:45:31.600262-07:00 CRITICAL     #4  /opt/couchbase/bin/memcached() [0x400000+0x452f76]
      2021-09-14T02:45:31.600276-07:00 CRITICAL     #5  /opt/couchbase/bin/memcached() [0x400000+0x3eb3ba]
      2021-09-14T02:45:31.600289-07:00 CRITICAL     #6  /opt/couchbase/bin/memcached() [0x400000+0x3ec981]
      2021-09-14T02:45:31.600302-07:00 CRITICAL     #7  /opt/couchbase/bin/memcached() [0x400000+0x306666]
      2021-09-14T02:45:31.600322-07:00 CRITICAL     #8  /opt/couchbase/bin/memcached() [0x400000+0x60ae52]
      2021-09-14T02:45:31.600341-07:00 CRITICAL     #9  /opt/couchbase/bin/memcached() [0x400000+0x607f75]
      2021-09-14T02:45:31.600362-07:00 CRITICAL     #10 /opt/couchbase/bin/memcached() [0x400000+0x759b30]
      2021-09-14T02:45:31.600383-07:00 CRITICAL     #11 /opt/couchbase/bin/memcached() [0x400000+0x7418ea]
      2021-09-14T02:45:31.600639-07:00 CRITICAL     #12 /opt/couchbase/bin/memcached() [0x400000+0x75cae9]
      2021-09-14T02:45:31.600660-07:00 CRITICAL     #13 /opt/couchbase/bin/memcached() [0x400000+0x607c04]
      2021-09-14T02:45:31.600731-07:00 CRITICAL     #14 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fae92ea6000+0xcdd40]
      2021-09-14T02:45:31.600744-07:00 CRITICAL     #15 /lib64/libpthread.so.0() [0x7fae94d8c000+0x7e65]
      2021-09-14T02:45:31.600778-07:00 CRITICAL     #16 /lib64/libc.so.6(clone+0x6d) [0x7fae925be000+0xfe88d]
      2021-09-14T02:45:32.148289-07:00 CRITICAL Detected previous crash
      2021-09-14T02:45:32.148341-07:00 CRITICAL Breakpad caught a crash (Couchbase version 7.1.0-1277). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/7b4d4f5c-6abd-49bd-53169ba0-0841c7ce.dmp before terminating.
      2021-09-14T02:45:32.148352-07:00 CRITICAL Stack backtrace of crashed thread:
      2021-09-14T02:45:32.148354-07:00 CRITICAL    #0  /opt/couchbase/bin/memcached() [0x400000+0x68c438]
      2021-09-14T02:45:32.148356-07:00 CRITICAL    #1  /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ea) [0x400000+0x6e1a4a]
      2021-09-14T02:45:32.148358-07:00 CRITICAL    #2  /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x400000+0x6e1d88]
      2021-09-14T02:45:32.148359-07:00 CRITICAL    #3  /lib64/libpthread.so.0() [0x7fae94d8c000+0xf5f0]
      2021-09-14T02:45:32.148361-07:00 CRITICAL    #4  /lib64/libc.so.6(gsignal+0x37) [0x7fae925be000+0x36337]
      2021-09-14T02:45:32.148362-07:00 CRITICAL    #5  /lib64/libc.so.6(abort+0x148) [0x7fae925be000+0x37a28]
      2021-09-14T02:45:32.148363-07:00 CRITICAL    #6  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fae92ea6000+0x9963c]
      2021-09-14T02:45:32.148375-07:00 CRITICAL    #7  /opt/couchbase/bin/memcached() [0x400000+0x699a3b]
      2021-09-14T02:45:32.148376-07:00 CRITICAL    #8  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fae92ea6000+0xa48f6]
      2021-09-14T02:45:32.148380-07:00 CRITICAL    #9  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fae92ea6000+0xa4961]
      2021-09-14T02:45:32.148382-07:00 CRITICAL    #10 /opt/couchbase/bin/../lib/libstdc++.so.6(__cxa_rethrow+0x46) [0x7fae92ea6000+0xa4c46]
      2021-09-14T02:45:32.148384-07:00 CRITICAL    #11 /opt/couchbase/bin/memcached() [0x400000+0xc3efe]
      2021-09-14T02:45:32.148385-07:00 CRITICAL    #12 /opt/couchbase/bin/memcached() [0x400000+0x4524f2]
      2021-09-14T02:45:32.148419-07:00 CRITICAL    #13 /opt/couchbase/bin/memcached() [0x400000+0x452f76]
      2021-09-14T02:45:32.148460-07:00 CRITICAL    #14 /opt/couchbase/bin/memcached() [0x400000+0x3eb3ba]
      2021-09-14T02:45:32.148464-07:00 CRITICAL    #15 /opt/couchbase/bin/memcached() [0x400000+0x3ec981]
      2021-09-14T02:45:32.148466-07:00 CRITICAL    #16 /opt/couchbase/bin/memcached() [0x400000+0x306666]
      2021-09-14T02:45:32.148468-07:00 CRITICAL    #17 /opt/couchbase/bin/memcached() [0x400000+0x60ae52]
      2021-09-14T02:45:32.148469-07:00 CRITICAL    #18 /opt/couchbase/bin/memcached() [0x400000+0x607f75]
      2021-09-14T02:45:32.148490-07:00 CRITICAL    #19 /opt/couchbase/bin/memcached() [0x400000+0x759b30]
      2021-09-14T02:45:32.148493-07:00 CRITICAL    #20 /opt/couchbase/bin/memcached() [0x400000+0x7418ea]
      2021-09-14T02:45:32.148496-07:00 CRITICAL    #21 /opt/couchbase/bin/memcached() [0x400000+0x75cae9]
      2021-09-14T02:45:32.148499-07:00 CRITICAL    #22 /opt/couchbase/bin/memcached() [0x400000+0x607c04]
      2021-09-14T02:45:32.148502-07:00 CRITICAL    #23 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fae92ea6000+0xcdd40]
      2021-09-14T02:45:32.148504-07:00 CRITICAL    #24 /lib64/libpthread.so.0() [0x7fae94d8c000+0x7e65]
      2021-09-14T02:45:32.148505-07:00 CRITICAL    #25 /lib64/libc.so.6(clone+0x6d) [0x7fae925be000+0xfe88d]
      2021-09-14T03:03:46.522726-07:00 CRITICAL *** Fatal error encountered during exception handling ***
      2021-09-14T03:03:46.522775-07:00 CRITICAL Caught unhandled std::exception-derived exception. what(): Monotonic<m> (unlabelled) invariant failed: new value (0) breaks invariant on current value (4837)
      2021-09-14T03:03:46.522778-07:00 CRITICAL Exception thrown from:
      2021-09-14T03:03:46.522942-07:00 CRITICAL     #0  /opt/couchbase/bin/memcached() [0x400000+0x95207]
      2021-09-14T03:03:46.522974-07:00 CRITICAL     #1  /opt/couchbase/bin/memcached() [0x400000+0xc3c47]
      2021-09-14T03:03:46.523077-07:00 CRITICAL     #2  /opt/couchbase/bin/memcached() [0x400000+0x3ef06d]
      2021-09-14T03:03:46.523105-07:00 CRITICAL     #3  /opt/couchbase/bin/memcached() [0x400000+0x4524f2]
      2021-09-14T03:03:46.523119-07:00 CRITICAL     #4  /opt/couchbase/bin/memcached() [0x400000+0x452f76]
      2021-09-14T03:03:46.523134-07:00 CRITICAL     #5  /opt/couchbase/bin/memcached() [0x400000+0x3eb3ba]
      2021-09-14T03:03:46.523199-07:00 CRITICAL     #6  /opt/couchbase/bin/memcached() [0x400000+0x3ec981]
      2021-09-14T03:03:46.523223-07:00 CRITICAL     #7  /opt/couchbase/bin/memcached() [0x400000+0x306666]
      2021-09-14T03:03:46.523283-07:00 CRITICAL     #8  /opt/couchbase/bin/memcached() [0x400000+0x60ae52]
      2021-09-14T03:03:46.523318-07:00 CRITICAL     #9  /opt/couchbase/bin/memcached() [0x400000+0x607f75]
      2021-09-14T03:03:46.523384-07:00 CRITICAL     #10 /opt/couchbase/bin/memcached() [0x400000+0x759b30]
      2021-09-14T03:03:46.523415-07:00 CRITICAL     #11 /opt/couchbase/bin/memcached() [0x400000+0x7418ea]
      2021-09-14T03:03:46.523475-07:00 CRITICAL     #12 /opt/couchbase/bin/memcached() [0x400000+0x75cae9]
      2021-09-14T03:03:46.523505-07:00 CRITICAL     #13 /opt/couchbase/bin/memcached() [0x400000+0x607c04]
      2021-09-14T03:03:46.523585-07:00 CRITICAL     #14 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fa8dfdab000+0xcdd40]
      2021-09-14T03:03:46.523617-07:00 CRITICAL     #15 /lib64/libpthread.so.0() [0x7fa8e1c91000+0x7e65]
      2021-09-14T03:03:46.523693-07:00 CRITICAL     #16 /lib64/libc.so.6(clone+0x6d) [0x7fa8df4c3000+0xfe88d]
      2021-09-14T03:03:47.370337-07:00 CRITICAL Detected previous crash
      2021-09-14T03:03:47.370400-07:00 CRITICAL Breakpad caught a crash (Couchbase version 7.1.0-1277). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/53b2e9b9-7a98-45a5-ad5431aa-ef85228a.dmp before terminating.
      2021-09-14T03:03:47.370410-07:00 CRITICAL Stack backtrace of crashed thread:
      2021-09-14T03:03:47.370412-07:00 CRITICAL    #0  /opt/couchbase/bin/memcached() [0x400000+0x68c438]
      2021-09-14T03:03:47.370414-07:00 CRITICAL    #1  /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ea) [0x400000+0x6e1a4a]
      2021-09-14T03:03:47.370415-07:00 CRITICAL    #2  /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x400000+0x6e1d88]
      2021-09-14T03:03:47.370418-07:00 CRITICAL    #3  /lib64/libpthread.so.0() [0x7fa8e1c91000+0xf5f0]
      2021-09-14T03:03:47.370420-07:00 CRITICAL    #4  /lib64/libc.so.6(gsignal+0x37) [0x7fa8df4c3000+0x36337]
      2021-09-14T03:03:47.370422-07:00 CRITICAL    #5  /lib64/libc.so.6(abort+0x148) [0x7fa8df4c3000+0x37a28]
      2021-09-14T03:03:47.370425-07:00 CRITICAL    #6  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fa8dfdab000+0x9963c]
      2021-09-14T03:03:47.370427-07:00 CRITICAL    #7  /opt/couchbase/bin/memcached() [0x400000+0x699a3b]
      2021-09-14T03:03:47.370428-07:00 CRITICAL    #8  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fa8dfdab000+0xa48f6]
      2021-09-14T03:03:47.370429-07:00 CRITICAL    #9  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fa8dfdab000+0xa4961]
      2021-09-14T03:03:47.370434-07:00 CRITICAL    #10 /opt/couchbase/bin/../lib/libstdc++.so.6(__cxa_rethrow+0x46) [0x7fa8dfdab000+0xa4c46]
      2021-09-14T03:03:47.370499-07:00 CRITICAL    #11 /opt/couchbase/bin/memcached() [0x400000+0xc3efe]
      2021-09-14T03:03:47.370502-07:00 CRITICAL    #12 /opt/couchbase/bin/memcached() [0x400000+0x4524f2]
      2021-09-14T03:03:47.370504-07:00 CRITICAL    #13 /opt/couchbase/bin/memcached() [0x400000+0x452f76]
      2021-09-14T03:03:47.370505-07:00 CRITICAL    #14 /opt/couchbase/bin/memcached() [0x400000+0x3eb3ba]
      2021-09-14T03:03:47.370507-07:00 CRITICAL    #15 /opt/couchbase/bin/memcached() [0x400000+0x3ec981]
      2021-09-14T03:03:47.370508-07:00 CRITICAL    #16 /opt/couchbase/bin/memcached() [0x400000+0x306666]
      2021-09-14T03:03:47.370509-07:00 CRITICAL    #17 /opt/couchbase/bin/memcached() [0x400000+0x60ae52]
      2021-09-14T03:03:47.370690-07:00 CRITICAL    #18 /opt/couchbase/bin/memcached() [0x400000+0x607f75]
      2021-09-14T03:03:47.370691-07:00 CRITICAL    #19 /opt/couchbase/bin/memcached() [0x400000+0x759b30]
      2021-09-14T03:03:47.370693-07:00 CRITICAL    #20 /opt/couchbase/bin/memcached() [0x400000+0x7418ea]
      2021-09-14T03:03:47.370694-07:00 CRITICAL    #21 /opt/couchbase/bin/memcached() [0x400000+0x75cae9]
      2021-09-14T03:03:47.370696-07:00 CRITICAL    #22 /opt/couchbase/bin/memcached() [0x400000+0x607c04]
      2021-09-14T03:03:47.370697-07:00 CRITICAL    #23 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fa8dfdab000+0xcdd40]
      2021-09-14T03:03:47.370699-07:00 CRITICAL    #24 /lib64/libpthread.so.0() [0x7fa8e1c91000+0x7e65]
      2021-09-14T03:03:47.370700-07:00 CRITICAL    #25 /lib64/libc.so.6(clone+0x6d) [0x7fa8df4c3000+0xfe88d]
      

      [^collectinfo-2021-09-14T100403-ns_1@172.23.121.221.zip] (No mini dumps or backtraces in logs)

      [^collectinfo-2021-09-14T100403-ns_1@172.23.123.119.zip] (2 mini dumps)

      2021-09-14T02:48:46.581565-07:00 CRITICAL *** Fatal error encountered during exception handling ***
      2021-09-14T02:48:46.581602-07:00 CRITICAL Caught unhandled std::exception-derived exception. what(): Monotonic<m> (unlabelled) invariant failed: new value (0) breaks invariant on current value (5535)
      2021-09-14T02:48:46.581605-07:00 CRITICAL Exception thrown from:
      2021-09-14T02:48:46.581646-07:00 CRITICAL     #0  /opt/couchbase/bin/memcached() [0x400000+0x95207]
      2021-09-14T02:48:46.581668-07:00 CRITICAL     #1  /opt/couchbase/bin/memcached() [0x400000+0xc3c47]
      2021-09-14T02:48:46.581685-07:00 CRITICAL     #2  /opt/couchbase/bin/memcached() [0x400000+0x3ef06d]
      2021-09-14T02:48:46.581701-07:00 CRITICAL     #3  /opt/couchbase/bin/memcached() [0x400000+0x4524f2]
      2021-09-14T02:48:46.581716-07:00 CRITICAL     #4  /opt/couchbase/bin/memcached() [0x400000+0x452f76]
      2021-09-14T02:48:46.581729-07:00 CRITICAL     #5  /opt/couchbase/bin/memcached() [0x400000+0x3eb3ba]
      2021-09-14T02:48:46.581741-07:00 CRITICAL     #6  /opt/couchbase/bin/memcached() [0x400000+0x3ec981]
      2021-09-14T02:48:46.581754-07:00 CRITICAL     #7  /opt/couchbase/bin/memcached() [0x400000+0x306666]
      2021-09-14T02:48:46.581781-07:00 CRITICAL     #8  /opt/couchbase/bin/memcached() [0x400000+0x60ae52]
      2021-09-14T02:48:46.581799-07:00 CRITICAL     #9  /opt/couchbase/bin/memcached() [0x400000+0x607f75]
      2021-09-14T02:48:46.581821-07:00 CRITICAL     #10 /opt/couchbase/bin/memcached() [0x400000+0x759b30]
      2021-09-14T02:48:46.581842-07:00 CRITICAL     #11 /opt/couchbase/bin/memcached() [0x400000+0x7418ea]
      2021-09-14T02:48:46.581861-07:00 CRITICAL     #12 /opt/couchbase/bin/memcached() [0x400000+0x75cae9]
      2021-09-14T02:48:46.581956-07:00 CRITICAL     #13 /opt/couchbase/bin/memcached() [0x400000+0x607c04]
      2021-09-14T02:48:46.582019-07:00 CRITICAL     #14 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f039a293000+0xcdd40]
      2021-09-14T02:48:46.582032-07:00 CRITICAL     #15 /lib64/libpthread.so.0() [0x7f039c179000+0x7e65]
      2021-09-14T02:48:46.582066-07:00 CRITICAL     #16 /lib64/libc.so.6(clone+0x6d) [0x7f03999ab000+0xfe88d]
      2021-09-14T02:48:47.040263-07:00 CRITICAL Detected previous crash
      2021-09-14T02:48:47.040305-07:00 CRITICAL Breakpad caught a crash (Couchbase version 7.1.0-1277). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/e6f61e03-c800-4997-991130bd-243a72e0.dmp before terminating.
      2021-09-14T02:48:47.040318-07:00 CRITICAL Stack backtrace of crashed thread:
      2021-09-14T02:48:47.040320-07:00 CRITICAL    #0  /opt/couchbase/bin/memcached() [0x400000+0x68c438]
      2021-09-14T02:48:47.040321-07:00 CRITICAL    #1  /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ea) [0x400000+0x6e1a4a]
      2021-09-14T02:48:47.040322-07:00 CRITICAL    #2  /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x400000+0x6e1d88]
      2021-09-14T02:48:47.040323-07:00 CRITICAL    #3  /lib64/libpthread.so.0() [0x7f039c179000+0xf5f0]
      2021-09-14T02:48:47.040325-07:00 CRITICAL    #4  /lib64/libc.so.6(gsignal+0x37) [0x7f03999ab000+0x36337]
      2021-09-14T02:48:47.040326-07:00 CRITICAL    #5  /lib64/libc.so.6(abort+0x148) [0x7f03999ab000+0x37a28]
      2021-09-14T02:48:47.040327-07:00 CRITICAL    #6  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f039a293000+0x9963c]
      2021-09-14T02:48:47.040329-07:00 CRITICAL    #7  /opt/couchbase/bin/memcached() [0x400000+0x699a3b]
      2021-09-14T02:48:47.040330-07:00 CRITICAL    #8  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f039a293000+0xa48f6]
      2021-09-14T02:48:47.040331-07:00 CRITICAL    #9  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f039a293000+0xa4961]
      2021-09-14T02:48:47.040332-07:00 CRITICAL    #10 /opt/couchbase/bin/../lib/libstdc++.so.6(__cxa_rethrow+0x46) [0x7f039a293000+0xa4c46]
      2021-09-14T02:48:47.040405-07:00 CRITICAL    #11 /opt/couchbase/bin/memcached() [0x400000+0xc3efe]
      2021-09-14T02:48:47.040407-07:00 CRITICAL    #12 /opt/couchbase/bin/memcached() [0x400000+0x4524f2]
      2021-09-14T02:48:47.040408-07:00 CRITICAL    #13 /opt/couchbase/bin/memcached() [0x400000+0x452f76]
      2021-09-14T02:48:47.040409-07:00 CRITICAL    #14 /opt/couchbase/bin/memcached() [0x400000+0x3eb3ba]
      2021-09-14T02:48:47.040410-07:00 CRITICAL    #15 /opt/couchbase/bin/memcached() [0x400000+0x3ec981]
      2021-09-14T02:48:47.040411-07:00 CRITICAL    #16 /opt/couchbase/bin/memcached() [0x400000+0x306666]
      2021-09-14T02:48:47.040413-07:00 CRITICAL    #17 /opt/couchbase/bin/memcached() [0x400000+0x60ae52]
      2021-09-14T02:48:47.040414-07:00 CRITICAL    #18 /opt/couchbase/bin/memcached() [0x400000+0x607f75]
      2021-09-14T02:48:47.040415-07:00 CRITICAL    #19 /opt/couchbase/bin/memcached() [0x400000+0x759b30]
      2021-09-14T02:48:47.040416-07:00 CRITICAL    #20 /opt/couchbase/bin/memcached() [0x400000+0x7418ea]
      2021-09-14T02:48:47.040417-07:00 CRITICAL    #21 /opt/couchbase/bin/memcached() [0x400000+0x75cae9]
      2021-09-14T02:48:47.040418-07:00 CRITICAL    #22 /opt/couchbase/bin/memcached() [0x400000+0x607c04]
      2021-09-14T02:48:47.040420-07:00 CRITICAL    #23 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f039a293000+0xcdd40]
      2021-09-14T02:48:47.040421-07:00 CRITICAL    #24 /lib64/libpthread.so.0() [0x7f039c179000+0x7e65]
      2021-09-14T02:48:47.040422-07:00 CRITICAL    #25 /lib64/libc.so.6(clone+0x6d) [0x7f03999ab000+0xfe88d]
      2021-09-14T03:04:04.806122-07:00 CRITICAL *** Fatal error encountered during exception handling ***
      2021-09-14T03:04:04.806157-07:00 CRITICAL Caught unhandled std::exception-derived exception. what(): Monotonic<m> (unlabelled) invariant failed: new value (0) breaks invariant on current value (3260)
      2021-09-14T03:04:04.806160-07:00 CRITICAL Exception thrown from:
      2021-09-14T03:04:04.806198-07:00 CRITICAL     #0  /opt/couchbase/bin/memcached() [0x400000+0x95207]
      2021-09-14T03:04:04.806219-07:00 CRITICAL     #1  /opt/couchbase/bin/memcached() [0x400000+0xc3c47]
      2021-09-14T03:04:04.806263-07:00 CRITICAL     #2  /opt/couchbase/bin/memcached() [0x400000+0x3ef06d]
      2021-09-14T03:04:04.806300-07:00 CRITICAL     #3  /opt/couchbase/bin/memcached() [0x400000+0x4524f2]
      2021-09-14T03:04:04.806314-07:00 CRITICAL     #4  /opt/couchbase/bin/memcached() [0x400000+0x452f76]
      2021-09-14T03:04:04.806333-07:00 CRITICAL     #5  /opt/couchbase/bin/memcached() [0x400000+0x3eb3ba]
      2021-09-14T03:04:04.806345-07:00 CRITICAL     #6  /opt/couchbase/bin/memcached() [0x400000+0x3ec981]
      2021-09-14T03:04:04.806361-07:00 CRITICAL     #7  /opt/couchbase/bin/memcached() [0x400000+0x306666]
      2021-09-14T03:04:04.806382-07:00 CRITICAL     #8  /opt/couchbase/bin/memcached() [0x400000+0x60ae52]
      2021-09-14T03:04:04.806418-07:00 CRITICAL     #9  /opt/couchbase/bin/memcached() [0x400000+0x607f75]
      2021-09-14T03:04:04.806440-07:00 CRITICAL     #10 /opt/couchbase/bin/memcached() [0x400000+0x759b30]
      2021-09-14T03:04:04.806466-07:00 CRITICAL     #11 /opt/couchbase/bin/memcached() [0x400000+0x7418ea]
      2021-09-14T03:04:04.806493-07:00 CRITICAL     #12 /opt/couchbase/bin/memcached() [0x400000+0x75cae9]
      2021-09-14T03:04:04.806516-07:00 CRITICAL     #13 /opt/couchbase/bin/memcached() [0x400000+0x607c04]
      2021-09-14T03:04:04.806569-07:00 CRITICAL     #14 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f0a5cc53000+0xcdd40]
      2021-09-14T03:04:04.806576-07:00 CRITICAL     #15 /lib64/libpthread.so.0() [0x7f0a5eb39000+0x7e65]
      2021-09-14T03:04:04.806609-07:00 CRITICAL     #16 /lib64/libc.so.6(clone+0x6d) [0x7f0a5c36b000+0xfe88d]
      2021-09-14T03:04:05.123688-07:00 CRITICAL *** Fatal error encountered during exception handling ***
      2021-09-14T03:04:05.336537-07:00 CRITICAL Detected previous crash
      2021-09-14T03:04:05.336580-07:00 CRITICAL Breakpad caught a crash (Couchbase version 7.1.0-1277). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/588da9bd-b72c-4133-14d1a9b4-c8293217.dmp before terminating.
      2021-09-14T03:04:05.336590-07:00 CRITICAL Stack backtrace of crashed thread:
      2021-09-14T03:04:05.336591-07:00 CRITICAL    #0  /opt/couchbase/bin/memcached() [0x400000+0x68c438]
      2021-09-14T03:04:05.336593-07:00 CRITICAL    #1  /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ea) [0x400000+0x6e1a4a]
      2021-09-14T03:04:05.336594-07:00 CRITICAL    #2  /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x400000+0x6e1d88]
      2021-09-14T03:04:05.336596-07:00 CRITICAL    #3  /lib64/libpthread.so.0() [0x7f0a5eb39000+0xf5f0]
      2021-09-14T03:04:05.336597-07:00 CRITICAL    #4  /lib64/libc.so.6(gsignal+0x37) [0x7f0a5c36b000+0x36337]
      2021-09-14T03:04:05.336598-07:00 CRITICAL    #5  /lib64/libc.so.6(abort+0x148) [0x7f0a5c36b000+0x37a28]
      2021-09-14T03:04:05.336599-07:00 CRITICAL    #6  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f0a5cc53000+0x9963c]
      2021-09-14T03:04:05.336600-07:00 CRITICAL    #7  /opt/couchbase/bin/memcached() [0x400000+0x699a3b]
      2021-09-14T03:04:05.336602-07:00 CRITICAL    #8  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f0a5cc53000+0xa48f6]
      2021-09-14T03:04:05.336603-07:00 CRITICAL    #9  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f0a5cc53000+0xa4961]
      2021-09-14T03:04:05.336610-07:00 CRITICAL    #10 /opt/couchbase/bin/../lib/libstdc++.so.6(__cxa_rethrow+0x46) [0x7f0a5cc53000+0xa4c46]
      2021-09-14T03:04:05.336611-07:00 CRITICAL    #11 /opt/couchbase/bin/memcached() [0x400000+0xc3efe]
      2021-09-14T03:04:05.336612-07:00 CRITICAL    #12 /opt/couchbase/bin/memcached() [0x400000+0x4524f2]
      2021-09-14T03:04:05.336652-07:00 CRITICAL    #13 /opt/couchbase/bin/memcached() [0x400000+0x452f76]
      2021-09-14T03:04:05.336655-07:00 CRITICAL    #14 /opt/couchbase/bin/memcached() [0x400000+0x3eb3ba]
      2021-09-14T03:04:05.336656-07:00 CRITICAL    #15 /opt/couchbase/bin/memcached() [0x400000+0x3ec981]
      2021-09-14T03:04:05.336659-07:00 CRITICAL    #16 /opt/couchbase/bin/memcached() [0x400000+0x306666]
      2021-09-14T03:04:05.336661-07:00 CRITICAL    #17 /opt/couchbase/bin/memcached() [0x400000+0x60ae52]
      2021-09-14T03:04:05.336664-07:00 CRITICAL    #18 /opt/couchbase/bin/memcached() [0x400000+0x607f75]
      2021-09-14T03:04:05.336665-07:00 CRITICAL    #19 /opt/couchbase/bin/memcached() [0x400000+0x759b30]
      2021-09-14T03:04:05.336683-07:00 CRITICAL    #20 /opt/couchbase/bin/memcached() [0x400000+0x7418ea]
      2021-09-14T03:04:05.336685-07:00 CRITICAL    #21 /opt/couchbase/bin/memcached() [0x400000+0x75cae9]
      2021-09-14T03:04:05.336720-07:00 CRITICAL    #22 /opt/couchbase/bin/memcached() [0x400000+0x607c04]
      2021-09-14T03:04:05.336739-07:00 CRITICAL    #23 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7f0a5cc53000+0xcdd40]
      2021-09-14T03:04:05.336740-07:00 CRITICAL    #24 /lib64/libpthread.so.0() [0x7f0a5eb39000+0x7e65]
      2021-09-14T03:04:05.336742-07:00 CRITICAL    #25 /lib64/libc.so.6(clone+0x6d) [0x7f0a5c36b000+0xfe88d]
      2021-09-14T03:04:38.541797-07:00 CRITICAL *** Fatal error encountered during exception handling ***
      2021-09-14T03:04:38.541828-07:00 CRITICAL Caught unhandled std::exception-derived exception. what(): Monotonic<m> (unlabelled) invariant failed: new value (0) breaks invariant on current value (2464)
      2021-09-14T03:04:38.541831-07:00 CRITICAL Exception thrown from:
      2021-09-14T03:04:38.541867-07:00 CRITICAL     #0  /opt/couchbase/bin/memcached() [0x400000+0x95207]
      2021-09-14T03:04:38.541889-07:00 CRITICAL     #1  /opt/couchbase/bin/memcached() [0x400000+0xc3c47]
      2021-09-14T03:04:38.541907-07:00 CRITICAL     #2  /opt/couchbase/bin/memcached() [0x400000+0x3ef06d]
      2021-09-14T03:04:38.541931-07:00 CRITICAL     #3  /opt/couchbase/bin/memcached() [0x400000+0x4524f2]
      2021-09-14T03:04:38.541951-07:00 CRITICAL     #4  /opt/couchbase/bin/memcached() [0x400000+0x452f76]
      2021-09-14T03:04:38.541972-07:00 CRITICAL     #5  /opt/couchbase/bin/memcached() [0x400000+0x3eb3ba]
      2021-09-14T03:04:38.541984-07:00 CRITICAL     #6  /opt/couchbase/bin/memcached() [0x400000+0x3ec981]
      2021-09-14T03:04:38.541998-07:00 CRITICAL     #7  /opt/couchbase/bin/memcached() [0x400000+0x306666]
      2021-09-14T03:04:38.542021-07:00 CRITICAL     #8  /opt/couchbase/bin/memcached() [0x400000+0x60ae52]
      2021-09-14T03:04:38.542047-07:00 CRITICAL     #9  /opt/couchbase/bin/memcached() [0x400000+0x607f75]
      2021-09-14T03:04:38.542070-07:00 CRITICAL     #10 /opt/couchbase/bin/memcached() [0x400000+0x759b30]
      2021-09-14T03:04:38.542098-07:00 CRITICAL     #11 /opt/couchbase/bin/memcached() [0x400000+0x7418ea]
      2021-09-14T03:04:38.542160-07:00 CRITICAL     #12 /opt/couchbase/bin/memcached() [0x400000+0x75cae9]
      2021-09-14T03:04:38.542211-07:00 CRITICAL     #13 /opt/couchbase/bin/memcached() [0x400000+0x607c04]
      2021-09-14T03:04:38.542255-07:00 CRITICAL     #14 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fd768c5a000+0xcdd40]
      2021-09-14T03:04:38.542261-07:00 CRITICAL     #15 /lib64/libpthread.so.0() [0x7fd76ab40000+0x7e65]
      2021-09-14T03:04:39.000223-07:00 CRITICAL Detected previous crash
      2021-09-14T03:04:39.000276-07:00 CRITICAL Breakpad caught a crash (Couchbase version 7.1.0-1277). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/4d9d9eec-2bbe-4c10-0b514c91-b0786e42.dmp before terminating.
      2021-09-14T03:04:39.000289-07:00 CRITICAL Stack backtrace of crashed thread:
      2021-09-14T03:04:39.000291-07:00 CRITICAL    #0  /opt/couchbase/bin/memcached() [0x400000+0x68c438]
      2021-09-14T03:04:39.000293-07:00 CRITICAL    #1  /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ea) [0x400000+0x6e1a4a]
      2021-09-14T03:04:39.000294-07:00 CRITICAL    #2  /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x400000+0x6e1d88]
      2021-09-14T03:04:39.000296-07:00 CRITICAL    #3  /lib64/libpthread.so.0() [0x7fd76ab40000+0xf5f0]
      2021-09-14T03:04:39.000297-07:00 CRITICAL    #4  /lib64/libc.so.6(gsignal+0x37) [0x7fd768372000+0x36337]
      2021-09-14T03:04:39.000299-07:00 CRITICAL    #5  /lib64/libc.so.6(abort+0x148) [0x7fd768372000+0x37a28]
      2021-09-14T03:04:39.000301-07:00 CRITICAL    #6  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fd768c5a000+0x9963c]
      2021-09-14T03:04:39.000302-07:00 CRITICAL    #7  /opt/couchbase/bin/memcached() [0x400000+0x699a3b]
      2021-09-14T03:04:39.000304-07:00 CRITICAL    #8  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fd768c5a000+0xa48f6]
      2021-09-14T03:04:39.000305-07:00 CRITICAL    #9  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fd768c5a000+0xa4961]
      2021-09-14T03:04:39.000307-07:00 CRITICAL    #10 /opt/couchbase/bin/../lib/libstdc++.so.6(__cxa_rethrow+0x46) [0x7fd768c5a000+0xa4c46]
      2021-09-14T03:04:39.000319-07:00 CRITICAL    #11 /opt/couchbase/bin/memcached() [0x400000+0xc3efe]
      2021-09-14T03:04:39.000322-07:00 CRITICAL    #12 /opt/couchbase/bin/memcached() [0x400000+0x4524f2]
      2021-09-14T03:04:39.000324-07:00 CRITICAL    #13 /opt/couchbase/bin/memcached() [0x400000+0x452f76]
      2021-09-14T03:04:39.000326-07:00 CRITICAL    #14 /opt/couchbase/bin/memcached() [0x400000+0x3eb3ba]
      2021-09-14T03:04:39.000331-07:00 CRITICAL    #15 /opt/couchbase/bin/memcached() [0x400000+0x3ec981]
      2021-09-14T03:04:39.000341-07:00 CRITICAL    #16 /opt/couchbase/bin/memcached() [0x400000+0x306666]
      2021-09-14T03:04:39.000345-07:00 CRITICAL    #17 /opt/couchbase/bin/memcached() [0x400000+0x60ae52]
      2021-09-14T03:04:39.000347-07:00 CRITICAL    #18 /opt/couchbase/bin/memcached() [0x400000+0x607f75]
      2021-09-14T03:04:39.000348-07:00 CRITICAL    #19 /opt/couchbase/bin/memcached() [0x400000+0x759b30]
      2021-09-14T03:04:39.000353-07:00 CRITICAL    #20 /opt/couchbase/bin/memcached() [0x400000+0x7418ea]
      2021-09-14T03:04:39.000357-07:00 CRITICAL    #21 /opt/couchbase/bin/memcached() [0x400000+0x75cae9]
      2021-09-14T03:04:39.000360-07:00 CRITICAL    #22 /opt/couchbase/bin/memcached() [0x400000+0x607c04]
      2021-09-14T03:04:39.000364-07:00 CRITICAL    #23 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fd768c5a000+0xcdd40]
      2021-09-14T03:04:39.000366-07:00 CRITICAL    #24 /lib64/libpthread.so.0() [0x7fd76ab40000+0x7e65]
      2021-09-14T03:04:39.000368-07:00 CRITICAL    #25 /lib64/libc.so.6(clone+0x6d) [0x7fd768372000+0xfe88d]
      

       

       

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            asad.zaidi Asad Zaidi (Inactive)
            asad.zaidi Asad Zaidi (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty