Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-45402

Incomplete breakpad crash-dump

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Critical
    • None
    • Cheshire-Cat
    • couchbase-bucket
    • None
    • Triaged
    • 1
    • Unknown

    Description

      Crash dump from MB-45347, https://issues.couchbase.com/secure/attachment/133423/ee5bc93b-0b30-4451-59a81ab4-b597ecd8.dmp

      Node .97.119 reported:

      2021-03-30T13:31:05.556051-07:00 CRITICAL *** Fatal error encountered during exception handling ***
      2021-03-30T13:31:05.556101-07:00 CRITICAL Caught unhandled std::exception-derived exception. what(): Collections::VB::Manifest::verifyFlatbuffersData: getCreateScopeEventData data invalid, ptr:0x7fa7adaa1749, size:0
      2021-03-30T13:31:05.829086-07:00 CRITICAL Breakpad caught a crash (Couchbase version 7.0.0-4809). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/ee5bc93b-0b30-4451-59a81ab4-b597ecd8.dmp before terminating.
      2021-03-30T13:31:05.829119-07:00 CRITICAL Stack backtrace of crashed thread:
      2021-03-30T13:31:05.829311-07:00 CRITICAL     #0  /opt/couchbase/bin/memcached() [0x400000+0x14a96d]
      2021-03-30T13:31:05.829321-07:00 CRITICAL     #1  /opt/couchbase/bin/../lib/libdefault_engine.so(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ea) [0x7fa859dc3000+0x308ca]
      2021-03-30T13:31:05.829326-07:00 CRITICAL     #2  /opt/couchbase/bin/../lib/libdefault_engine.so(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x7fa859dc3000+0x30c08]
      2021-03-30T13:31:05.829332-07:00 CRITICAL     #3  /lib64/libpthread.so.0() [0x7fa855876000+0xf370]
      2021-03-30T13:31:05.829353-07:00 CRITICAL     #4  /lib64/libc.so.6(gsignal+0x37) [0x7fa8554b5000+0x351d7]
      2021-03-30T13:31:05.829370-07:00 CRITICAL     #5  /lib64/libc.so.6(abort+0x148) [0x7fa8554b5000+0x368c8]
      2021-03-30T13:31:05.829397-07:00 CRITICAL     #6  /opt/couchbase/bin/../lib/libstdc++.so.6(_ZN9__gnu_cxx27__verbose_terminate_handlerEv+0x125) [0x7fa855fab000+0x91195]
      2021-03-30T13:31:05.829405-07:00 CRITICAL     #7  /opt/couchbase/bin/memcached() [0x400000+0x159a62]
      2021-03-30T13:31:05.829419-07:00 CRITICAL     #8  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fa855fab000+0x8ef86]
      2021-03-30T13:31:05.829433-07:00 CRITICAL     #9  /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fa855fab000+0x8efd1]
      2021-03-30T13:31:05.829455-07:00 CRITICAL     #10 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fa855fab000+0xb9dfe]
      2021-03-30T13:31:05.829460-07:00 CRITICAL     #11 /lib64/libpthread.so.0() [0x7fa855876000+0x7dc5]
      2021-03-30T13:31:05.829487-07:00 CRITICAL     #12 /lib64/libc.so.6(clone+0x6d) [0x7fa8554b5000+0xf776d
      

      Opened in couchbaselabs/vagrants/cheshire-cat-testing/centos7 with 7.0.0-3809 EE and related debug symbols installed.

      Installed the correct glibc by:

      sudo rpm -Uvh https://vault.centos.org/7.3.1611/os/x86_64/Packages/glibc-2.17-157.el7.x86_64.rpm https://vault.centos.org/7.3.1611/os/x86_64/Packages/glibc-common-2.17-157.el7.x86_64.rpm https://vault.centos.org/7.3.1611/os/x86_64/Packages/glibc-devel-2.17-157.el7.x86_64.rpm https://vault.centos.org/7.3.1611/os/x86_64/Packages/glibc-headers-2.17-157.el7.x86_64.rpm
      

      Then:

      /opt/couchbase/bin/minidump-2-core ee5bc93b-0b30-4451-59a81ab4-b597ecd8.dmp > crash.core
       
      gdb /opt/couchbase/bin/memcached -c crash.core
       
      (gdb) bt
      #0  0x00007fa8554ea1d7 in raise () from /lib64/libc.so.6
      #1  0x00007fa8554eb8c8 in abort () from /lib64/libc.so.6
      #2  0x00007fa85603c195 in __gnu_cxx::__verbose_terminate_handler () at /tmp/deploy/gcc-7.3.0/libstdc++-v3/libsupc++/vterminate.cc:95
      #3  0x0000000000559a62 in backtrace_terminate_handler () at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/utilities/terminate_handler.cc:93
      #4  0x00007fa856039f86 in __cxxabiv1::__terminate (handler=<optimized out>) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/libsupc++/eh_terminate.cc:47
      #5  0x00007fa856039fd1 in std::terminate () at /tmp/deploy/gcc-7.3.0/libstdc++-v3/libsupc++/eh_terminate.cc:57
      #6  0x00007fa856064dfe in std::execute_native_thread_routine (__p=0x7fa850308a30) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:91
      #7  0x00007fa85587ddc5 in start_thread () from /lib64/libpthread.so.0
      #8  0x00007fa8555ac76d in __lseek_nocancel () from /lib64/libc.so.6
      #9  0x0000000000000000 in ?? ()
      

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              drigby Dave Rigby (Inactive)
              paolo.cocchi Paolo Cocchi
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty