Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-44062

SteadyStateTest: Caught unhandled std::exception-derived exception. what(): ThrowExceptionUnderflowPolicy current:4857252345881229119 arg:4859594435879554232

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      Stack Trace:
      -- 1. CHECKING ON SLAVE: 172.23.107.117 --
      /data/workspace/centos-p0-magma-vset00-00-basic_10gbvB_P0_7.0_P0/job_logs/testrunner-21-Jan-30_18-41-34/test_2/collectinfo-2021-01-31T030433-ns_1@172.23.106.122.zip

      Critical messages in memcached logs:

      2021-01-30T19:01:38.480068-08:00 CRITICAL *** Fatal error encountered during exception handling ***
      2021-01-30T19:01:38.480139-08:00 CRITICAL Caught unhandled std::exception-derived exception. what(): ThrowExceptionUnderflowPolicy current:4857252345881229119 arg:4859594435879554232
      2021-01-30T19:01:38.930512-08:00 CRITICAL Breakpad caught a crash (Couchbase version 7.0.0-4342). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/57b69006-a57c-4a5f-5ab3f88f-e4097e7f.dmp before terminating.
      2021-01-30T19:01:38.930542-08:00 CRITICAL Stack backtrace of crashed thread:
      2021-01-30T19:01:38.958107-08:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0x145bbd]
      2021-01-30T19:01:38.958145-08:00 CRITICAL     /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ea) [0x400000+0x15b3fa]
      2021-01-30T19:01:38.958171-08:00 CRITICAL     /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x400000+0x15b738]
      2021-01-30T19:01:38.958183-08:00 CRITICAL     /lib64/libpthread.so.0() [0x7fa8f3ad8000+0xf5f0]
      2021-01-30T19:01:38.958223-08:00 CRITICAL     /lib64/libc.so.6(gsignal+0x37) [0x7fa8f370a000+0x36337]
      2021-01-30T19:01:38.958257-08:00 CRITICAL     /lib64/libc.so.6(abort+0x148) [0x7fa8f370a000+0x37a28]
      2021-01-30T19:01:38.958293-08:00 CRITICAL     /opt/couchbase/bin/../lib/libstdc++.so.6(_ZN9__gnu_cxx27__verbose_terminate_handlerEv+0x125) [0x7fa8f420d000+0x91195]
      2021-01-30T19:01:38.958325-08:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0x155632]
      2021-01-30T19:01:38.958342-08:00 CRITICAL     /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fa8f420d000+0x8ef86]
      2021-01-30T19:01:38.958364-08:00 CRITICAL     /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fa8f420d000+0x8efd1]
      2021-01-30T19:01:38.958377-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7fa8f7b39000+0x16dba3]
      2021-01-30T19:01:38.958386-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7fa8f7b39000+0x167c02]
      2021-01-30T19:01:38.958405-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7fa8f7b39000+0x2e5eb6]
      2021-01-30T19:01:38.958425-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7fa8f7b39000+0x2ce3aa]
      2021-01-30T19:01:38.958439-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7fa8f7b39000+0x2e8fd9]
      2021-01-30T19:01:38.958448-08:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7fa8f7b39000+0x166043]
      2021-01-30T19:01:38.958490-08:00 CRITICAL     /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fa8f420d000+0xb9dcf]
      2021-01-30T19:01:38.958496-08:00 CRITICAL     /lib64/libpthread.so.0() [0x7fa8f3ad8000+0x7e65]
      2021-01-30T19:01:38.958540-08:00 CRITICAL     /lib64/libc.so.6(clone+0x6d) [0x7fa8f370a000+0xfe88d]
      

      172.23.106.122: Stack Trace of first crash - 57b69006-a57c-4a5f-5ab3f88f-e4097e7f.dmp

      Core was generated by `/opt/couchbase/bin/memcached -C /opt/couchbase/var/lib/couchbase/config/memcach'.
       #0  0x00007fa8f3740337 in raise () from /lib64/libc.so.6
       #0  0x00007fa8f3740337 in raise () from /lib64/libc.so.6
       No symbol table info available.
       #1  0x00007fa8f3741a28 in abort () from /lib64/libc.so.6
       No symbol table info available.
       #2  0x00007fa8f429e195 in __gnu_cxx::__verbose_terminate_handler() () from /opt/couchbase/bin/../lib/libstdc++.so.6
       No symbol table info available.
       #3  0x0000000000555632 in backtrace_terminate_handler() ()
       No symbol table info available.
       #4  0x00007fa8f429bf86 in __cxxabiv1::__terminate(void (*)()) () from /opt/couchbase/bin/../lib/libstdc++.so.6
       No symbol table info available.
       #5  0x00007fa8f429bfd1 in std::terminate() () from /opt/couchbase/bin/../lib/libstdc++.so.6
       No symbol table info available.
       #6  0x00007fa8f7ca6ba3 in GlobalTask::execute() () from /opt/couchbase/bin/../lib/libep.so
       No symbol table info available.
       #7  0x00007fa8f7ca0c02 in void folly::detail::function::FunctionTraits<void ()>::callSmall<FollyExecutorPool::TaskProxy::scheduleViaCPUPool()::{lambda()#1}>(folly::detail::function::Data&) () from /opt/couchbase/bin/../lib/libep.so
       No symbol table info available.
       #8  0x00007fa8f7e1eeb6 in folly::ThreadPoolExecutor::runTask(std::shared_ptr<folly::ThreadPoolExecutor::Thread> const&, folly::ThreadPoolExecutor::Task&&) () from /opt/couchbase/bin/../lib/libep.so
       No symbol table info available.
       #9  0x00007fa8f7e073aa in folly::CPUThreadPoolExecutor::threadRun(std::shared_ptr<folly::ThreadPoolExecutor::Thread>) () from /opt/couchbase/bin/../lib/libep.so
       No symbol table info available.
       #10 0x00007fa8f7e21fd9 in void folly::detail::function::FunctionTraits<void ()>::callBig<std::_Bind<void (folly::ThreadPoolExecutor::*(folly::ThreadPoolExecutor*, std::shared_ptr<folly::ThreadPoolExecutor::Thread>))(std::shared_ptr<folly::ThreadPoolExecutor::Thread>)> >(folly::detail::function::Data&) () from /opt/couchbase/bin/../lib/libep.so
       No symbol table info available.
       #11 0x00007fa8f7c9f043 in void folly::detail::function::FunctionTraits<void ()>::callBig<folly::PriorityThreadFactory::newThread(folly::Function<void ()>&&)::{lambda()#1}>(folly::detail::function::Data&) () from /opt/couchbase/bin/../lib/libep.so
       No symbol table info available.
       #12 0x00007fa8f42c6dcf in execute_native_thread_routine () from /opt/couchbase/bin/../lib/libstdc++.so.6
       No symbol table info available.
       #13 0x00007fa8f3adfe65 in start_thread () from /lib64/libpthread.so.0
       No symbol table info available.
       #14 0x00007fa8f380888d in clone () from /lib64/libc.so.6
       No symbol table info available.
      

      Thread dumps attached for both the nodes in the same file.

      QE Test:

      guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/testexec.99493.ini disable_magma_commit_points=True,bucket_storage=magma,GROUP=P0,bucket_eviction_policy=fullEviction,randomize_value=True,rerun=false,replicas=0,sdk_timeout=60,get-cbcollect-info=True,infra_log_level=critical,log_level=error,upgrade_version=7.0.0-4342 -t epengine.basic_ops.basic_ops.test_doc_size,doc_size=0,upgrade_version=7.0.0-4342,doc_type=json,rerun=false,GROUP=P0,disable_magma_commit_points=True,sdk_timeout=60,get-cbcollect-info=True,replicas=0,doc_op=update,bucket_storage=magma,log_level=error,vbuckets=2,bucket_eviction_policy=fullEviction,nodes_init=2,num_items=20000000,randomize_value=True,infra_log_level=critical'
      

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              ritesh.agarwal Ritesh Agarwal
              ritesh.agarwal Ritesh Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty