Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-41718

memcached crashed in DcpProducer::getHighSeqnoOfCollections(Collections::VB::Filter const&, Vbid) const () from /opt/couchbase/bin/../lib/libep.so

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      On node: 172.23.107.50

      Core was generated by `/opt/couchbase/bin/memcached -C /opt/couchbase/var/lib/couchbase/config/memcach'.
      #0  0x00007f5bbb121074 in DcpProducer::getHighSeqnoOfCollections(Collections::VB::Filter const&, Vbid) const () from /opt/couchbase/bin/../lib/libep.so
      #0  0x00007f5bbb121074 in DcpProducer::getHighSeqnoOfCollections(Collections::VB::Filter const&, Vbid) const () from /opt/couchbase/bin/../lib/libep.so
      #1  0x00007f5bbb122783 in DcpProducer::streamRequest(unsigned int, unsigned int, Vbid, unsigned long, unsigned long, unsigned long, unsigned long, unsigned long, unsigned long*, ENGINE_ERROR_CODE (*)(vbucket_failover_t*, unsigned long, gsl::not_null<void const*>), std::optional<std::basic_string_view<char, std::char_traits<char> > >) () from /opt/couchbase/bin/../lib/libep.so
      #2  0x00007f5bbb174340 in EventuallyPersistentEngine::stream_req(gsl::not_null<void const*>, unsigned int, unsigned int, Vbid, unsigned long, unsigned long, unsigned long, unsigned long, unsigned long, unsigned long*, ENGINE_ERROR_CODE (*)(vbucket_failover_t*, unsigned long, gsl::not_null<void const*>), std::optional<std::basic_string_view<char, std::char_traits<char> > >) () from /opt/couchbase/bin/../lib/libep.so
      #3  0x000000000046fd34 in dcpStreamReq(Cookie&, unsigned int, unsigned int, Vbid, unsigned long, unsigned long, unsigned long, unsigned long, unsigned long, unsigned long*, ENGINE_ERROR_CODE (*)(vbucket_failover_t*, unsigned long, gsl::not_null<void const*>), std::optional<std::basic_string_view<char, std::char_traits<char> > >) ()
      #4  0x00000000004decac in dcp_stream_req_executor(Cookie&) ()
      #5  0x00000000004c8c76 in execute_client_request_packet(Cookie&, cb::mcbp::Request const&) ()
      #6  0x00000000004b7d09 in Cookie::execute() ()
      #7  0x00000000004a04fd in Connection::executeCommandPipeline() ()
      #8  0x00000000004a3c48 in Connection::executeCommandsCallback() ()
      #9  0x00000000004a4475 in Connection::rw_callback(bufferevent*, void*) ()
      #10 0x00007f5bb8bd0d8e in bufferevent_run_deferred_callbacks_unlocked () from /opt/couchbase/bin/../lib/libevent_core-2.1.so.7
      #11 0x00007f5bb8bd9d01 in event_process_active_single_queue.isra.31 () from /opt/couchbase/bin/../lib/libevent_core-2.1.so.7
      #12 0x00007f5bb8bda54f in event_base_loop () from /opt/couchbase/bin/../lib/libevent_core-2.1.so.7
      #13 0x0000000000487de9 in worker_libevent(void*) ()
      #14 0x00007f5bb9b09947 in platform_thread_wrap(void*) () from /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0
      #15 0x00007f5bb734edd5 in start_thread () from /lib64/libpthread.so.0
      #16 0x00007f5bb7077ead in epoll_wait () from /lib64/libc.so.6
      #17 0x0000000000000000 in ?? ()
      

      Memcahced msgs on .50

      2020-09-27T00:34:45.132961-07:00 CRITICAL Breakpad caught a crash (Couchbase version 7.0.0-3216). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/a3494228-cd68-46a0-c9d4fbac-1e6fc1d1.dmp before terminating.
      2020-09-27T00:34:45.133002-07:00 CRITICAL Stack backtrace of crashed thread:
      2020-09-27T00:34:45.133244-07:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0x19422d]
      2020-09-27T00:34:45.133261-07:00 CRITICAL     /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ea) [0x400000+0x1aa5aa]
      2020-09-27T00:34:45.133275-07:00 CRITICAL     /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x400000+0x1aa8e8]
      2020-09-27T00:34:45.133282-07:00 CRITICAL     /lib64/libpthread.so.0() [0x7f5bb7347000+0xf5d0]
      2020-09-27T00:34:45.133293-07:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7f5bbb031000+0xf0074]
      2020-09-27T00:34:45.133301-07:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7f5bbb031000+0xf1783]
      2020-09-27T00:34:45.133309-07:00 CRITICAL     /opt/couchbase/bin/../lib/libep.so() [0x7f5bbb031000+0x143340]
      2020-09-27T00:34:45.133321-07:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0x6fd34]
      2020-09-27T00:34:45.133333-07:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0xdecac]
      2020-09-27T00:34:45.133344-07:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0xc8c76]
      2020-09-27T00:34:45.133353-07:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0xb7d09]
      2020-09-27T00:34:45.133362-07:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0xa04fd]
      2020-09-27T00:34:45.133371-07:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0xa3c48]
      2020-09-27T00:34:45.133379-07:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0xa4475]
      2020-09-27T00:34:45.133387-07:00 CRITICAL     /opt/couchbase/bin/../lib/libevent_core-2.1.so.7() [0x7f5bb8bc2000+0xed8e]
      2020-09-27T00:34:45.133422-07:00 CRITICAL     /opt/couchbase/bin/../lib/libevent_core-2.1.so.7() [0x7f5bb8bc2000+0x17d01]
      2020-09-27T00:34:45.133427-07:00 CRITICAL     /opt/couchbase/bin/../lib/libevent_core-2.1.so.7(event_base_loop+0x3bf) [0x7f5bb8bc2000+0x1854f]
      2020-09-27T00:34:45.133436-07:00 CRITICAL     /opt/couchbase/bin/memcached() [0x400000+0x87de9]
      2020-09-27T00:34:45.133492-07:00 CRITICAL     /opt/couchbase/bin/../lib/libplatform_so.so.0.1.0() [0x7f5bb9af9000+0x10947]
      2020-09-27T00:34:45.133498-07:00 CRITICAL     /lib64/libpthread.so.0() [0x7f5bb7347000+0x7dd5]
      2020-09-27T00:34:45.133534-07:00 CRITICAL     /lib64/libc.so.6(clone+0x6d) [0x7f5bb6f7a000+0xfdead]
      

      QE Test:

      <testcase name="cbas.cbas_bucket_operations.CBASBucketOperations.compact_cb_bucket_with_cbas_connected,cluster:D,cb_bucket_name:default,cluster_name:testexec.90600,get-cbcollect-info:False,ini:/tmp/testexec.90600.ini,replicas:0,durability:MAJORITY,log_level:debug,conf_file:conf/cbas/py-cbas-functional-tests.conf,upgrade_version:7.0.0-3216,cbas_dataset_name:default_ds,compression_mode:active,rerun:True,spec:py-cbas-functional-tests,num_nodes:4,logs_folder:/data/workspace/centos-p0-durability-vset00-00-service_cbas_6.5_P1_majority/logs/testrunner-20-Sep-26_23-55-42/test_20,GROUP:P1;durability,cbas_bucket_name:default_bucket,num_items:10000,case_number:20,infra_log_level:critical" time="832.962000132">
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            umang.agrawal Umang
            ritesh.agarwal Ritesh Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty