GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-119.el7 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /opt/couchbase/bin/memcached...Reading symbols from /usr/lib/debug/opt/couchbase/bin/memcached.debug...done. done. [New LWP 107926] [New LWP 107393] [New LWP 107433] [New LWP 107434] [New LWP 107435] [New LWP 107436] [New LWP 107437] [New LWP 107438] [New LWP 107439] [New LWP 107440] [New LWP 107441] [New LWP 107442] [New LWP 107443] [New LWP 107444] [New LWP 107445] [New LWP 107446] [New LWP 107447] [New LWP 107448] [New LWP 107449] [New LWP 107450] [New LWP 107451] [New LWP 107452] [New LWP 107453] [New LWP 107454] [New LWP 107913] [New LWP 107914] [New LWP 107915] [New LWP 107916] [New LWP 107917] [New LWP 107918] [New LWP 107919] [New LWP 107920] [New LWP 107921] [New LWP 107922] [New LWP 107923] [New LWP 107924] [New LWP 107925] [New LWP 107927] [New LWP 107928] To enable execution of this file add add-auto-load-safe-path /usr/lib64/libthread_db-1.0.so line to your configuration file "/root/.gdbinit". To completely disable this security protection add set auto-load safe-path / line to your configuration file "/root/.gdbinit". For more information about this security protection see the "Auto-loading safe path" section in the GDB manual. E.g., run from the shell: info "(gdb)Auto-loading safe path" Core was generated by `/opt/couchbase/bin/memcached -C /opt/couchbase/var/lib/couchbase/config/memcach'. #0 0x00007f34b2450387 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:55 55 return INLINE_SYSCALL (tgkill, 3, pid, selftid, sig); Thread 39 (LWP 107928): #0 0x00007f34b2518eb3 in epoll_wait () at ../sysdeps/unix/syscall-template.S:81 #1 0x00007f34b4da83c5 in epoll_dispatch (base=0x6170000afe80, tv=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/epoll.c:465 #2 0x00007f34b4d9f376 in event_base_loop (base=0x6170000afe80, flags=1) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:1998 #3 0x00007f34bd58eaa7 in folly::EventBase::loopBody (this=this@entry=0x6160000c0080, flags=flags@entry=0, ignoreKeepAlive=ignoreKeepAlive@entry=false) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/io/async/EventBase.cpp:397 #4 0x00007f34bd58ef76 in folly::EventBase::loop (this=this@entry=0x6160000c0080) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/io/async/EventBase.cpp:315 #5 0x00007f34bd590936 in folly::EventBase::loopForever (this=0x6160000c0080) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/io/async/EventBase.cpp:538 #6 0x00007f34bd57de09 in folly::IOThreadPoolExecutor::threadRun (this=0x6160000afe80, thread=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/IOThreadPoolExecutor.cpp:195 #7 0x00007f34bd5896e9 in __invoke_impl), folly::ThreadPoolExecutor*&, std::shared_ptr&> ( __t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #8 __invoke), folly::ThreadPoolExecutor*&, std::shared_ptr&> (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #9 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #10 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #11 folly::detail::function::FunctionTraits::callBig))(std::shared_ptr)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401 #12 0x00007f34bcc8d704 in operator() (this=0x60b00005c1a0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #13 operator() (__closure=0x60b00005c1a0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/NamedThreadFactory.h:40 #14 __invoke_impl > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #15 __invoke > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #16 _M_invoke<0> (this=0x60b00005c1a0) at /usr/local/include/c++/7.3.0/thread:234 #17 operator() (this=0x60b00005c1a0) at /usr/local/include/c++/7.3.0/thread:243 #18 std::thread::_State_impl&&)::{lambda()#1}> > >::_M_run() (this=0x60b00005c190) at /usr/local/include/c++/7.3.0/thread:186 #19 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60b00005c190) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #20 0x00007f34b27efea5 in start_thread (arg=0x7f3498aac700) at pthread_create.c:307 #21 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 38 (LWP 107927): #0 0x00007f34c1738d5e in ?? () from /opt/couchbase/bin/../lib/libasan.so.4 #1 0x00007f34c17eafe0 in operator new(unsigned long) () from /opt/couchbase/bin/../lib/libasan.so.4 #2 0x00007f34bc5e1e3a in allocate (__n=, this=0x7f34992bb6c8) at /usr/local/include/c++/7.3.0/ext/new_allocator.h:111 #3 allocate (__n=, __a=...) at /usr/local/include/c++/7.3.0/bits/alloc_traits.h:436 #4 _M_allocate (__n=, this=0x7f34992bb6c8) at /usr/local/include/c++/7.3.0/bits/stl_vector.h:172 #5 std::vector >, std::allocator > > >::_M_realloc_insert > const&> (this=this@entry=0x7f34992bb6c8, __position=..., __args#0=...) at /usr/local/include/c++/7.3.0/bits/vector.tcc:406 #6 0x00007f34bc5d5546 in push_back (__x=..., this=0x7f34992bb6c8) at /usr/local/include/c++/7.3.0/bits/stl_vector.h:948 #7 CheckpointManager::getItemsForCursor (this=this@entry=0x613000b57440, cursorPtr=, items=..., approxLimit=approxLimit@entry=18446744073709551615) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/checkpoint_manager.cc:1060 #8 0x00007f34bc5d8c08 in CheckpointManager::getNextItemsForCursor (this=this@entry=0x613000b57440, cursor=, items=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/checkpoint_manager.cc:992 #9 0x00007f34bc655bab in ActiveStream::getOutstandingItems (this=0x61800054a890, vb=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/dcp/active_stream.cc:1054 #10 0x00007f34bc67f962 in ActiveStream::nextCheckpointItemTask (this=0x61800054a890, streamMutex=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/dcp/active_stream.cc:1034 #11 0x00007f34bc68032c in ActiveStream::nextCheckpointItemTask (this=this@entry=0x61800054a890) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/dcp/active_stream.cc:1020 #12 0x00007f34bc6c8dc2 in ActiveStreamCheckpointProcessorTask::run (this=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/dcp/active_stream_checkpoint_processor_task.cc:57 #13 0x00007f34bccd3577 in GlobalTask::execute (this=this@entry=0x613000ad7bd0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/globaltask.cc:74 #14 0x00007f34bcca5fc6 in FollyExecutorPool::TaskProxy::scheduleViaCPUPool()::{lambda()#1}::operator()() const (__closure=0x7f34992bc830) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/folly_executorpool.cc:167 #15 0x00007f34bd5865c6 in operator() (this=0x7f34992bc830) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:416 #16 folly::ThreadPoolExecutor::runTask(std::shared_ptr const&, folly::ThreadPoolExecutor::Task&&) (this=0x61e000158480, thread=..., task=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/ThreadPoolExecutor.cpp:98 #17 0x00007f34bd56ea0a in folly::CPUThreadPoolExecutor::threadRun (this=0x61e000158480, thread=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/CPUThreadPoolExecutor.cpp:265 #18 0x00007f34bd5896e9 in __invoke_impl), folly::ThreadPoolExecutor*&, std::shared_ptr&> ( __t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #19 __invoke), folly::ThreadPoolExecutor*&, std::shared_ptr&> (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #20 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #21 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #22 folly::detail::function::FunctionTraits::callBig))(std::shared_ptr)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401 #23 0x00007f34bcc92c59 in operator() (this=0x6070008e93f0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #24 operator() (__closure=0x6070008e93e0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/PriorityThreadFactory.h:54 #25 folly::detail::function::FunctionTraits::callBig&&)::{lambda()#1}>(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:401 #26 0x00007f34bcc8d704 in operator() (this=0x60b00005c040) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #27 operator() (__closure=0x60b00005c040) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/NamedThreadFactory.h:40 #28 __invoke_impl > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #29 __invoke > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #30 _M_invoke<0> (this=0x60b00005c040) at /usr/local/include/c++/7.3.0/thread:234 #31 operator() (this=0x60b00005c040) at /usr/local/include/c++/7.3.0/thread:243 #32 std::thread::_State_impl&&)::{lambda()#1}> > >::_M_run() (this=0x60b00005c030) at /usr/local/include/c++/7.3.0/thread:186 #33 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60b00005c030) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #34 0x00007f34b27efea5 in start_thread (arg=0x7f34992d4700) at pthread_create.c:307 #35 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 37 (LWP 107925): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f34bd56944d in nativeFutexWaitImpl (waitMask=, absSteadyTime=, absSystemTime=, expected=, addr=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:123 #2 folly::detail::futexWaitImpl (futex=, expected=, absSystemTime=, absSteadyTime=, waitMask=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:254 #3 0x00007f34bc964a07 in futexWaitImpl const, std::chrono::time_point > > > (waitMask=, deadline=..., expected=, futex=0x7f349ebe7c80) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:85 #4 folly::detail::futexWaitUntil, std::chrono::_V2::steady_clock, std::chrono::duration > > (futex=, expected=, deadline=..., waitMask=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:123 #5 0x00007f34bd575fed in folly::SaturatingSemaphore::tryWaitSlow > > (this=0x7f349ebe7c80, deadline=..., opt=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/MemoryIdler.h:164 #6 0x00007f34bd576656 in folly::detail::LifoSemBase, std::atomic>::try_wait_until > > ( this=0x6160000b0840, deadline=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/SaturatingSemaphore.h:179 #7 0x00007f34bd579db0 in folly::UnboundedBlockingQueue::try_take_for (this=0x6160000b0800, time=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/LifoSem.h:498 #8 0x00007f34bd56e997 in folly::CPUThreadPoolExecutor::threadRun (this=0x61e000157880, thread=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/CPUThreadPoolExecutor.cpp:243 #9 0x00007f34bd5896e9 in __invoke_impl), folly::ThreadPoolExecutor*&, std::shared_ptr&> ( __t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #10 __invoke), folly::ThreadPoolExecutor*&, std::shared_ptr&> (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #11 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #12 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #13 folly::detail::function::FunctionTraits::callBig))(std::shared_ptr)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401 #14 0x00007f34bcc92c59 in operator() (this=0x6070008e9230) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #15 operator() (__closure=0x6070008e9220) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/PriorityThreadFactory.h:54 #16 folly::detail::function::FunctionTraits::callBig&&)::{lambda()#1}>(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:401 #17 0x00007f34bcc8d704 in operator() (this=0x60b00005bee0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #18 operator() (__closure=0x60b00005bee0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/NamedThreadFactory.h:40 #19 __invoke_impl > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #20 __invoke > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #21 _M_invoke<0> (this=0x60b00005bee0) at /usr/local/include/c++/7.3.0/thread:234 #22 operator() (this=0x60b00005bee0) at /usr/local/include/c++/7.3.0/thread:243 #23 std::thread::_State_impl&&)::{lambda()#1}> > >::_M_run() (this=0x60b00005bed0) at /usr/local/include/c++/7.3.0/thread:186 #24 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60b00005bed0) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #25 0x00007f34b27efea5 in start_thread (arg=0x7f349a304700) at pthread_create.c:307 #26 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 36 (LWP 107924): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f34bd56944d in nativeFutexWaitImpl (waitMask=, absSteadyTime=, absSystemTime=, expected=, addr=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:123 #2 folly::detail::futexWaitImpl (futex=, expected=, absSystemTime=, absSteadyTime=, waitMask=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:254 #3 0x00007f34bc964a07 in futexWaitImpl const, std::chrono::time_point > > > (waitMask=, deadline=..., expected=, futex=0x7f349ebeacc8) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:85 #4 folly::detail::futexWaitUntil, std::chrono::_V2::steady_clock, std::chrono::duration > > (futex=, expected=, deadline=..., waitMask=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:123 #5 0x00007f34bd576127 in folly::SaturatingSemaphore::tryWaitSlow > > (this=0x7f349ebeacc8, deadline=..., opt=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/MemoryIdler.h:194 #6 0x00007f34bd576656 in folly::detail::LifoSemBase, std::atomic>::try_wait_until > > ( this=0x6160000b0540, deadline=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/SaturatingSemaphore.h:179 #7 0x00007f34bd579db0 in folly::UnboundedBlockingQueue::try_take_for (this=0x6160000b0500, time=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/LifoSem.h:498 #8 0x00007f34bd56e997 in folly::CPUThreadPoolExecutor::threadRun (this=0x61e000156c80, thread=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/CPUThreadPoolExecutor.cpp:243 #9 0x00007f34bd5896e9 in __invoke_impl), folly::ThreadPoolExecutor*&, std::shared_ptr&> ( __t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #10 __invoke), folly::ThreadPoolExecutor*&, std::shared_ptr&> (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #11 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #12 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #13 folly::detail::function::FunctionTraits::callBig))(std::shared_ptr)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401 #14 0x00007f34bcc92c59 in operator() (this=0x6070008e9150) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #15 operator() (__closure=0x6070008e9140) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/PriorityThreadFactory.h:54 #16 folly::detail::function::FunctionTraits::callBig&&)::{lambda()#1}>(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:401 #17 0x00007f34bcc8d704 in operator() (this=0x60b00005be30) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #18 operator() (__closure=0x60b00005be30) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/NamedThreadFactory.h:40 #19 __invoke_impl > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #20 __invoke > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #21 _M_invoke<0> (this=0x60b00005be30) at /usr/local/include/c++/7.3.0/thread:234 #22 operator() (this=0x60b00005be30) at /usr/local/include/c++/7.3.0/thread:243 #23 std::thread::_State_impl&&)::{lambda()#1}> > >::_M_run() (this=0x60b00005be20) at /usr/local/include/c++/7.3.0/thread:186 #24 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60b00005be20) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #25 0x00007f34b27efea5 in start_thread (arg=0x7f349ab1d700) at pthread_create.c:307 #26 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 35 (LWP 107923): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f34bd56944d in nativeFutexWaitImpl (waitMask=, absSteadyTime=, absSystemTime=, expected=, addr=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:123 #2 folly::detail::futexWaitImpl (futex=, expected=, absSystemTime=, absSteadyTime=, waitMask=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:254 #3 0x00007f34bc964a07 in futexWaitImpl const, std::chrono::time_point > > > (waitMask=, deadline=..., expected=, futex=0x7f349ebea9b0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:85 #4 folly::detail::futexWaitUntil, std::chrono::_V2::steady_clock, std::chrono::duration > > (futex=, expected=, deadline=..., waitMask=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:123 #5 0x00007f34bd576127 in folly::SaturatingSemaphore::tryWaitSlow > > (this=0x7f349ebea9b0, deadline=..., opt=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/MemoryIdler.h:194 #6 0x00007f34bd576656 in folly::detail::LifoSemBase, std::atomic>::try_wait_until > > ( this=0x6160000b0540, deadline=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/SaturatingSemaphore.h:179 #7 0x00007f34bd579db0 in folly::UnboundedBlockingQueue::try_take_for (this=0x6160000b0500, time=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/LifoSem.h:498 #8 0x00007f34bd56e997 in folly::CPUThreadPoolExecutor::threadRun (this=0x61e000156c80, thread=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/CPUThreadPoolExecutor.cpp:243 #9 0x00007f34bd5896e9 in __invoke_impl), folly::ThreadPoolExecutor*&, std::shared_ptr&> ( __t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #10 __invoke), folly::ThreadPoolExecutor*&, std::shared_ptr&> (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #11 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #12 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #13 folly::detail::function::FunctionTraits::callBig))(std::shared_ptr)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401 #14 0x00007f34bcc92c59 in operator() (this=0x6070008e90e0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #15 operator() (__closure=0x6070008e90d0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/PriorityThreadFactory.h:54 #16 folly::detail::function::FunctionTraits::callBig&&)::{lambda()#1}>(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:401 #17 0x00007f34bcc8d704 in operator() (this=0x60b00005bd80) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #18 operator() (__closure=0x60b00005bd80) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/NamedThreadFactory.h:40 #19 __invoke_impl > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #20 __invoke > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #21 _M_invoke<0> (this=0x60b00005bd80) at /usr/local/include/c++/7.3.0/thread:234 #22 operator() (this=0x60b00005bd80) at /usr/local/include/c++/7.3.0/thread:243 #23 std::thread::_State_impl&&)::{lambda()#1}> > >::_M_run() (this=0x60b00005bd70) at /usr/local/include/c++/7.3.0/thread:186 #24 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60b00005bd70) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #25 0x00007f34b27efea5 in start_thread (arg=0x7f349b335700) at pthread_create.c:307 #26 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 34 (LWP 107922): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f34bd56944d in nativeFutexWaitImpl (waitMask=, absSteadyTime=, absSystemTime=, expected=, addr=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:123 #2 folly::detail::futexWaitImpl (futex=, expected=, absSystemTime=, absSteadyTime=, waitMask=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:254 #3 0x00007f34bc964a07 in futexWaitImpl const, std::chrono::time_point > > > (waitMask=, deadline=..., expected=, futex=0x7f349ebead58) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:85 #4 folly::detail::futexWaitUntil, std::chrono::_V2::steady_clock, std::chrono::duration > > (futex=, expected=, deadline=..., waitMask=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:123 #5 0x00007f34bd576127 in folly::SaturatingSemaphore::tryWaitSlow > > (this=0x7f349ebead58, deadline=..., opt=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/MemoryIdler.h:194 #6 0x00007f34bd576656 in folly::detail::LifoSemBase, std::atomic>::try_wait_until > > ( this=0x6160000b0540, deadline=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/SaturatingSemaphore.h:179 #7 0x00007f34bd579db0 in folly::UnboundedBlockingQueue::try_take_for (this=0x6160000b0500, time=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/LifoSem.h:498 #8 0x00007f34bd56e997 in folly::CPUThreadPoolExecutor::threadRun (this=0x61e000156c80, thread=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/CPUThreadPoolExecutor.cpp:243 #9 0x00007f34bd5896e9 in __invoke_impl), folly::ThreadPoolExecutor*&, std::shared_ptr&> ( __t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #10 __invoke), folly::ThreadPoolExecutor*&, std::shared_ptr&> (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #11 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #12 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #13 folly::detail::function::FunctionTraits::callBig))(std::shared_ptr)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401 #14 0x00007f34bcc92c59 in operator() (this=0x6070008e9070) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #15 operator() (__closure=0x6070008e9060) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/PriorityThreadFactory.h:54 #16 folly::detail::function::FunctionTraits::callBig&&)::{lambda()#1}>(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:401 #17 0x00007f34bcc8d704 in operator() (this=0x60b00005bcd0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #18 operator() (__closure=0x60b00005bcd0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/NamedThreadFactory.h:40 #19 __invoke_impl > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #20 __invoke > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #21 _M_invoke<0> (this=0x60b00005bcd0) at /usr/local/include/c++/7.3.0/thread:234 #22 operator() (this=0x60b00005bcd0) at /usr/local/include/c++/7.3.0/thread:243 #23 std::thread::_State_impl&&)::{lambda()#1}> > >::_M_run() (this=0x60b00005bcc0) at /usr/local/include/c++/7.3.0/thread:186 #24 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60b00005bcc0) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #25 0x00007f34b27efea5 in start_thread (arg=0x7f349bb4d700) at pthread_create.c:307 #26 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 33 (LWP 107921): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f34bd56944d in nativeFutexWaitImpl (waitMask=, absSteadyTime=, absSystemTime=, expected=, addr=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:123 #2 folly::detail::futexWaitImpl (futex=, expected=, absSystemTime=, absSteadyTime=, waitMask=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:254 #3 0x00007f34bc964a07 in futexWaitImpl const, std::chrono::time_point > > > (waitMask=, deadline=..., expected=, futex=0x7f349ebeac38) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:85 #4 folly::detail::futexWaitUntil, std::chrono::_V2::steady_clock, std::chrono::duration > > (futex=, expected=, deadline=..., waitMask=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:123 #5 0x00007f34bd576127 in folly::SaturatingSemaphore::tryWaitSlow > > (this=0x7f349ebeac38, deadline=..., opt=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/MemoryIdler.h:194 #6 0x00007f34bd576656 in folly::detail::LifoSemBase, std::atomic>::try_wait_until > > ( this=0x6160000b0540, deadline=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/SaturatingSemaphore.h:179 #7 0x00007f34bd579db0 in folly::UnboundedBlockingQueue::try_take_for (this=0x6160000b0500, time=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/LifoSem.h:498 #8 0x00007f34bd56e997 in folly::CPUThreadPoolExecutor::threadRun (this=0x61e000156c80, thread=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/CPUThreadPoolExecutor.cpp:243 #9 0x00007f34bd5896e9 in __invoke_impl), folly::ThreadPoolExecutor*&, std::shared_ptr&> ( __t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #10 __invoke), folly::ThreadPoolExecutor*&, std::shared_ptr&> (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #11 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #12 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #13 folly::detail::function::FunctionTraits::callBig))(std::shared_ptr)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401 #14 0x00007f34bcc92c59 in operator() (this=0x6070008e9000) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #15 operator() (__closure=0x6070008e8ff0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/PriorityThreadFactory.h:54 #16 folly::detail::function::FunctionTraits::callBig&&)::{lambda()#1}>(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:401 #17 0x00007f34bcc8d704 in operator() (this=0x60b00005bc20) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #18 operator() (__closure=0x60b00005bc20) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/NamedThreadFactory.h:40 #19 __invoke_impl > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #20 __invoke > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #21 _M_invoke<0> (this=0x60b00005bc20) at /usr/local/include/c++/7.3.0/thread:234 #22 operator() (this=0x60b00005bc20) at /usr/local/include/c++/7.3.0/thread:243 #23 std::thread::_State_impl&&)::{lambda()#1}> > >::_M_run() (this=0x60b00005bc10) at /usr/local/include/c++/7.3.0/thread:186 #24 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60b00005bc10) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #25 0x00007f34b27efea5 in start_thread (arg=0x7f349c364700) at pthread_create.c:307 #26 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 32 (LWP 107920): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f34bd56944d in nativeFutexWaitImpl (waitMask=, absSteadyTime=, absSystemTime=, expected=, addr=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:123 #2 folly::detail::futexWaitImpl (futex=, expected=, absSystemTime=, absSteadyTime=, waitMask=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:254 #3 0x00007f34bc964a07 in futexWaitImpl const, std::chrono::time_point > > > (waitMask=, deadline=..., expected=, futex=0x7f349ebe7d88) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:85 #4 folly::detail::futexWaitUntil, std::chrono::_V2::steady_clock, std::chrono::duration > > (futex=, expected=, deadline=..., waitMask=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:123 #5 0x00007f34bd575fed in folly::SaturatingSemaphore::tryWaitSlow > > (this=0x7f349ebe7d88, deadline=..., opt=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/MemoryIdler.h:164 #6 0x00007f34bd576656 in folly::detail::LifoSemBase, std::atomic>::try_wait_until > > ( this=0x6160000b0240, deadline=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/SaturatingSemaphore.h:179 #7 0x00007f34bd579db0 in folly::UnboundedBlockingQueue::try_take_for (this=0x6160000b0200, time=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/LifoSem.h:498 #8 0x00007f34bd56e997 in folly::CPUThreadPoolExecutor::threadRun (this=0x61e000156080, thread=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/CPUThreadPoolExecutor.cpp:243 #9 0x00007f34bd5896e9 in __invoke_impl), folly::ThreadPoolExecutor*&, std::shared_ptr&> ( __t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #10 __invoke), folly::ThreadPoolExecutor*&, std::shared_ptr&> (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #11 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #12 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #13 folly::detail::function::FunctionTraits::callBig))(std::shared_ptr)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401 #14 0x00007f34bcc92c59 in operator() (this=0x6070008e8dd0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #15 operator() (__closure=0x6070008e8dc0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/PriorityThreadFactory.h:54 #16 folly::detail::function::FunctionTraits::callBig&&)::{lambda()#1}>(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:401 #17 0x00007f34bcc8d704 in operator() (this=0x60b00005bb70) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #18 operator() (__closure=0x60b00005bb70) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/NamedThreadFactory.h:40 #19 __invoke_impl > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #20 __invoke > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #21 _M_invoke<0> (this=0x60b00005bb70) at /usr/local/include/c++/7.3.0/thread:234 #22 operator() (this=0x60b00005bb70) at /usr/local/include/c++/7.3.0/thread:243 #23 std::thread::_State_impl&&)::{lambda()#1}> > >::_M_run() (this=0x60b00005bb60) at /usr/local/include/c++/7.3.0/thread:186 #24 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60b00005bb60) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #25 0x00007f34b27efea5 in start_thread (arg=0x7f349cb7d700) at pthread_create.c:307 #26 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 31 (LWP 107919): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f34bd56944d in nativeFutexWaitImpl (waitMask=, absSteadyTime=, absSystemTime=, expected=, addr=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:123 #2 folly::detail::futexWaitImpl (futex=, expected=, absSystemTime=, absSteadyTime=, waitMask=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:254 #3 0x00007f34bc964a07 in futexWaitImpl const, std::chrono::time_point > > > (waitMask=, deadline=..., expected=, futex=0x7f349ebe60d8) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:85 #4 folly::detail::futexWaitUntil, std::chrono::_V2::steady_clock, std::chrono::duration > > (futex=, expected=, deadline=..., waitMask=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:123 #5 0x00007f34bd575fed in folly::SaturatingSemaphore::tryWaitSlow > > (this=0x7f349ebe60d8, deadline=..., opt=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/MemoryIdler.h:164 #6 0x00007f34bd576656 in folly::detail::LifoSemBase, std::atomic>::try_wait_until > > ( this=0x6160000b0240, deadline=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/SaturatingSemaphore.h:179 #7 0x00007f34bd579db0 in folly::UnboundedBlockingQueue::try_take_for (this=0x6160000b0200, time=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/LifoSem.h:498 #8 0x00007f34bd56e997 in folly::CPUThreadPoolExecutor::threadRun (this=0x61e000156080, thread=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/CPUThreadPoolExecutor.cpp:243 #9 0x00007f34bd5896e9 in __invoke_impl), folly::ThreadPoolExecutor*&, std::shared_ptr&> ( __t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #10 __invoke), folly::ThreadPoolExecutor*&, std::shared_ptr&> (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #11 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #12 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #13 folly::detail::function::FunctionTraits::callBig))(std::shared_ptr)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401 #14 0x00007f34bcc92c59 in operator() (this=0x6070008e8d60) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #15 operator() (__closure=0x6070008e8d50) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/PriorityThreadFactory.h:54 #16 folly::detail::function::FunctionTraits::callBig&&)::{lambda()#1}>(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:401 #17 0x00007f34bcc8d704 in operator() (this=0x60b00005bac0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #18 operator() (__closure=0x60b00005bac0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/NamedThreadFactory.h:40 #19 __invoke_impl > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #20 __invoke > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #21 _M_invoke<0> (this=0x60b00005bac0) at /usr/local/include/c++/7.3.0/thread:234 #22 operator() (this=0x60b00005bac0) at /usr/local/include/c++/7.3.0/thread:243 #23 std::thread::_State_impl&&)::{lambda()#1}> > >::_M_run() (this=0x60b00005bab0) at /usr/local/include/c++/7.3.0/thread:186 #24 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60b00005bab0) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #25 0x00007f34b27efea5 in start_thread (arg=0x7f349d395700) at pthread_create.c:307 #26 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 30 (LWP 107918): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f34bd56944d in nativeFutexWaitImpl (waitMask=, absSteadyTime=, absSystemTime=, expected=, addr=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:123 #2 folly::detail::futexWaitImpl (futex=, expected=, absSystemTime=, absSteadyTime=, waitMask=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:254 #3 0x00007f34bc964a07 in futexWaitImpl const, std::chrono::time_point > > > (waitMask=, deadline=..., expected=, futex=0x7f349ebe6018) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:85 #4 folly::detail::futexWaitUntil, std::chrono::_V2::steady_clock, std::chrono::duration > > (futex=, expected=, deadline=..., waitMask=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:123 #5 0x00007f34bd575fed in folly::SaturatingSemaphore::tryWaitSlow > > (this=0x7f349ebe6018, deadline=..., opt=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/MemoryIdler.h:164 #6 0x00007f34bd576656 in folly::detail::LifoSemBase, std::atomic>::try_wait_until > > ( this=0x6160000b0240, deadline=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/SaturatingSemaphore.h:179 #7 0x00007f34bd579db0 in folly::UnboundedBlockingQueue::try_take_for (this=0x6160000b0200, time=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/LifoSem.h:498 #8 0x00007f34bd56e997 in folly::CPUThreadPoolExecutor::threadRun (this=0x61e000156080, thread=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/CPUThreadPoolExecutor.cpp:243 #9 0x00007f34bd5896e9 in __invoke_impl), folly::ThreadPoolExecutor*&, std::shared_ptr&> ( __t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #10 __invoke), folly::ThreadPoolExecutor*&, std::shared_ptr&> (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #11 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #12 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #13 folly::detail::function::FunctionTraits::callBig))(std::shared_ptr)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401 #14 0x00007f34bcc92c59 in operator() (this=0x6070008e8cf0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #15 operator() (__closure=0x6070008e8ce0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/PriorityThreadFactory.h:54 #16 folly::detail::function::FunctionTraits::callBig&&)::{lambda()#1}>(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:401 #17 0x00007f34bcc8d704 in operator() (this=0x60b00005ba10) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #18 operator() (__closure=0x60b00005ba10) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/NamedThreadFactory.h:40 #19 __invoke_impl > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #20 __invoke > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #21 _M_invoke<0> (this=0x60b00005ba10) at /usr/local/include/c++/7.3.0/thread:234 #22 operator() (this=0x60b00005ba10) at /usr/local/include/c++/7.3.0/thread:243 #23 std::thread::_State_impl&&)::{lambda()#1}> > >::_M_run() (this=0x60b00005ba00) at /usr/local/include/c++/7.3.0/thread:186 #24 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60b00005ba00) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #25 0x00007f34b27efea5 in start_thread (arg=0x7f349dbad700) at pthread_create.c:307 #26 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 29 (LWP 107917): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f34bd56944d in nativeFutexWaitImpl (waitMask=, absSteadyTime=, absSystemTime=, expected=, addr=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:123 #2 folly::detail::futexWaitImpl (futex=, expected=, absSystemTime=, absSteadyTime=, waitMask=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:254 #3 0x00007f34bc964a07 in futexWaitImpl const, std::chrono::time_point > > > (waitMask=, deadline=..., expected=, futex=0x7f349ebe66a8) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:85 #4 folly::detail::futexWaitUntil, std::chrono::_V2::steady_clock, std::chrono::duration > > (futex=, expected=, deadline=..., waitMask=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:123 #5 0x00007f34bd575fed in folly::SaturatingSemaphore::tryWaitSlow > > (this=0x7f349ebe66a8, deadline=..., opt=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/MemoryIdler.h:164 #6 0x00007f34bd576656 in folly::detail::LifoSemBase, std::atomic>::try_wait_until > > ( this=0x6160000b0240, deadline=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/SaturatingSemaphore.h:179 #7 0x00007f34bd579db0 in folly::UnboundedBlockingQueue::try_take_for (this=0x6160000b0200, time=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/LifoSem.h:498 #8 0x00007f34bd56e997 in folly::CPUThreadPoolExecutor::threadRun (this=0x61e000156080, thread=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/CPUThreadPoolExecutor.cpp:243 #9 0x00007f34bd5896e9 in __invoke_impl), folly::ThreadPoolExecutor*&, std::shared_ptr&> ( __t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #10 __invoke), folly::ThreadPoolExecutor*&, std::shared_ptr&> (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #11 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #12 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #13 folly::detail::function::FunctionTraits::callBig))(std::shared_ptr)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401 #14 0x00007f34bcc92c59 in operator() (this=0x6070008e8c80) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #15 operator() (__closure=0x6070008e8c70) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/PriorityThreadFactory.h:54 #16 folly::detail::function::FunctionTraits::callBig&&)::{lambda()#1}>(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:401 #17 0x00007f34bcc8d704 in operator() (this=0x60b00005b960) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #18 operator() (__closure=0x60b00005b960) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/NamedThreadFactory.h:40 #19 __invoke_impl > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #20 __invoke > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #21 _M_invoke<0> (this=0x60b00005b960) at /usr/local/include/c++/7.3.0/thread:234 #22 operator() (this=0x60b00005b960) at /usr/local/include/c++/7.3.0/thread:243 #23 std::thread::_State_impl&&)::{lambda()#1}> > >::_M_run() (this=0x60b00005b950) at /usr/local/include/c++/7.3.0/thread:186 #24 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60b00005b950) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #25 0x00007f34b27efea5 in start_thread (arg=0x7f349e3c5700) at pthread_create.c:307 #26 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 28 (LWP 107916): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f34bd56944d in nativeFutexWaitImpl (waitMask=, absSteadyTime=, absSystemTime=, expected=, addr=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:123 #2 folly::detail::futexWaitImpl (futex=, expected=, absSystemTime=, absSteadyTime=, waitMask=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:254 #3 0x00007f34bc964a07 in futexWaitImpl const, std::chrono::time_point > > > (waitMask=, deadline=..., expected=, futex=0x7f349ebe9558) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:85 #4 folly::detail::futexWaitUntil, std::chrono::_V2::steady_clock, std::chrono::duration > > (futex=, expected=, deadline=..., waitMask=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:123 #5 0x00007f34bd575fed in folly::SaturatingSemaphore::tryWaitSlow > > (this=0x7f349ebe9558, deadline=..., opt=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/MemoryIdler.h:164 #6 0x00007f34bd576656 in folly::detail::LifoSemBase, std::atomic>::try_wait_until > > ( this=0x6160000b0240, deadline=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/SaturatingSemaphore.h:179 #7 0x00007f34bd579db0 in folly::UnboundedBlockingQueue::try_take_for (this=0x6160000b0200, time=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/LifoSem.h:498 #8 0x00007f34bd56e997 in folly::CPUThreadPoolExecutor::threadRun (this=0x61e000156080, thread=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/CPUThreadPoolExecutor.cpp:243 #9 0x00007f34bd5896e9 in __invoke_impl), folly::ThreadPoolExecutor*&, std::shared_ptr&> ( __t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #10 __invoke), folly::ThreadPoolExecutor*&, std::shared_ptr&> (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #11 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #12 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #13 folly::detail::function::FunctionTraits::callBig))(std::shared_ptr)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401 #14 0x00007f34bcc92c59 in operator() (this=0x6070008e8c10) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #15 operator() (__closure=0x6070008e8c00) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/PriorityThreadFactory.h:54 #16 folly::detail::function::FunctionTraits::callBig&&)::{lambda()#1}>(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:401 #17 0x00007f34bcc8d704 in operator() (this=0x60b00005b8b0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #18 operator() (__closure=0x60b00005b8b0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/NamedThreadFactory.h:40 #19 __invoke_impl > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #20 __invoke > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #21 _M_invoke<0> (this=0x60b00005b8b0) at /usr/local/include/c++/7.3.0/thread:234 #22 operator() (this=0x60b00005b8b0) at /usr/local/include/c++/7.3.0/thread:243 #23 std::thread::_State_impl&&)::{lambda()#1}> > >::_M_run() (this=0x60b00005b8a0) at /usr/local/include/c++/7.3.0/thread:186 #24 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60b00005b8a0) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #25 0x00007f34b27efea5 in start_thread (arg=0x7f349ebdd700) at pthread_create.c:307 #26 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 27 (LWP 107915): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f34bd56944d in nativeFutexWaitImpl (waitMask=, absSteadyTime=, absSystemTime=, expected=, addr=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:123 #2 folly::detail::futexWaitImpl (futex=, expected=, absSystemTime=, absSteadyTime=, waitMask=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:254 #3 0x00007f34bc964a07 in futexWaitImpl const, std::chrono::time_point > > > (waitMask=, deadline=..., expected=, futex=0x7f349ebe61e0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:85 #4 folly::detail::futexWaitUntil, std::chrono::_V2::steady_clock, std::chrono::duration > > (futex=, expected=, deadline=..., waitMask=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:123 #5 0x00007f34bd575fed in folly::SaturatingSemaphore::tryWaitSlow > > (this=0x7f349ebe61e0, deadline=..., opt=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/MemoryIdler.h:164 #6 0x00007f34bd576656 in folly::detail::LifoSemBase, std::atomic>::try_wait_until > > ( this=0x6160000b0240, deadline=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/SaturatingSemaphore.h:179 #7 0x00007f34bd579db0 in folly::UnboundedBlockingQueue::try_take_for (this=0x6160000b0200, time=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/LifoSem.h:498 #8 0x00007f34bd56e997 in folly::CPUThreadPoolExecutor::threadRun (this=0x61e000156080, thread=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/CPUThreadPoolExecutor.cpp:243 #9 0x00007f34bd5896e9 in __invoke_impl), folly::ThreadPoolExecutor*&, std::shared_ptr&> ( __t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #10 __invoke), folly::ThreadPoolExecutor*&, std::shared_ptr&> (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #11 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #12 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #13 folly::detail::function::FunctionTraits::callBig))(std::shared_ptr)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401 #14 0x00007f34bcc92c59 in operator() (this=0x6070008e8ba0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #15 operator() (__closure=0x6070008e8b90) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/PriorityThreadFactory.h:54 #16 folly::detail::function::FunctionTraits::callBig&&)::{lambda()#1}>(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:401 #17 0x00007f34bcc8d704 in operator() (this=0x60b00005b800) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #18 operator() (__closure=0x60b00005b800) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/NamedThreadFactory.h:40 #19 __invoke_impl > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #20 __invoke > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #21 _M_invoke<0> (this=0x60b00005b800) at /usr/local/include/c++/7.3.0/thread:234 #22 operator() (this=0x60b00005b800) at /usr/local/include/c++/7.3.0/thread:243 #23 std::thread::_State_impl&&)::{lambda()#1}> > >::_M_run() (this=0x60b00005b7f0) at /usr/local/include/c++/7.3.0/thread:186 #24 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60b00005b7f0) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #25 0x00007f34b27efea5 in start_thread (arg=0x7f34a0c1a700) at pthread_create.c:307 #26 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 26 (LWP 107914): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f34bd56944d in nativeFutexWaitImpl (waitMask=, absSteadyTime=, absSystemTime=, expected=, addr=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:123 #2 folly::detail::futexWaitImpl (futex=, expected=, absSystemTime=, absSteadyTime=, waitMask=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:254 #3 0x00007f34bc964a07 in futexWaitImpl const, std::chrono::time_point > > > (waitMask=, deadline=..., expected=, futex=0x7f349ebe78a8) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:85 #4 folly::detail::futexWaitUntil, std::chrono::_V2::steady_clock, std::chrono::duration > > (futex=, expected=, deadline=..., waitMask=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:123 #5 0x00007f34bd575fed in folly::SaturatingSemaphore::tryWaitSlow > > (this=0x7f349ebe78a8, deadline=..., opt=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/MemoryIdler.h:164 #6 0x00007f34bd576656 in folly::detail::LifoSemBase, std::atomic>::try_wait_until > > ( this=0x6160000b0240, deadline=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/SaturatingSemaphore.h:179 #7 0x00007f34bd579db0 in folly::UnboundedBlockingQueue::try_take_for (this=0x6160000b0200, time=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/LifoSem.h:498 #8 0x00007f34bd56e997 in folly::CPUThreadPoolExecutor::threadRun (this=0x61e000156080, thread=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/CPUThreadPoolExecutor.cpp:243 #9 0x00007f34bd5896e9 in __invoke_impl), folly::ThreadPoolExecutor*&, std::shared_ptr&> ( __t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #10 __invoke), folly::ThreadPoolExecutor*&, std::shared_ptr&> (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #11 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #12 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #13 folly::detail::function::FunctionTraits::callBig))(std::shared_ptr)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401 #14 0x00007f34bcc92c59 in operator() (this=0x6070008e8b30) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #15 operator() (__closure=0x6070008e8b20) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/PriorityThreadFactory.h:54 #16 folly::detail::function::FunctionTraits::callBig&&)::{lambda()#1}>(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:401 #17 0x00007f34bcc8d704 in operator() (this=0x60b00005b750) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #18 operator() (__closure=0x60b00005b750) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/NamedThreadFactory.h:40 #19 __invoke_impl > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #20 __invoke > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #21 _M_invoke<0> (this=0x60b00005b750) at /usr/local/include/c++/7.3.0/thread:234 #22 operator() (this=0x60b00005b750) at /usr/local/include/c++/7.3.0/thread:243 #23 std::thread::_State_impl&&)::{lambda()#1}> > >::_M_run() (this=0x60b00005b740) at /usr/local/include/c++/7.3.0/thread:186 #24 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60b00005b740) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #25 0x00007f34b27efea5 in start_thread (arg=0x7f34a1432700) at pthread_create.c:307 #26 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 25 (LWP 107913): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f34bd56944d in nativeFutexWaitImpl (waitMask=, absSteadyTime=, absSystemTime=, expected=, addr=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:123 #2 folly::detail::futexWaitImpl (futex=, expected=, absSystemTime=, absSteadyTime=, waitMask=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/Futex.cpp:254 #3 0x00007f34bc964a07 in futexWaitImpl const, std::chrono::time_point > > > (waitMask=, deadline=..., expected=, futex=0x7f349ebe6660) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:85 #4 folly::detail::futexWaitUntil, std::chrono::_V2::steady_clock, std::chrono::duration > > (futex=, expected=, deadline=..., waitMask=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/detail/Futex-inl.h:123 #5 0x00007f34bd575fed in folly::SaturatingSemaphore::tryWaitSlow > > (this=0x7f349ebe6660, deadline=..., opt=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/detail/MemoryIdler.h:164 #6 0x00007f34bd576656 in folly::detail::LifoSemBase, std::atomic>::try_wait_until > > ( this=0x6160000b0240, deadline=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/SaturatingSemaphore.h:179 #7 0x00007f34bd579db0 in folly::UnboundedBlockingQueue::try_take_for (this=0x6160000b0200, time=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/synchronization/LifoSem.h:498 #8 0x00007f34bd56e997 in folly::CPUThreadPoolExecutor::threadRun (this=0x61e000156080, thread=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/CPUThreadPoolExecutor.cpp:243 #9 0x00007f34bd5896e9 in __invoke_impl), folly::ThreadPoolExecutor*&, std::shared_ptr&> ( __t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #10 __invoke), folly::ThreadPoolExecutor*&, std::shared_ptr&> (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #11 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #12 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #13 folly::detail::function::FunctionTraits::callBig))(std::shared_ptr)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401 #14 0x00007f34bcc92c59 in operator() (this=0x6070008e8ac0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #15 operator() (__closure=0x6070008e8ab0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/PriorityThreadFactory.h:54 #16 folly::detail::function::FunctionTraits::callBig&&)::{lambda()#1}>(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:401 #17 0x00007f34bcc8d704 in operator() (this=0x60b00005b6a0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #18 operator() (__closure=0x60b00005b6a0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/NamedThreadFactory.h:40 #19 __invoke_impl > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #20 __invoke > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #21 _M_invoke<0> (this=0x60b00005b6a0) at /usr/local/include/c++/7.3.0/thread:234 #22 operator() (this=0x60b00005b6a0) at /usr/local/include/c++/7.3.0/thread:243 #23 std::thread::_State_impl&&)::{lambda()#1}> > >::_M_run() (this=0x60b00005b690) at /usr/local/include/c++/7.3.0/thread:186 #24 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60b00005b690) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #25 0x00007f34b27efea5 in start_thread (arg=0x7f34a1c49700) at pthread_create.c:307 #26 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 24 (LWP 107454): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007f34b3cef1bc in __gthread_cond_wait (__mutex=, __cond=__cond@entry=0x614000000d98) at /tmp/deploy/objdir/x86_64-pc-linux-gnu/libstdc++-v3/include/x86_64-pc-linux-gnu/bits/gthr-default.h:864 #2 std::condition_variable::wait (this=this@entry=0x614000000d98, __lock=...) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/condition_variable.cc:53 #3 0x0000000000843685 in Executor::run (this=0x614000000c40) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/executor.cc:44 #4 0x00007f34b5a4b26d in Couchbase::Thread::thread_entry (this=0x614000000c40) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/thread.cc:45 #5 0x00007f34b5a06ae9 in run (this=0x60400006efd0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #6 platform_thread_wrap (arg=0x60400006efd0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #7 0x00007f34b27efea5 in start_thread (arg=0x7f34a42a8700) at pthread_create.c:307 #8 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 23 (LWP 107453): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007f34b3cef1bc in __gthread_cond_wait (__mutex=, __cond=__cond@entry=0x614000000b98) at /tmp/deploy/objdir/x86_64-pc-linux-gnu/libstdc++-v3/include/x86_64-pc-linux-gnu/bits/gthr-default.h:864 #2 std::condition_variable::wait (this=this@entry=0x614000000b98, __lock=...) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/condition_variable.cc:53 #3 0x0000000000843685 in Executor::run (this=0x614000000a40) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/executor.cc:44 #4 0x00007f34b5a4b26d in Couchbase::Thread::thread_entry (this=0x614000000a40) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/thread.cc:45 #5 0x00007f34b5a06ae9 in run (this=0x60400006ef90) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #6 platform_thread_wrap (arg=0x60400006ef90) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #7 0x00007f34b27efea5 in start_thread (arg=0x7f34a4ac0700) at pthread_create.c:307 #8 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 22 (LWP 107452): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007f34b3cef1bc in __gthread_cond_wait (__mutex=, __cond=__cond@entry=0x614000000998) at /tmp/deploy/objdir/x86_64-pc-linux-gnu/libstdc++-v3/include/x86_64-pc-linux-gnu/bits/gthr-default.h:864 #2 std::condition_variable::wait (this=this@entry=0x614000000998, __lock=...) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/condition_variable.cc:53 #3 0x0000000000843685 in Executor::run (this=0x614000000840) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/executor.cc:44 #4 0x00007f34b5a4b26d in Couchbase::Thread::thread_entry (this=0x614000000840) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/thread.cc:45 #5 0x00007f34b5a06ae9 in run (this=0x60400006ef50) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #6 platform_thread_wrap (arg=0x60400006ef50) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #7 0x00007f34b27efea5 in start_thread (arg=0x7f34a52d8700) at pthread_create.c:307 #8 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 21 (LWP 107451): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007f34b3cef1bc in __gthread_cond_wait (__mutex=, __cond=__cond@entry=0x614000000798) at /tmp/deploy/objdir/x86_64-pc-linux-gnu/libstdc++-v3/include/x86_64-pc-linux-gnu/bits/gthr-default.h:864 #2 std::condition_variable::wait (this=this@entry=0x614000000798, __lock=...) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/condition_variable.cc:53 #3 0x0000000000843685 in Executor::run (this=0x614000000640) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/executor.cc:44 #4 0x00007f34b5a4b26d in Couchbase::Thread::thread_entry (this=0x614000000640) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/thread.cc:45 #5 0x00007f34b5a06ae9 in run (this=0x60400006ef10) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #6 platform_thread_wrap (arg=0x60400006ef10) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #7 0x00007f34b27efea5 in start_thread (arg=0x7f34a5af0700) at pthread_create.c:307 #8 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 20 (LWP 107450): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007f34b3cef1bc in __gthread_cond_wait (__mutex=, __cond=__cond@entry=0x614000000598) at /tmp/deploy/objdir/x86_64-pc-linux-gnu/libstdc++-v3/include/x86_64-pc-linux-gnu/bits/gthr-default.h:864 #2 std::condition_variable::wait (this=this@entry=0x614000000598, __lock=...) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/condition_variable.cc:53 #3 0x0000000000843685 in Executor::run (this=0x614000000440) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/executor.cc:44 #4 0x00007f34b5a4b26d in Couchbase::Thread::thread_entry (this=0x614000000440) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/thread.cc:45 #5 0x00007f34b5a06ae9 in run (this=0x60400006eed0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #6 platform_thread_wrap (arg=0x60400006eed0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #7 0x00007f34b27efea5 in start_thread (arg=0x7f34a6308700) at pthread_create.c:307 #8 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 19 (LWP 107449): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007f34b3cef1bc in __gthread_cond_wait (__mutex=, __cond=__cond@entry=0x614000000398) at /tmp/deploy/objdir/x86_64-pc-linux-gnu/libstdc++-v3/include/x86_64-pc-linux-gnu/bits/gthr-default.h:864 #2 std::condition_variable::wait (this=this@entry=0x614000000398, __lock=...) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/condition_variable.cc:53 #3 0x0000000000843685 in Executor::run (this=0x614000000240) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/executor.cc:44 #4 0x00007f34b5a4b26d in Couchbase::Thread::thread_entry (this=0x614000000240) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/thread.cc:45 #5 0x00007f34b5a06ae9 in run (this=0x60400006ee90) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #6 platform_thread_wrap (arg=0x60400006ee90) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #7 0x00007f34b27efea5 in start_thread (arg=0x7f34a6b20700) at pthread_create.c:307 #8 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 18 (LWP 107448): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007f34b3cef1bc in __gthread_cond_wait (__mutex=, __cond=__cond@entry=0x614000000198) at /tmp/deploy/objdir/x86_64-pc-linux-gnu/libstdc++-v3/include/x86_64-pc-linux-gnu/bits/gthr-default.h:864 #2 std::condition_variable::wait (this=this@entry=0x614000000198, __lock=...) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/condition_variable.cc:53 #3 0x0000000000843685 in Executor::run (this=0x614000000040) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/executor.cc:44 #4 0x00007f34b5a4b26d in Couchbase::Thread::thread_entry (this=0x614000000040) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/thread.cc:45 #5 0x00007f34b5a06ae9 in run (this=0x60400006ee50) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #6 platform_thread_wrap (arg=0x60400006ee50) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #7 0x00007f34b27efea5 in start_thread (arg=0x7f34a7338700) at pthread_create.c:307 #8 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 17 (LWP 107447): #0 0x00007f34c1738d5e in ?? () from /opt/couchbase/bin/../lib/libasan.so.4 #1 0x00007f34c17eafe0 in operator new(unsigned long) () from /opt/couchbase/bin/../lib/libasan.so.4 #2 0x00000000008ac273 in _M_init_functor (__f=, __functor=...) at /usr/local/include/c++/7.3.0/bits/std_function.h:268 #3 _M_init_functor (__f=, __functor=...) at /usr/local/include/c++/7.3.0/bits/std_function.h:239 #4 std::function)>::function >(McbpValidator::) (this=0x7f34a7b37540, __f=...) at /usr/local/include/c++/7.3.0/bits/std_function.h:693 #5 0x00000000008b6b21 in McbpValidator::verify_header (cookie=..., expected_extlen=, expected_keylen=, expected_valuelen=, expected_cas=, expected_datatype_mask=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/mcbp_validators.cc:250 #6 0x00000000008c5c55 in dcp_system_event_validator (cookie=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/mcbp_validators.cc:742 #7 0x0000000000818257 in Cookie::validate (this=this@entry=0x6160002da580) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/cookie.cc:460 #8 0x000000000075ae04 in Connection::executeCommandPipeline (this=this@entry=0x6170002b1880) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/connection.cc:554 #9 0x0000000000776975 in Connection::executeCommandsCallback (this=this@entry=0x6170002b1880) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/connection.cc:633 #10 0x000000000077bc58 in Connection::rw_callback (ctx=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/connection.cc:779 #11 0x00007f34b4d95d8e in bufferevent_run_deferred_callbacks_unlocked (cb=, arg=0x61600124d780) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/bufferevent.c:208 #12 0x00007f34b4d9ed01 in event_process_active_single_queue (base=base@entry=0x617000003500, max_to_process=max_to_process@entry=2147483647, endtime=endtime@entry=0x0, activeq=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:1726 #13 0x00007f34b4d9f54f in event_process_active (base=0x617000003500) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:1789 #14 event_base_loop (base=0x617000003500, flags=flags@entry=0) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:2012 #15 0x00000000006ad1f8 in worker_libevent (arg=0x6290000091f0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/thread.cc:195 #16 0x00007f34b5a06ae9 in run (this=0x60400006ee10) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #17 platform_thread_wrap (arg=0x60400006ee10) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #18 0x00007f34b27efea5 in start_thread (arg=0x7f34a7b51700) at pthread_create.c:307 #19 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 16 (LWP 107446): #0 __memset_sse2 () at ../sysdeps/x86_64/memset.S:126 #1 0x00007f34c17391f2 in ?? () from /opt/couchbase/bin/../lib/libasan.so.4 #2 0x00007f34c17eafe0 in operator new(unsigned long) () from /opt/couchbase/bin/../lib/libasan.so.4 #3 0x00007f34bc748e76 in make_unique&, cb::sized_buffer&> () at /usr/local/include/c++/7.3.0/bits/unique_ptr.h:825 #4 DcpConsumer::systemEvent (this=0x6190028870c0, opaque=, vbucket=..., event=, bySeqno=, version=, key=..., eventData=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/dcp/consumer.cc:1746 #5 0x00007f34bca6b0e4 in EventuallyPersistentEngine::system_event (this=0x61d00067fc80, cookie=..., opaque=, vbucket=..., event=, bySeqno=593, version=, key=..., eventData=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/ep_engine.cc:1652 #6 0x00000000005cc63b in dcpSystemEvent (cookie=..., opaque=, vbucket=..., eventId=, bySeqno=, version=, key=..., eventData=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/protocol/mcbp/engine_wrapper.cc:749 #7 0x0000000000934a4f in dcp_system_event_executor (cookie=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/protocol/mcbp/dcp_system_event_executor.cc:34 #8 0x000000000089a43d in operator() (__args#0=..., this=) at /usr/local/include/c++/7.3.0/bits/std_function.h:706 #9 execute_client_request_packet (cookie=..., request=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/mcbp_executors.cc:891 #10 0x000000000089b31e in execute_request_packet (cookie=..., request=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/mcbp_executors.cc:899 #11 0x000000000081f385 in Cookie::execute (this=this@entry=0x6160011aab80) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/cookie.cc:158 #12 0x000000000075af10 in Connection::executeCommandPipeline (this=this@entry=0x6170003f5f00) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/connection.cc:560 #13 0x0000000000776975 in Connection::executeCommandsCallback (this=this@entry=0x6170003f5f00) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/connection.cc:633 #14 0x000000000077bc58 in Connection::rw_callback (ctx=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/connection.cc:779 #15 0x00007f34b4d95d8e in bufferevent_run_deferred_callbacks_unlocked (cb=, arg=0x6160012e9a80) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/bufferevent.c:208 #16 0x00007f34b4d9ed01 in event_process_active_single_queue (base=base@entry=0x617000003180, max_to_process=max_to_process@entry=2147483647, endtime=endtime@entry=0x0, activeq=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:1726 #17 0x00007f34b4d9f54f in event_process_active (base=0x617000003180) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:1789 #18 event_base_loop (base=0x617000003180, flags=flags@entry=0) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:2012 #19 0x00000000006ad1f8 in worker_libevent (arg=0x629000008748) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/thread.cc:195 #20 0x00007f34b5a06ae9 in run (this=0x60400006edd0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #21 platform_thread_wrap (arg=0x60400006edd0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #22 0x00007f34b27efea5 in start_thread (arg=0x7f34a8368700) at pthread_create.c:307 #23 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 15 (LWP 107445): #0 0x00007f34b2518eb3 in epoll_wait () at ../sysdeps/unix/syscall-template.S:81 #1 0x00007f34b4da83c5 in epoll_dispatch (base=0x617000002e00, tv=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/epoll.c:465 #2 0x00007f34b4d9f376 in event_base_loop (base=0x617000002e00, flags=flags@entry=0) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:1998 #3 0x00000000006ad1f8 in worker_libevent (arg=0x629000007ca0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/thread.cc:195 #4 0x00007f34b5a06ae9 in run (this=0x60400006ed90) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #5 platform_thread_wrap (arg=0x60400006ed90) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #6 0x00007f34b27efea5 in start_thread (arg=0x7f34a8b81700) at pthread_create.c:307 #7 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 14 (LWP 107444): #0 compare_exchange_strong (__m2=, __m1=std::memory_order_seq_cst, __i2=2048, __i1=@0x7f34a937cb70: 0, this=0x61d0001e4bc8) at /usr/local/include/c++/7.3.0/bits/atomic_base.h:477 #1 compare_exchange_strong (__m=std::memory_order_seq_cst, __i2=2048, __i1=@0x7f34a937cb70: 0, this=0x61d0001e4bc8) at /usr/local/include/c++/7.3.0/bits/atomic_base.h:500 #2 folly::SharedMutexImpl::lockSharedImpl::WaitForever> (this=0x61d0001e4bc8, ctx=..., token=0x0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/SharedMutex.h:1291 #3 0x00007f34bd514d0b in lock_shared (this=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/SharedMutex.h:413 #4 lock_shared (mutex=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/LockTraits.h:157 #5 lock > (mutex=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/LockTraits.h:499 #6 LockedPtrBase (parent=, this=0x7f34a937cca0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Synchronized.h:1097 #7 LockedPtr (parent=, this=0x7f34a937cca0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Synchronized.h:1402 #8 rlock (this=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Synchronized.h:141 #9 HdrHistogram::addValueAndCount (this=, v=, count=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/utilities/hdrhistogram.cc:120 #10 0x00007f34bcb4513b in ScopeTimer2, TracerStopwatch>::~ScopeTimer2 (this=0x7f34a937e970, __in_chrg=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/utilities/hdrhistogram.h:410 #11 0x00007f34bcb32101 in EventuallyPersistentEngine::getStats(void const*, std::basic_string_view >, std::basic_string_view >, std::function >, std::basic_string_view >, gsl::not_null)> const&) (this=this@entry=0x61d0001e4680, cookie=, key=..., value=..., add_stat=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/ep_engine.cc:4776 #12 0x00007f34bcb36b35 in EventuallyPersistentEngine::get_stats(gsl::not_null, std::basic_string_view >, std::basic_string_view >, std::function >, std::basic_string_view >, gsl::not_null)> const&) (this=this@entry=0x61d0001e4680, cookie=..., key=..., value=..., add_stat=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/ep_engine.cc:371 #13 0x00000000005c2419 in bucket_get_stats(Cookie&, std::basic_string_view >, cb::sized_buffer, std::function >, std::basic_string_view >, gsl::not_null)> const&) (cookie=..., key=..., value=..., add_stat=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/protocol/mcbp/engine_wrapper.cc:376 #14 0x0000000000999077 in stat_bucket_stats (arg=..., cookie=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/protocol/mcbp/stats_context.cc:507 #15 0x000000000099c134 in StatsCommandContext::doStats (this=this@entry=0x60b000698bb0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/protocol/mcbp/stats_context.cc:728 #16 0x00000000009a4918 in StatsCommandContext::step (this=0x60b000698bb0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/protocol/mcbp/stats_context.cc:654 #17 0x00000000009b64e1 in SteppableCommandContext::drive (this=this@entry=0x60b000698bb0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/protocol/mcbp/steppable_command_context.cc:42 #18 0x00000000008869f8 in stat_executor (cookie=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/mcbp_executors.cc:191 #19 0x000000000089a43d in operator() (__args#0=..., this=) at /usr/local/include/c++/7.3.0/bits/std_function.h:706 #20 execute_client_request_packet (cookie=..., request=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/mcbp_executors.cc:891 #21 0x000000000089b31e in execute_request_packet (cookie=..., request=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/mcbp_executors.cc:899 #22 0x000000000081f385 in Cookie::execute (this=this@entry=0x616001b53480) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/cookie.cc:158 #23 0x000000000075af10 in Connection::executeCommandPipeline (this=this@entry=0x6170000fd200) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/connection.cc:560 #24 0x0000000000776975 in Connection::executeCommandsCallback (this=this@entry=0x6170000fd200) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/connection.cc:633 #25 0x000000000077bc58 in Connection::rw_callback (ctx=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/connection.cc:779 #26 0x00007f34b4d95d8e in bufferevent_run_deferred_callbacks_unlocked (cb=, arg=0x616000c48080) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/bufferevent.c:208 #27 0x00007f34b4d9ed01 in event_process_active_single_queue (base=base@entry=0x617000002a80, max_to_process=max_to_process@entry=2147483647, endtime=endtime@entry=0x0, activeq=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:1726 #28 0x00007f34b4d9f54f in event_process_active (base=0x617000002a80) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:1789 #29 event_base_loop (base=0x617000002a80, flags=flags@entry=0) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:2012 #30 0x00000000006ad1f8 in worker_libevent (arg=0x6290000071f8) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/thread.cc:195 #31 0x00007f34b5a06ae9 in run (this=0x60400006ed50) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #32 platform_thread_wrap (arg=0x60400006ed50) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #33 0x00007f34b27efea5 in start_thread (arg=0x7f34a9399700) at pthread_create.c:307 #34 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 13 (LWP 107443): #0 0x00007f34b2518eb3 in epoll_wait () at ../sysdeps/unix/syscall-template.S:81 #1 0x00007f34b4da83c5 in epoll_dispatch (base=0x617000002700, tv=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/epoll.c:465 #2 0x00007f34b4d9f376 in event_base_loop (base=0x617000002700, flags=flags@entry=0) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:1998 #3 0x00000000006ad1f8 in worker_libevent (arg=0x629000006750) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/thread.cc:195 #4 0x00007f34b5a06ae9 in run (this=0x60400006ed10) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #5 platform_thread_wrap (arg=0x60400006ed10) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #6 0x00007f34b27efea5 in start_thread (arg=0x7f34a9bb0700) at pthread_create.c:307 #7 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 12 (LWP 107442): #0 0x00007f34c17eaf92 in operator new(unsigned long) () from /opt/couchbase/bin/../lib/libasan.so.4 #1 0x00000000005084b2 in std::vector >::emplace_back(char&&) (this=0x7f34aa3ae418) at /usr/local/include/c++/7.3.0/ext/new_allocator.h:111 #2 0x00000000005088ba in push_back (__x=, this=0x7f34aa3ae418) at /usr/local/include/c++/7.3.0/bits/stl_vector.h:954 #3 nlohmann::detail::lexer, std::allocator >, bool, long, unsigned long, double, std::allocator, nlohmann::adl_serializer> >::get (this=0x7f34aa3ae3e8) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/json.exploded/include/nlohmann/detail/input/lexer.hpp:1259 #4 0x000000000050c4e9 in nlohmann::detail::lexer, std::allocator >, bool, long, unsigned long, double, std::allocator, nlohmann::adl_serializer> >::scan (this=0x7f34aa3ae3e8) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/json.exploded/include/nlohmann/detail/input/lexer.hpp:1392 #5 0x000000000055ee04 in nlohmann::basic_json, std::allocator >, bool, long, unsigned long, double, std::allocator, nlohmann::adl_serializer>::parse(nlohmann::detail::input_adapter&&, std::function, std::allocator >, bool, long, unsigned long, double, std::allocator, nlohmann::adl_serializer> >::parse_event_t, nlohmann::basic_json, std::allocator >, bool, long, unsigned long, double, std::allocator, nlohmann::adl_serializer>&)>, bool) (i=, cb=..., allow_exceptions=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/json.exploded/include/nlohmann/detail/input/parser.hpp:461 #6 0x00007f34bcb263af in EventuallyPersistentEngine::processUnknownCommandInner(void const*, cb::mcbp::Request const&, std::function >, std::basic_string_view >, std::basic_string_view >, unsigned char, cb::mcbp::Status, unsigned long, void const*)> const&) (this=0x61d00067fc80, cookie=cookie@entry=0x6160017e5c80, request=..., response=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/ep_engine.cc:1013 #7 0x00007f34bcb27a8c in EventuallyPersistentEngine::unknown_command(void const*, cb::mcbp::Request const&, std::function >, std::basic_string_view >, std::basic_string_view >, unsigned char, cb::mcbp::Status, unsigned long, void const*)> const&) (this=this@entry=0x61d00067fc80, cookie=cookie@entry=0x6160017e5c80, request=..., response=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/ep_engine.cc:1313 #8 0x00000000005bb841 in bucket_unknown_command(Cookie&, std::function >, std::basic_string_view >, std::basic_string_view >, unsigned char, cb::mcbp::Status, unsigned long, void const*)> const&) (cookie=..., response=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/protocol/mcbp/engine_wrapper.cc:34 #9 0x0000000000876c55 in process_bin_unknown_packet (cookie=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/mcbp_executors.cc:132 #10 0x000000000089a43d in operator() (__args#0=..., this=) at /usr/local/include/c++/7.3.0/bits/std_function.h:706 #11 execute_client_request_packet (cookie=..., request=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/mcbp_executors.cc:891 #12 0x000000000089b31e in execute_request_packet (cookie=..., request=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/mcbp_executors.cc:899 #13 0x000000000081f385 in Cookie::execute (this=this@entry=0x6160017e5c80) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/cookie.cc:158 #14 0x000000000075af10 in Connection::executeCommandPipeline (this=this@entry=0x617000441d80) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/connection.cc:560 #15 0x0000000000776975 in Connection::executeCommandsCallback (this=this@entry=0x617000441d80) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/connection.cc:633 #16 0x000000000077bc58 in Connection::rw_callback (ctx=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/connection.cc:779 #17 0x00007f34b4d95d8e in bufferevent_run_deferred_callbacks_unlocked (cb=, arg=0x616001b27f80) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/bufferevent.c:208 #18 0x00007f34b4d9ed01 in event_process_active_single_queue (base=base@entry=0x617000002380, max_to_process=max_to_process@entry=2147483647, endtime=endtime@entry=0x0, activeq=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:1726 #19 0x00007f34b4d9f54f in event_process_active (base=0x617000002380) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:1789 #20 event_base_loop (base=0x617000002380, flags=flags@entry=0) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:2012 #21 0x00000000006ad1f8 in worker_libevent (arg=0x629000005ca8) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/thread.cc:195 #22 0x00007f34b5a06ae9 in run (this=0x60400006ecd0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #23 platform_thread_wrap (arg=0x60400006ecd0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #24 0x00007f34b27efea5 in start_thread (arg=0x7f34aa3c9700) at pthread_create.c:307 #25 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 11 (LWP 107441): #0 __memset_sse2 () at ../sysdeps/x86_64/memset.S:115 #1 0x00007f34c17391f2 in ?? () from /opt/couchbase/bin/../lib/libasan.so.4 #2 0x00007f34c17eafe0 in operator new(unsigned long) () from /opt/couchbase/bin/../lib/libasan.so.4 #3 0x00000000008ac273 in _M_init_functor (__f=, __functor=...) at /usr/local/include/c++/7.3.0/bits/std_function.h:268 #4 _M_init_functor (__f=, __functor=...) at /usr/local/include/c++/7.3.0/bits/std_function.h:239 #5 std::function)>::function >(McbpValidator::) (this=0x7f34aabc6540, __f=...) at /usr/local/include/c++/7.3.0/bits/std_function.h:693 #6 0x00000000008b6b21 in McbpValidator::verify_header (cookie=..., expected_extlen=, expected_keylen=, expected_valuelen=, expected_cas=, expected_datatype_mask=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/mcbp_validators.cc:250 #7 0x00000000008c5c55 in dcp_system_event_validator (cookie=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/mcbp_validators.cc:742 #8 0x0000000000818257 in Cookie::validate (this=this@entry=0x616000243680) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/cookie.cc:460 #9 0x000000000075ae04 in Connection::executeCommandPipeline (this=this@entry=0x617000081180) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/connection.cc:554 #10 0x0000000000776975 in Connection::executeCommandsCallback (this=this@entry=0x617000081180) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/connection.cc:633 #11 0x000000000077bc58 in Connection::rw_callback (ctx=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/connection.cc:779 #12 0x00007f34b4d95d8e in bufferevent_run_deferred_callbacks_unlocked (cb=, arg=0x616000a61480) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/bufferevent.c:208 #13 0x00007f34b4d9ed01 in event_process_active_single_queue (base=base@entry=0x617000002000, max_to_process=max_to_process@entry=2147483647, endtime=endtime@entry=0x0, activeq=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:1726 #14 0x00007f34b4d9f54f in event_process_active (base=0x617000002000) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:1789 #15 event_base_loop (base=0x617000002000, flags=flags@entry=0) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:2012 #16 0x00000000006ad1f8 in worker_libevent (arg=0x629000005200) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/thread.cc:195 #17 0x00007f34b5a06ae9 in run (this=0x60400006ec90) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #18 platform_thread_wrap (arg=0x60400006ec90) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #19 0x00007f34b27efea5 in start_thread (arg=0x7f34aabe0700) at pthread_create.c:307 #20 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 10 (LWP 107440): #0 pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238 #1 0x0000000000a770f2 in __gthread_cond_timedwait (__abs_timeout=0x7f34ab3e0930, __mutex=, __cond=0x61a000001078) at /usr/local/include/c++/7.3.0/x86_64-pc-linux-gnu/bits/gthr-default.h:871 #2 __wait_until_impl > > (__atime=..., __lock=..., this=0x61a000001078) at /usr/local/include/c++/7.3.0/condition_variable:166 #3 wait_until > > (__atime=..., __lock=..., this=0x61a000001078) at /usr/local/include/c++/7.3.0/condition_variable:106 #4 wait_for > (__rtime=..., __lock=..., this=0x61a000001078) at /usr/local/include/c++/7.3.0/condition_variable:138 #5 AuditImpl::consume_events (this=0x61a000000c80) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/auditd/src/audit.cc:414 #6 0x00007f34b5a06ae9 in run (this=0x604000069390) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #7 platform_thread_wrap (arg=0x604000069390) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #8 0x00007f34b27efea5 in start_thread (arg=0x7f34ab3f8700) at pthread_create.c:307 #9 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 9 (LWP 107439): #0 pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238 #1 0x00000000007c66ef in __gthread_cond_timedwait (__abs_timeout=0x7f34abc28880, __mutex=, __cond=0x616000008e78) at /usr/local/include/c++/7.3.0/x86_64-pc-linux-gnu/bits/gthr-default.h:871 #2 __wait_until_impl > > (__atime=..., __lock=..., this=0x616000008e78) at /usr/local/include/c++/7.3.0/condition_variable:166 #3 wait_until > > (__atime=..., __lock=..., this=0x616000008e78) at /usr/local/include/c++/7.3.0/condition_variable:106 #4 wait_for > (__rtime=..., __lock=..., this=0x616000008e78) at /usr/local/include/c++/7.3.0/condition_variable:138 #5 ExternalAuthManagerThread::run (this=0x616000008d80) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/external_auth_manager_thread.cc:229 #6 0x00007f34b5a4b26d in Couchbase::Thread::thread_entry (this=0x616000008d80) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/thread.cc:45 #7 0x00007f34b5a06ae9 in run (this=0x60400000c290) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #8 platform_thread_wrap (arg=0x60400000c290) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #9 0x00007f34b27efea5 in start_thread (arg=0x7f34abc40700) at pthread_create.c:307 #10 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 8 (LWP 107438): #0 0x00007f34b250dc3d in poll () at ../sysdeps/unix/syscall-template.S:81 #1 0x00007f34c174a691 in poll () from /opt/couchbase/bin/../lib/libasan.so.4 #2 0x00007f34b9963788 in master_thread_run (ctx=0x61900000dc90) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/prometheus-cpp/prometheus-cpp-prefix/src/prometheus-cpp/3rdparty/civetweb/src/civetweb.c:19148 #3 master_thread (thread_func_param=0x61900000dc90) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/prometheus-cpp/prometheus-cpp-prefix/src/prometheus-cpp/3rdparty/civetweb/src/civetweb.c:19243 #4 0x00007f34b27efea5 in start_thread (arg=0x7f34ac457700) at pthread_create.c:307 #5 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 7 (LWP 107437): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007f34b996c7db in consume_socket (thread_index=, sp=0x6220000013e8, ctx=0x61900000dc90) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/prometheus-cpp/prometheus-cpp-prefix/src/prometheus-cpp/3rdparty/civetweb/src/civetweb.c:18718 #2 worker_thread_run (conn=0x622000000af8) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/prometheus-cpp/prometheus-cpp-prefix/src/prometheus-cpp/3rdparty/civetweb/src/civetweb.c:18859 #3 worker_thread (thread_func_param=0x622000000af8) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/prometheus-cpp/prometheus-cpp-prefix/src/prometheus-cpp/3rdparty/civetweb/src/civetweb.c:19002 #4 0x00007f34b27efea5 in start_thread (arg=0x7f34acc6e700) at pthread_create.c:307 #5 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 6 (LWP 107436): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007f34b996c7db in consume_socket (thread_index=, sp=0x622000000a00, ctx=0x61900000dc90) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/prometheus-cpp/prometheus-cpp-prefix/src/prometheus-cpp/3rdparty/civetweb/src/civetweb.c:18718 #2 worker_thread_run (conn=0x622000000110) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/prometheus-cpp/prometheus-cpp-prefix/src/prometheus-cpp/3rdparty/civetweb/src/civetweb.c:18859 #3 worker_thread (thread_func_param=0x622000000110) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/prometheus-cpp/prometheus-cpp-prefix/src/prometheus-cpp/3rdparty/civetweb/src/civetweb.c:19002 #4 0x00007f34b27efea5 in start_thread (arg=0x7f34ad485700) at pthread_create.c:307 #5 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 5 (LWP 107435): #0 0x00007f34b250dc3d in poll () at ../sysdeps/unix/syscall-template.S:81 #1 0x00007f34c174a691 in poll () from /opt/couchbase/bin/../lib/libasan.so.4 #2 0x00000000006a93e2 in get_command (buffsize=80, buffer=0x7f34adc859b0 "0X\310\255\064\177") at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/stdin_check.cc:49 #3 check_stdin_thread (arg=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/stdin_check.cc:90 #4 0x00007f34b5a06ae9 in run (this=0x6040000081d0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58 #5 platform_thread_wrap (arg=0x6040000081d0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71 #6 0x00007f34b27efea5 in start_thread (arg=0x7f34adc9d700) at pthread_create.c:307 #7 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 4 (LWP 107434): #0 0x00007f34b6a618ac in _M_add_ref_lock_nothrow (this=) at /usr/local/include/c++/7.3.0/bits/shared_ptr_base.h:294 #1 __shared_count (__r=..., this=0x7f34ae49bed8) at /usr/local/include/c++/7.3.0/bits/shared_ptr_base.h:865 #2 __shared_ptr (__r=..., this=0x7f34ae49bed0) at /usr/local/include/c++/7.3.0/bits/shared_ptr_base.h:1345 #3 shared_ptr (__r=..., this=0x7f34ae49bed0) at /usr/local/include/c++/7.3.0/bits/shared_ptr.h:353 #4 lock (this=) at /usr/local/include/c++/7.3.0/bits/shared_ptr.h:584 #5 spdlog::details::registry::flush_all (this=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/third_party/spdlog/include/spdlog/details/registry.h:169 #6 0x00007f34b6a485a4 in __invoke_impl (__t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #7 __invoke (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #8 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #9 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #10 std::_Function_handler >::_M_invoke(std::_Any_data const&) (__functor=...) at /usr/local/include/c++/7.3.0/bits/std_function.h:316 #11 0x00007f34b6a5d88b in operator() (this=0x60600000d9b0) at /usr/local/include/c++/7.3.0/bits/std_function.h:706 #12 operator() (__closure=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/third_party/spdlog/include/spdlog/details/periodic_worker.h:42 #13 __invoke_impl&, std::chrono::seconds):: > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #14 __invoke&, std::chrono::seconds):: > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #15 _M_invoke<0> (this=) at /usr/local/include/c++/7.3.0/thread:234 #16 operator() (this=) at /usr/local/include/c++/7.3.0/thread:243 #17 _ZNSt6thread11_State_implINS_8_InvokerISt5tupleIJZN6spdlog7details15periodic_workerC4ERKSt8functionIFvvEENSt6chrono8durationIlSt5ratioILl1ELl1EEEEEUlvE_EEEEE6_M_runEv (this=) at /usr/local/include/c++/7.3.0/thread:186 #18 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60600000d9a0) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #19 0x00007f34b27efea5 in start_thread (arg=0x7f34ae4b4700) at pthread_create.c:307 #20 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 3 (LWP 107433): #0 pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238 #1 0x00007f34b6a8745b in __gthread_cond_timedwait (__abs_timeout=0x7f34aecc3680, __mutex=, __cond=0x611000000e38) at /usr/local/include/c++/7.3.0/x86_64-pc-linux-gnu/bits/gthr-default.h:871 #2 __wait_until_impl > > (__atime=..., __lock=..., this=0x611000000e38) at /usr/local/include/c++/7.3.0/condition_variable:166 #3 wait_until > > (__atime=..., __lock=..., this=0x611000000e38) at /usr/local/include/c++/7.3.0/condition_variable:106 #4 wait_until >, spdlog::details::mpmc_blocking_queue::dequeue_for(T&, std::chrono::milliseconds) [with T = spdlog::details::async_msg]:: > (__p=..., __atime=..., __lock=..., this=) at /usr/local/include/c++/7.3.0/condition_variable:129 #5 wait_for, spdlog::details::mpmc_blocking_queue::dequeue_for(T&, std::chrono::milliseconds) [with T = spdlog::details::async_msg]:: > (__p=..., __rtime=..., __lock=..., this=0x611000000e38) at /usr/local/include/c++/7.3.0/condition_variable:145 #6 dequeue_for (wait_duration=..., popped_item=..., this=0x611000000e10) at /home/couchbase/jenkins/workspace/couchbase-server-unix/third_party/spdlog/include/spdlog/details/mpmc_blocking_q.h:61 #7 spdlog::details::thread_pool::process_next_msg_ (this=this@entry=0x611000000e10) at /home/couchbase/jenkins/workspace/couchbase-server-unix/third_party/spdlog/include/spdlog/details/thread_pool.h:193 #8 0x00007f34b6a89cbd in spdlog::details::thread_pool::worker_loop_ (this=0x611000000e10) at /home/couchbase/jenkins/workspace/couchbase-server-unix/third_party/spdlog/include/spdlog/details/thread_pool.h:184 #9 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60300003c130) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #10 0x00007f34b27efea5 in start_thread (arg=0x7f34aecdb700) at pthread_create.c:307 #11 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 2 (LWP 107393): #0 0x00007f34b27f1d5d in __GI___pthread_mutex_lock (mutex=0x3150e38 ) at ../nptl/pthread_mutex_lock.c:78 #1 0x0000000000490dd7 in bucketsForEach(std::function, void*) (fn=..., arg=) at /usr/local/include/c++/7.3.0/x86_64-pc-linux-gnu/bits/gthr-default.h:748 #2 0x0000000000857eac in mc_time_clock_tick () at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/mc_time.cc:259 #3 0x00000000008588e7 in mc_time_clock_event_handler (fd=, which=, arg=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/mc_time.cc:198 #4 0x00007f34b4d9ef58 in event_process_active_single_queue (base=base@entry=0x617000001c80, max_to_process=max_to_process@entry=2147483647, endtime=endtime@entry=0x0, activeq=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:1697 #5 0x00007f34b4d9f54f in event_process_active (base=0x617000001c80) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:1789 #6 event_base_loop (base=0x617000001c80, flags=flags@entry=0) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/libevent/libevent-prefix/src/libevent/event.c:2012 #7 0x00000000004bf88f in memcached_main (argc=, argv=) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/memcached.cc:1531 #8 0x00007f34b243c555 in __libc_start_main (main=0x47a180 , argc=3, argv=0x7ffe5b1bc818, init=, fini=, rtld_fini=, stack_end=0x7ffe5b1bc808) at ../csu/libc-start.c:266 #9 0x000000000048bb05 in _start () Thread 1 (LWP 107926): #0 0x00007f34b2450387 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:55 #1 0x00007f34b2451a78 in __GI_abort () at abort.c:90 #2 0x00007f34b3ccc195 in __gnu_cxx::__verbose_terminate_handler () at /tmp/deploy/gcc-7.3.0/libstdc++-v3/libsupc++/vterminate.cc:95 #3 0x0000000000c6104e in backtrace_terminate_handler () at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/utilities/terminate_handler.cc:86 #4 0x00007f34b3cc9f86 in __cxxabiv1::__terminate (handler=) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/libsupc++/eh_terminate.cc:47 #5 0x00007f34b3cc9fd1 in std::terminate () at /tmp/deploy/gcc-7.3.0/libstdc++-v3/libsupc++/eh_terminate.cc:57 #6 0x00007f34bccd360f in GlobalTask::execute (this=this@entry=0x61200001a150) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/globaltask.cc:77 #7 0x00007f34bcca5fc6 in FollyExecutorPool::TaskProxy::scheduleViaCPUPool()::{lambda()#1}::operator()() const (__closure=0x7f3499ad4830) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/folly_executorpool.cc:167 #8 0x00007f34bd5865c6 in operator() (this=0x7f3499ad4830) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:416 #9 folly::ThreadPoolExecutor::runTask(std::shared_ptr const&, folly::ThreadPoolExecutor::Task&&) (this=0x61e000158480, thread=..., task=) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/ThreadPoolExecutor.cpp:98 #10 0x00007f34bd56ea0a in folly::CPUThreadPoolExecutor::threadRun (this=0x61e000158480, thread=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/CPUThreadPoolExecutor.cpp:265 #11 0x00007f34bd5896e9 in __invoke_impl), folly::ThreadPoolExecutor*&, std::shared_ptr&> ( __t=, __f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:73 #12 __invoke), folly::ThreadPoolExecutor*&, std::shared_ptr&> (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #13 __call (__args=, this=) at /usr/local/include/c++/7.3.0/functional:467 #14 operator()<> (this=) at /usr/local/include/c++/7.3.0/functional:551 #15 folly::detail::function::FunctionTraits::callBig))(std::shared_ptr)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401 #16 0x00007f34bcc92c59 in operator() (this=0x6070008e9380) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #17 operator() (__closure=0x6070008e9370) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/PriorityThreadFactory.h:54 #18 folly::detail::function::FunctionTraits::callBig&&)::{lambda()#1}>(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:401 #19 0x00007f34bcc8d704 in operator() (this=0x60b00005bf90) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:416 #20 operator() (__closure=0x60b00005bf90) at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/executors/thread_factory/NamedThreadFactory.h:40 #21 __invoke_impl > (__f=) at /usr/local/include/c++/7.3.0/bits/invoke.h:60 #22 __invoke > (__fn=) at /usr/local/include/c++/7.3.0/bits/invoke.h:95 #23 _M_invoke<0> (this=0x60b00005bf90) at /usr/local/include/c++/7.3.0/thread:234 #24 operator() (this=0x60b00005bf90) at /usr/local/include/c++/7.3.0/thread:243 #25 std::thread::_State_impl&&)::{lambda()#1}> > >::_M_run() (this=0x60b00005bf80) at /usr/local/include/c++/7.3.0/thread:186 #26 0x00007f34b3cf4dcf in std::execute_native_thread_routine (__p=0x60b00005bf80) at /tmp/deploy/gcc-7.3.0/libstdc++-v3/src/c++11/thread.cc:83 #27 0x00007f34b27efea5 in start_thread (arg=0x7f3499aec700) at pthread_create.c:307 #28 0x00007f34b25188dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No core file now.