Basic crash dump analysis of /tmp//core.mc:worker_2.14946. Please send the file to support@couchbase.com -------------------------------------------------------------------------------- File information: -rwxr-xr-x 1 couchbase couchbase 587960 Jul 19 07:39 /opt/couchbase/bin/memcached 6b5e5228950870c5e13c23e1025a2ddf /opt/couchbase/bin/memcached -rw------- 1 couchbase couchbase 431820800 Jul 25 01:04 /tmp//core.mc:worker_2.14946 cdaba678fdd162686354134e6646aa2f /tmp//core.mc:worker_2.14946 -------------------------------------------------------------------------------- Core file callstacks: GNU gdb (GDB) Red Hat Enterprise Linux (7.2-60.el6_4.1) Copyright (C) 2010 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /opt/couchbase/bin/memcached...(no debugging symbols found)...done. [New Thread 14966] [New Thread 15422] [New Thread 14968] [New Thread 14971] [New Thread 14961] [New Thread 14970] [New Thread 15416] [New Thread 14969] [New Thread 15419] [New Thread 14959] [New Thread 14963] [New Thread 15418] [New Thread 15420] [New Thread 14967] [New Thread 15421] [New Thread 15423] [New Thread 15414] [New Thread 15547] [New Thread 15424] [New Thread 15417] [New Thread 14964] [New Thread 15415] [New Thread 14946] Reading symbols from /opt/couchbase/bin/../lib/libauditd.so.0.1.0...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/libauditd.so.0.1.0 Reading symbols from /opt/couchbase/bin/../lib/libmcd_time.so.1.0.0...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/libmcd_time.so.1.0.0 Reading symbols from /opt/couchbase/bin/../lib/libdirutils.so.0.1.0...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/libdirutils.so.0.1.0 Reading symbols from /opt/couchbase/bin/../lib/libmcd_util.so.1.0.0...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/libmcd_util.so.1.0.0 Reading symbols from /opt/couchbase/bin/../lib/libcbsasl.so.1.1.1...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/libcbsasl.so.1.1.1 Reading symbols from /opt/couchbase/bin/../lib/libcJSON.so.1.1.0...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/libcJSON.so.1.1.0 Reading symbols from /opt/couchbase/bin/../lib/libJSON_checker.so.1.0.0...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/libJSON_checker.so.1.0.0 Reading symbols from /opt/couchbase/bin/../lib/libplatform.so.0.1.0...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/libplatform.so.0.1.0 Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libdl.so.2 Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done. [Thread debugging using libthread_db enabled] Loaded symbols for /lib64/libpthread.so.0 Reading symbols from /lib64/librt.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/librt.so.1 Reading symbols from /opt/couchbase/bin/../lib/libsnappy.so.1...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/libsnappy.so.1 Reading symbols from /opt/couchbase/bin/../lib/libjemalloc.so.2...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/libjemalloc.so.2 Reading symbols from /opt/couchbase/bin/../lib/libevent_core-2.0.so.5...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/libevent_core-2.0.so.5 Reading symbols from /usr/lib64/libssl.so.10...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libssl.so.10 Reading symbols from /usr/lib64/libcrypto.so.10...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libcrypto.so.10 Reading symbols from /opt/couchbase/bin/../lib/libnuma.so.1...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/libnuma.so.1 Reading symbols from /opt/couchbase/bin/../lib/libevent_pthreads-2.0.so.5...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/libevent_pthreads-2.0.so.5 Reading symbols from /usr/lib64/libstdc++.so.6...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libstdc++.so.6 Reading symbols from /lib64/libm.so.6...(no debugging symbols found)...done. Loaded symbols for /lib64/libm.so.6 Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libgcc_s.so.1 Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib64/libc.so.6 Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /lib64/libgssapi_krb5.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libgssapi_krb5.so.2 Reading symbols from /lib64/libkrb5.so.3...(no debugging symbols found)...done. Loaded symbols for /lib64/libkrb5.so.3 Reading symbols from /lib64/libcom_err.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libcom_err.so.2 Reading symbols from /lib64/libk5crypto.so.3...(no debugging symbols found)...done. Loaded symbols for /lib64/libk5crypto.so.3 Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libz.so.1 Reading symbols from /lib64/libkrb5support.so.0...(no debugging symbols found)...done. Loaded symbols for /lib64/libkrb5support.so.0 Reading symbols from /lib64/libkeyutils.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libkeyutils.so.1 Reading symbols from /lib64/libresolv.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libresolv.so.2 Reading symbols from /lib64/libselinux.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libselinux.so.1 Reading symbols from /opt/couchbase/lib/memcached/stdin_term_handler.so...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/lib/memcached/stdin_term_handler.so Reading symbols from /opt/couchbase/lib/memcached/file_logger.so...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/lib/memcached/file_logger.so Reading symbols from /opt/couchbase/bin/../lib/../lib/nobucket.so...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/../lib/nobucket.so Reading symbols from /opt/couchbase/bin/../lib/../lib/default_engine.so...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/../lib/default_engine.so Reading symbols from /opt/couchbase/bin/../lib/../lib/ep.so...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/../lib/ep.so Reading symbols from /opt/couchbase/bin/../lib/../lib/../lib/libcouchstore.so...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/../lib/../lib/libcouchstore.so Reading symbols from /opt/couchbase/bin/../lib/../lib/../lib/libforestdb.so...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/../lib/../lib/libforestdb.so Reading symbols from /opt/couchbase/bin/../lib/../lib/../lib/libv8.so...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/../lib/../lib/libv8.so Reading symbols from /opt/couchbase/bin/../lib/../lib/../lib/libicuuc.so.54...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/../lib/../lib/libicuuc.so.54 Reading symbols from /opt/couchbase/bin/../lib/../lib/../lib/libicudata.so.54...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/../lib/../lib/libicudata.so.54 Reading symbols from /opt/couchbase/bin/../lib/../lib/../lib/libicui18n.so.54...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/bin/../lib/../lib/../lib/libicui18n.so.54 Core was generated by `/opt/couchbase/bin/memcached -C /opt/couchbase/var/lib/couchbase/config/memcach'. Program terminated with signal 11, Segmentation fault. #0 0x00007fc8ee05849d in event_base_loop () from /opt/couchbase/bin/../lib/libevent_core-2.0.so.5 Thread 23 (Thread 0x7fc8eff62820 (LWP 14946)): #0 0x00007fc8ee8d85bc in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8ed3a82fc in std::condition_variable::wait(std::unique_lock&) () from /usr/lib64/libstdc++.so.6 #2 0x00007fc8eecf7ebb in Couchbase::Thread::waitForState(Couchbase::ThreadState const&) () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #3 0x0000000000414290 in _start () Thread 22 (Thread 0x7fc8dc7fd700 (LWP 15415)): #0 0x00007fc8ee8d898e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8e834c4fb in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #2 0x00007fc8e834e5a0 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #3 0x00007fc8e830c5f6 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #4 0x00007fc8e830c6d1 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #5 0x00007fc8e8314968 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #6 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #7 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 21 (Thread 0x7fc8e39ff700 (LWP 14964)): #0 0x00007fc8ecbad163 in epoll_wait () from /lib64/libc.so.6 #1 0x00007fc8ee06ae93 in ?? () from /opt/couchbase/bin/../lib/libevent_core-2.0.so.5 #2 0x00007fc8ee057f42 in event_base_loop () from /opt/couchbase/bin/../lib/libevent_core-2.0.so.5 #3 0x0000000000423524 in ?? () #4 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #5 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 20 (Thread 0x7fc8db3fb700 (LWP 15417)): #0 0x00007fc8ee8d898e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8e834c4fb in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #2 0x00007fc8e834e5a0 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #3 0x00007fc8e830c5f6 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #4 0x00007fc8e830c6d1 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #5 0x00007fc8e8314968 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #6 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #7 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 19 (Thread 0x7fc8d6df4700 (LWP 15424)): #0 0x00007fc8ee8d898e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8e834c4fb in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #2 0x00007fc8e834e5a0 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #3 0x00007fc8e830c5f6 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #4 0x00007fc8e830c6d1 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #5 0x00007fc8e8314968 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #6 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #7 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 18 (Thread 0x7fc8de9f7700 (LWP 15547)): #0 0x00007fc8ee8d898e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8eecf4099 in cb_cond_timedwait () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #2 0x0000000000413aa4 in _start () Thread 17 (Thread 0x7fc8dd1fe700 (LWP 15414)): #0 0x00007fc8ee8d898e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8e83260f0 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #2 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #3 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #4 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 16 (Thread 0x7fc8d77f5700 (LWP 15423)): #0 0x00007fc8ee8d898e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8e834c4fb in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #2 0x00007fc8e834e5a0 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #3 0x00007fc8e830c5f6 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #4 0x00007fc8e830c6d1 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #5 0x00007fc8e8314968 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #6 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #7 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7fc8d8bf7700 (LWP 15421)): #0 0x00007fc8ee8d898e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8e834c4fb in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #2 0x00007fc8e834e5a0 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #3 0x00007fc8e830c5f6 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #4 0x00007fc8e830c6d1 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #5 0x00007fc8e8314968 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #6 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #7 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7fc8e1bfc700 (LWP 14967)): #0 0x00007fc8ecbad163 in epoll_wait () from /lib64/libc.so.6 #1 0x00007fc8ee06ae93 in ?? () from /opt/couchbase/bin/../lib/libevent_core-2.0.so.5 #2 0x00007fc8ee057f42 in event_base_loop () from /opt/couchbase/bin/../lib/libevent_core-2.0.so.5 #3 0x0000000000423524 in ?? () #4 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #5 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7fc8d95f8700 (LWP 15420)): #0 0x00007fc8ee8d898e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8e834c4fb in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #2 0x00007fc8e834e5a0 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #3 0x00007fc8e830c5f6 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #4 0x00007fc8e830c6d1 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #5 0x00007fc8e8314968 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #6 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #7 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7fc8da9fa700 (LWP 15418)): #0 0x00007fc8ee8d898e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8e834c4fb in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #2 0x00007fc8e834e5a0 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #3 0x00007fc8e830c5f6 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #4 0x00007fc8e830c6d1 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #5 0x00007fc8e8314968 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #6 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #7 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7fc8e93fe700 (LWP 14963)): #0 0x00007fc8ee8d898e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8eecf4099 in cb_cond_timedwait () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #2 0x00007fc8efb4c327 in ?? () from /opt/couchbase/bin/../lib/libauditd.so.0.1.0 #3 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #4 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #5 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 10 (Thread 0x7fc8eaffd700 (LWP 14959)): #0 0x00007fc8ecba3343 in poll () from /lib64/libc.so.6 #1 0x00007fc8eaffeb58 in ?? () from /opt/couchbase/lib/memcached/stdin_term_handler.so #2 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #3 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #4 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7fc8d9ff9700 (LWP 15419)): #0 0x00007fc8ee8d898e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8e834c4fb in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #2 0x00007fc8e834e5a0 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #3 0x00007fc8e830c5f6 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #4 0x00007fc8e830c6d1 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #5 0x00007fc8e8314968 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #6 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #7 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7fc8e07fa700 (LWP 14969)): #0 0x00007fc8ee8d85bc in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8ed3a82fc in std::condition_variable::wait(std::unique_lock&) () from /usr/lib64/libstdc++.so.6 #2 0x0000000000437d40 in ?? () #3 0x00007fc8eecf7bab in Couchbase::Thread::thread_entry() () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #4 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #5 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7fc8dbdfc700 (LWP 15416)): #0 0x00007fc8ee8d898e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8e834c4fb in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #2 0x00007fc8e834e5a0 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #3 0x00007fc8e830c5f6 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #4 0x00007fc8e830c6d1 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #5 0x00007fc8e8314968 in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #6 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #7 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7fc8dfdf9700 (LWP 14970)): #0 0x00007fc8ee8d85bc in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8ed3a82fc in std::condition_variable::wait(std::unique_lock&) () from /usr/lib64/libstdc++.so.6 #2 0x0000000000437d40 in ?? () #3 0x00007fc8eecf7bab in Couchbase::Thread::thread_entry() () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #4 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #5 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7fc8e9dff700 (LWP 14961)): #0 0x00007fc8ee8d898e in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8eecf4099 in cb_cond_timedwait () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #2 0x00007fc8ea3f99f5 in ?? () from /opt/couchbase/lib/memcached/file_logger.so #3 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #4 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #5 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7fc8df3f8700 (LWP 14971)): #0 0x00007fc8ee8d85bc in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8ed3a82fc in std::condition_variable::wait(std::unique_lock&) () from /usr/lib64/libstdc++.so.6 #2 0x0000000000437d40 in ?? () #3 0x00007fc8eecf7bab in Couchbase::Thread::thread_entry() () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #4 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #5 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7fc8e11fb700 (LWP 14968)): #0 0x00007fc8ee8d85bc in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fc8ed3a82fc in std::condition_variable::wait(std::unique_lock&) () from /usr/lib64/libstdc++.so.6 #2 0x0000000000437d40 in ?? () #3 0x00007fc8eecf7bab in Couchbase::Thread::thread_entry() () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #4 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #5 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #6 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7fc8d81f6700 (LWP 15422)): #0 0x0000000000460110 in google_breakpad::ExceptionHandler::SignalHandler(int, siginfo*, void*) () #1 #2 0x000000000042458c in ?? () #3 0x0000000000424745 in ?? () #4 0x00007fc8e82db72d in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #5 0x00007fc8e83147be in ?? () from /opt/couchbase/bin/../lib/../lib/ep.so #6 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #7 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7fc8e25fd700 (LWP 14966)): #0 0x00007fc8ee05849d in event_base_loop () from /opt/couchbase/bin/../lib/libevent_core-2.0.so.5 #1 0x0000000000423524 in ?? () #2 0x00007fc8eecf389a in ?? () from /opt/couchbase/bin/../lib/libplatform.so.0.1.0 #3 0x00007fc8ee8d49d1 in start_thread () from /lib64/libpthread.so.0 #4 0x00007fc8ecbacb6d in clone () from /lib64/libc.so.6 -------------------------------------------------------------------------------- Module information: /opt/couchbase/bin/../lib/libauditd.so.0.1.0: -rwxr-xr-x 1 couchbase couchbase 100320 Jul 19 07:39 /opt/couchbase/bin/../lib/libauditd.so.0.1.0 290784c38aa4231d0e58d3af2849a944 /opt/couchbase/bin/../lib/libauditd.so.0.1.0 /opt/couchbase/bin/../lib/libmcd_time.so.1.0.0: -rwxr-xr-x 1 couchbase couchbase 7592 Jul 19 07:39 /opt/couchbase/bin/../lib/libmcd_time.so.1.0.0 31fac57ea758664996f24423d4a6ba0e /opt/couchbase/bin/../lib/libmcd_time.so.1.0.0 /opt/couchbase/bin/../lib/libdirutils.so.0.1.0: -rwxr-xr-x 1 couchbase couchbase 15336 Jul 19 07:39 /opt/couchbase/bin/../lib/libdirutils.so.0.1.0 cbfe508e2ee49c37d9a27dc0cd99dc81 /opt/couchbase/bin/../lib/libdirutils.so.0.1.0 /opt/couchbase/bin/../lib/libmcd_util.so.1.0.0: -rwxr-xr-x 1 couchbase couchbase 31976 Jul 19 07:39 /opt/couchbase/bin/../lib/libmcd_util.so.1.0.0 c3100998624a5149b550c0e692d3f134 /opt/couchbase/bin/../lib/libmcd_util.so.1.0.0 /opt/couchbase/bin/../lib/libcbsasl.so.1.1.1: -rwxr-xr-x 1 couchbase couchbase 159048 Jul 19 07:39 /opt/couchbase/bin/../lib/libcbsasl.so.1.1.1 5e44db18d0049d6321bee0e27b95836b /opt/couchbase/bin/../lib/libcbsasl.so.1.1.1 /opt/couchbase/bin/../lib/libcJSON.so.1.1.0: -rwxr-xr-x 1 couchbase couchbase 23568 Jul 19 07:39 /opt/couchbase/bin/../lib/libcJSON.so.1.1.0 1b9d2c33fb5fc804efcd4d6225248156 /opt/couchbase/bin/../lib/libcJSON.so.1.1.0 /opt/couchbase/bin/../lib/libJSON_checker.so.1.0.0: -rwxr-xr-x 1 couchbase couchbase 18008 Jul 19 07:39 /opt/couchbase/bin/../lib/libJSON_checker.so.1.0.0 7e91cf38da8765960b82e4459f040d3a /opt/couchbase/bin/../lib/libJSON_checker.so.1.0.0 /opt/couchbase/bin/../lib/libplatform.so.0.1.0: -rwxr-xr-x 1 couchbase couchbase 57576 Jul 19 07:39 /opt/couchbase/bin/../lib/libplatform.so.0.1.0 bc389857fef787f52203f9008c46a24a /opt/couchbase/bin/../lib/libplatform.so.0.1.0 /lib64/libdl.so.2: lrwxrwxrwx. 1 root root 13 Jun 26 2014 /lib64/libdl.so.2 -> libdl-2.12.so edb686710e606ba7f63ebf923fddc1de /lib64/libdl.so.2 /lib64/libpthread.so.0: lrwxrwxrwx. 1 root root 18 Jun 26 2014 /lib64/libpthread.so.0 -> libpthread-2.12.so b3e172fde149a8bbc0f8f8f219665cf7 /lib64/libpthread.so.0 /lib64/librt.so.1: lrwxrwxrwx. 1 root root 13 Jun 26 2014 /lib64/librt.so.1 -> librt-2.12.so 0fa1bf77fabba484c44107085db28216 /lib64/librt.so.1 /opt/couchbase/bin/../lib/libsnappy.so.1: lrwxrwxrwx 1 couchbase couchbase 18 Jul 24 23:33 /opt/couchbase/bin/../lib/libsnappy.so.1 -> libsnappy.so.1.2.0 2811d7c53df31bee5a33faf3b43c46bb /opt/couchbase/bin/../lib/libsnappy.so.1 /opt/couchbase/bin/../lib/libjemalloc.so.2: -rwxr-xr-x 1 couchbase couchbase 294224 Jul 19 07:39 /opt/couchbase/bin/../lib/libjemalloc.so.2 c3a03adcc357db7c7a6a016a6779486d /opt/couchbase/bin/../lib/libjemalloc.so.2 /opt/couchbase/bin/../lib/libevent_core-2.0.so.5: lrwxrwxrwx 1 couchbase couchbase 27 Jul 24 23:33 /opt/couchbase/bin/../lib/libevent_core-2.0.so.5 -> libevent_core-2.0.so.5.1.10 26a7a84bd00c1b22b64468241b29fa36 /opt/couchbase/bin/../lib/libevent_core-2.0.so.5 /usr/lib64/libssl.so.10: lrwxrwxrwx. 1 root root 16 Jun 26 2014 /usr/lib64/libssl.so.10 -> libssl.so.1.0.1e 3907083410e4dfed61210fcdf8c27a46 /usr/lib64/libssl.so.10 /usr/lib64/libcrypto.so.10: lrwxrwxrwx. 1 root root 19 Jun 26 2014 /usr/lib64/libcrypto.so.10 -> libcrypto.so.1.0.1e a6f00c5b250e2e547dbbb88e2e956129 /usr/lib64/libcrypto.so.10 /opt/couchbase/bin/../lib/libnuma.so.1: -rwxr-xr-x 1 couchbase couchbase 36240 Jul 19 07:39 /opt/couchbase/bin/../lib/libnuma.so.1 72a895738e8bebe59824fd81744eb3ad /opt/couchbase/bin/../lib/libnuma.so.1 /opt/couchbase/bin/../lib/libevent_pthreads-2.0.so.5: lrwxrwxrwx 1 couchbase couchbase 31 Jul 24 23:33 /opt/couchbase/bin/../lib/libevent_pthreads-2.0.so.5 -> libevent_pthreads-2.0.so.5.1.10 fb15fb0d0d000f17437d51cad511d194 /opt/couchbase/bin/../lib/libevent_pthreads-2.0.so.5 /usr/lib64/libstdc++.so.6: lrwxrwxrwx. 1 root root 19 Jun 26 2014 /usr/lib64/libstdc++.so.6 -> libstdc++.so.6.0.13 5fca8c3a8f76f6eca0c47ca31fa5fff9 /usr/lib64/libstdc++.so.6 /lib64/libm.so.6: lrwxrwxrwx. 1 root root 12 Jun 26 2014 /lib64/libm.so.6 -> libm-2.12.so de92a26a843b8f246860788d2d734479 /lib64/libm.so.6 /lib64/libgcc_s.so.1: lrwxrwxrwx. 1 root root 28 Jun 26 2014 /lib64/libgcc_s.so.1 -> libgcc_s-4.4.7-20120601.so.1 c38fffa3e98af77c14817139e1619684 /lib64/libgcc_s.so.1 /lib64/libc.so.6: lrwxrwxrwx. 1 root root 12 Jun 26 2014 /lib64/libc.so.6 -> libc-2.12.so c0090df6f1bb5511ac48b2e7e4ff3582 /lib64/libc.so.6 /lib64/ld-linux-x86-64.so.2: lrwxrwxrwx. 1 root root 10 Jun 26 2014 /lib64/ld-linux-x86-64.so.2 -> ld-2.12.so bebf225d79eebddf3f021fde519190c7 /lib64/ld-linux-x86-64.so.2 /lib64/libgssapi_krb5.so.2: lrwxrwxrwx. 1 root root 21 Jun 26 2014 /lib64/libgssapi_krb5.so.2 -> libgssapi_krb5.so.2.2 953833a08c92ecd9650aa9f74772160d /lib64/libgssapi_krb5.so.2 /lib64/libkrb5.so.3: lrwxrwxrwx. 1 root root 14 Jun 26 2014 /lib64/libkrb5.so.3 -> libkrb5.so.3.3 982b29d819fd19092459777108bf5660 /lib64/libkrb5.so.3 /lib64/libcom_err.so.2: lrwxrwxrwx. 1 root root 17 Jun 26 2014 /lib64/libcom_err.so.2 -> libcom_err.so.2.1 b32f935ae5131dff1c7222bf398de5d1 /lib64/libcom_err.so.2 /lib64/libk5crypto.so.3: lrwxrwxrwx. 1 root root 18 Jun 26 2014 /lib64/libk5crypto.so.3 -> libk5crypto.so.3.1 300d67a9ca292c96eafafd796a10c6f4 /lib64/libk5crypto.so.3 /lib64/libz.so.1: lrwxrwxrwx. 1 root root 13 Jun 26 2014 /lib64/libz.so.1 -> libz.so.1.2.3 e8ac93fdb47f4beb4560abee1ae5f0da /lib64/libz.so.1 /lib64/libkrb5support.so.0: lrwxrwxrwx. 1 root root 21 Jun 26 2014 /lib64/libkrb5support.so.0 -> libkrb5support.so.0.1 f7d26e6c613b2f4998b298b43b509615 /lib64/libkrb5support.so.0 /lib64/libkeyutils.so.1: lrwxrwxrwx. 1 root root 18 Jun 26 2014 /lib64/libkeyutils.so.1 -> libkeyutils.so.1.3 8002611a776e9de0ccf7832721b86d95 /lib64/libkeyutils.so.1 /lib64/libresolv.so.2: lrwxrwxrwx. 1 root root 17 Jun 26 2014 /lib64/libresolv.so.2 -> libresolv-2.12.so 48628ee5ee5efc24d872003a51ecef2a /lib64/libresolv.so.2 /lib64/libselinux.so.1: -rwxr-xr-x. 1 root root 122040 May 10 2013 /lib64/libselinux.so.1 0a438a255ce11f51605efe623823f887 /lib64/libselinux.so.1 /opt/couchbase/lib/memcached/stdin_term_handler.so: -rwxr-xr-x 1 couchbase couchbase 6792 Jul 19 07:39 /opt/couchbase/lib/memcached/stdin_term_handler.so d8fa0cdeb72479119ef6aaace3668e9a /opt/couchbase/lib/memcached/stdin_term_handler.so /opt/couchbase/lib/memcached/file_logger.so: -rwxr-xr-x 1 couchbase couchbase 23864 Jul 19 07:39 /opt/couchbase/lib/memcached/file_logger.so ba2708f13499ea120d130fbe0af80286 /opt/couchbase/lib/memcached/file_logger.so /opt/couchbase/bin/../lib/../lib/nobucket.so: -rwxr-xr-x 1 couchbase couchbase 6960 Jul 19 07:39 /opt/couchbase/bin/../lib/../lib/nobucket.so 9f297507896f0002315f9c5d18649873 /opt/couchbase/bin/../lib/../lib/nobucket.so /opt/couchbase/bin/../lib/../lib/default_engine.so: -rwxr-xr-x 1 couchbase couchbase 52552 Jul 19 07:39 /opt/couchbase/bin/../lib/../lib/default_engine.so 9f3898566fad79fea0cdcd68a2fbca92 /opt/couchbase/bin/../lib/../lib/default_engine.so /opt/couchbase/bin/../lib/../lib/ep.so: -rwxr-xr-x 1 couchbase couchbase 1532112 Jul 19 07:39 /opt/couchbase/bin/../lib/../lib/ep.so a21fbd56b9b8d2f720c73860c7c87cf5 /opt/couchbase/bin/../lib/../lib/ep.so /opt/couchbase/bin/../lib/../lib/../lib/libcouchstore.so: -rwxr-xr-x 1 couchbase couchbase 200216 Jul 19 07:39 /opt/couchbase/bin/../lib/../lib/../lib/libcouchstore.so 58b894f35b0e3d2072f46946cd3fb11e /opt/couchbase/bin/../lib/../lib/../lib/libcouchstore.so /opt/couchbase/bin/../lib/../lib/../lib/libforestdb.so: -rwxr-xr-x 1 couchbase couchbase 601432 Jul 19 07:39 /opt/couchbase/bin/../lib/../lib/../lib/libforestdb.so 6069ed1f589656afe5cc4d87bf77dfb4 /opt/couchbase/bin/../lib/../lib/../lib/libforestdb.so /opt/couchbase/bin/../lib/../lib/../lib/libv8.so: -rwxr-xr-x 1 couchbase couchbase 12605744 Jul 19 07:39 /opt/couchbase/bin/../lib/../lib/../lib/libv8.so 161d875708645183ab5175578ddba439 /opt/couchbase/bin/../lib/../lib/../lib/libv8.so /opt/couchbase/bin/../lib/../lib/../lib/libicuuc.so.54: lrwxrwxrwx 1 couchbase couchbase 16 Jul 24 23:33 /opt/couchbase/bin/../lib/../lib/../lib/libicuuc.so.54 -> libicuuc.so.54.1 1c55b75f5e597d1e772a720487560f32 /opt/couchbase/bin/../lib/../lib/../lib/libicuuc.so.54 /opt/couchbase/bin/../lib/../lib/../lib/libicudata.so.54: lrwxrwxrwx 1 couchbase couchbase 18 Jul 24 23:33 /opt/couchbase/bin/../lib/../lib/../lib/libicudata.so.54 -> libicudata.so.54.1 ae88c315fe48157aae6976c981e624ca /opt/couchbase/bin/../lib/../lib/../lib/libicudata.so.54 /opt/couchbase/bin/../lib/../lib/../lib/libicui18n.so.54: lrwxrwxrwx 1 couchbase couchbase 18 Jul 24 23:33 /opt/couchbase/bin/../lib/../lib/../lib/libicui18n.so.54 -> libicui18n.so.54.1 decf5cc88d23b661414408b17353326e /opt/couchbase/bin/../lib/../lib/../lib/libicui18n.so.54