[root@localhost ~]# gdb /opt/couchbase/bin/memcached /tmp/core.17839 GNU gdb (GDB) Red Hat Enterprise Linux (7.0.1-32.el5_6.2) Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /opt/couchbase/bin/memcached...(no debugging symbols found)...done. [New Thread 18290] [New Thread 18288] [New Thread 18287] [New Thread 17854] [New Thread 17853] [New Thread 17852] [New Thread 17851] [New Thread 17850] [New Thread 17849] [New Thread 17848] [New Thread 17839] Reading symbols from /opt/couchbase/lib/memcached/libmemcached_utilities.so.0...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/lib/memcached/libmemcached_utilities.so.0 Reading symbols from /opt/couchbase/lib/libevent-2.0.so.5...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/lib/libevent-2.0.so.5 Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libdl.so.2 Reading symbols from /lib64/libm.so.6...(no debugging symbols found)...done. Loaded symbols for /lib64/libm.so.6 Reading symbols from /lib64/librt.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/librt.so.1 Reading symbols from /opt/couchbase/lib/libtcmalloc_minimal.so.4...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/lib/libtcmalloc_minimal.so.4 Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done. Loaded symbols for /lib64/libpthread.so.0 Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib64/libc.so.6 Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /usr/lib64/libstdc++.so.6...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libstdc++.so.6 Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libgcc_s.so.1 Reading symbols from /opt/couchbase/lib/memcached/stdin_term_handler.so...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/lib/memcached/stdin_term_handler.so Reading symbols from /opt/couchbase/lib/memcached/bucket_engine.so...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/lib/memcached/bucket_engine.so Reading symbols from /opt/couchbase/lib/memcached/ep.so...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/lib/memcached/ep.so Reading symbols from /opt/couchbase/lib/libcouchstore.so.1...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/lib/libcouchstore.so.1 Reading symbols from /opt/couchbase/lib/libsnappy.so.1...(no debugging symbols found)...done. Loaded symbols for /opt/couchbase/lib/libsnappy.so.1 Reading symbols from /lib64/libnss_files.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libnss_files.so.2 Core was generated by `/opt/couchbase/bin/memcached -X /opt/couchbase/lib/memcached/stdin_term_handler'. Program terminated with signal 11, Segmentation fault. #0 0x00002aaaaad773f9 in HashTable::resize(unsigned long) () from /opt/couchbase/lib/memcached/ep.so (gdb) t a a bt Thread 12 (Thread 17839): #0 0x0000003bf28d48a8 in epoll_wait () from /lib64/libc.so.6 #1 0x00002b8960c18c28 in ?? () from /opt/couchbase/lib/libevent-2.0.so.5 #2 0x00002b8960c07a4c in event_base_loop () from /opt/couchbase/lib/libevent-2.0.so.5 #3 0x0000000000409958 in pthread_attr_setdetachstate () #4 0x0000003bf281d994 in __libc_start_main () from /lib64/libc.so.6 #5 0x0000000000402969 in pthread_attr_setdetachstate () #6 0x00007fff4a0f90a8 in ?? () #7 0x0000000000000000 in ?? () Thread 11 (Thread 17848): #0 0x0000003bf28c678b in read () from /lib64/libc.so.6 #1 0x0000003bf286cd57 in _IO_new_file_underflow () from /lib64/libc.so.6 #2 0x0000003bf286d71e in _IO_default_uflow_internal () from /lib64/libc.so.6 #3 0x0000003bf2868fdb in getc () from /lib64/libc.so.6 #4 0x00002b896109c875 in ?? () from /opt/couchbase/lib/memcached/stdin_term_handler.so #5 0x0000003bf340673d in start_thread () from /lib64/libpthread.so.0 #6 0x0000003bf28d44bd in clone () from /lib64/libc.so.6 Thread 10 (Thread 17849): #0 0x0000003bf289a541 in nanosleep () from /lib64/libc.so.6 #1 0x0000003bf289a364 in sleep () from /lib64/libc.so.6 #2 0x00000000004150f8 in pthread_attr_setdetachstate () #3 0x0000003bf340673d in start_thread () from /lib64/libpthread.so.0 #4 0x0000003bf28d44bd in clone () from /lib64/libc.so.6 Thread 9 (Thread 17850): #0 0x0000003bf28d48a8 in epoll_wait () from /lib64/libc.so.6 #1 0x00002b8960c18c28 in ?? () from /opt/couchbase/lib/libevent-2.0.so.5 #2 0x00002b8960c07a4c in event_base_loop () from /opt/couchbase/lib/libevent-2.0.so.5 #3 0x00000000004135b4 in pthread_attr_setdetachstate () #4 0x0000003bf340673d in start_thread () from /lib64/libpthread.so.0 #5 0x0000003bf28d44bd in clone () from /lib64/libc.so.6 Thread 8 (Thread 17851): #0 0x0000003bf28d48a8 in epoll_wait () from /lib64/libc.so.6 #1 0x00002b8960c18c28 in ?? () from /opt/couchbase/lib/libevent-2.0.so.5 #2 0x00002b8960c07a4c in event_base_loop () from /opt/couchbase/lib/libevent-2.0.so.5 #3 0x00000000004135b4 in pthread_attr_setdetachstate () #4 0x0000003bf340673d in start_thread () from /lib64/libpthread.so.0 #5 0x0000003bf28d44bd in clone () from /lib64/libc.so.6 Thread 7 (Thread 17852): #0 0x0000003bf28d48a8 in epoll_wait () from /lib64/libc.so.6 #1 0x00002b8960c18c28 in ?? () from /opt/couchbase/lib/libevent-2.0.so.5 #2 0x00002b8960c07a4c in event_base_loop () from /opt/couchbase/lib/libevent-2.0.so.5 #3 0x00000000004135b4 in pthread_attr_setdetachstate () #4 0x0000003bf340673d in start_thread () from /lib64/libpthread.so.0 #5 0x0000003bf28d44bd in clone () from /lib64/libc.so.6 Thread 6 (Thread 17853): #0 0x0000003bf28d48a8 in epoll_wait () from /lib64/libc.so.6 #1 0x00002b8960c18c28 in ?? () from /opt/couchbase/lib/libevent-2.0.so.5 #2 0x00002b8960c07a4c in event_base_loop () from /opt/couchbase/lib/libevent-2.0.so.5 #3 0x00000000004135b4 in pthread_attr_setdetachstate () #4 0x0000003bf340673d in start_thread () from /lib64/libpthread.so.0 #5 0x0000003bf28d44bd in clone () from /lib64/libc.so.6 Thread 5 (Thread 17854): #0 0x0000003bf28d48a8 in epoll_wait () from /lib64/libc.so.6 #1 0x00002b8960c18c28 in ?? () from /opt/couchbase/lib/libevent-2.0.so.5 #2 0x00002b8960c07a4c in event_base_loop () from /opt/couchbase/lib/libevent-2.0.so.5 #3 0x00000000004135b4 in pthread_attr_setdetachstate () #4 0x0000003bf340673d in start_thread () from /lib64/libpthread.so.0 #5 0x0000003bf28d44bd in clone () from /lib64/libc.so.6 Thread 4 (Thread 18287): #0 0x0000003bf340aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002aaaaad2577e in Dispatcher::run() () from /opt/couchbase/lib/memcached/ep.so #2 0x00002aaaaad260fb in ?? () from /opt/couchbase/lib/memcached/ep.so #3 0x0000003bf340673d in start_thread () from /lib64/libpthread.so.0 #4 0x0000003bf28d44bd in clone () from /lib64/libc.so.6 Thread 3 (Thread 18288): #0 0x00002aaaab0f4f43 in total_read_len () from /opt/couchbase/lib/libcouchstore.so.1 #1 0x00002aaaab0f4fee in ?? () from /opt/couchbase/lib/libcouchstore.so.1 #2 0x00002aaaab0f514b in ?? () from /opt/couchbase/lib/libcouchstore.so.1 #3 0x00002aaaab0f5342 in pread_compressed () from /opt/couchbase/lib/libcouchstore.so.1 #4 0x00002aaaab0f261a in ei_decode_ref () from /opt/couchbase/lib/libcouchstore.so.1 #5 0x00002aaaab0f295a in ei_decode_ref () from /opt/couchbase/lib/libcouchstore.so.1 #6 0x00002aaaab0f295a in ei_decode_ref () from /opt/couchbase/lib/libcouchstore.so.1 #7 0x00002aaaab0f295a in ei_decode_ref () from /opt/couchbase/lib/libcouchstore.so.1 #8 0x00002aaaab0f2c20 in modify_btree () from /opt/couchbase/lib/libcouchstore.so.1 #9 0x00002aaaab0f3f60 in save_docs () from /opt/couchbase/lib/libcouchstore.so.1 #10 0x00002aaaaadcc9b1 in CouchKVStore::saveDocs(unsigned short, int, _doc**, _docinfo**, int) () from /opt/couchbase/lib/memcached/ep.so #11 0x00002aaaaadcd023 in CouchKVStore::commit2couchstore() () from /opt/couchbase/lib/memcached/ep.so #12 0x00002aaaaadcd22f in CouchKVStore::commit() () from /opt/couchbase/lib/memcached/ep.so #13 0x00002aaaaad32fd7 in TransactionContext::commit() () from /opt/couchbase/lib/memcached/ep.so #14 0x00002aaaaad367b6 in EventuallyPersistentStore::flushSome(std::queue, std::deque, std::allocator > > >*, std::queue, std::deque, std::allocator > > >*) () from /opt/couchbase/lib/memcached/ep.so #15 0x00002aaaaad68e17 in Flusher::doFlush() () from /opt/couchbase/lib/memcached/ep.so #16 0x00002aaaaad6988a in Flusher::step(Dispatcher&, std::tr1::shared_ptr) () from /opt/couchbase/lib/memcached/ep.so #17 0x00002aaaaad69bce in FlusherStepper::callback(Dispatcher&, std::tr1::shared_ptr) () from /opt/couchbase/lib/memcached/ep.so #18 0x00002aaaaad2683f in Task::run(Dispatcher&, std::tr1::shared_ptr) () from /opt/couchbase/lib/memcached/ep.so #19 0x00002aaaaad2594d in Dispatcher::run() () from /opt/couchbase/lib/memcached/ep.so #20 0x00002aaaaad260fb in ?? () from /opt/couchbase/lib/memcached/ep.so #21 0x0000003bf340673d in start_thread () from /lib64/libpthread.so.0 #22 0x0000003bf28d44bd in clone () from /lib64/libc.so.6 Thread 2 (Thread 18290): #0 0x0000003bf340b150 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00002aaaaad4b020 in EventuallyPersistentEngine::notifyPendingConnections() () from /opt/couchbase/lib/memcached/ep.so #2 0x00002aaaaad4b0f1 in EvpNotifyPendingConns () from /opt/couchbase/lib/memcached/ep.so #3 0x0000003bf340673d in start_thread () from /lib64/libpthread.so.0 #4 0x0000003bf28d44bd in clone () from /lib64/libc.so.6 Thread 1 (Thread 18289): #0 0x00002aaaaad773f9 in HashTable::resize(unsigned long) () from /opt/couchbase/lib/memcached/ep.so #1 0x00002aaaaad7767b in HashTable::resize() () from /opt/couchbase/lib/memcached/ep.so #2 0x00002aaaaad6a790 in ResizingVisitor::visitBucket(RCPtr&) () from /opt/couchbase/lib/memcached/ep.so #3 0x00002aaaaad29e0f in VBCBAdaptor::callback(Dispatcher&, std::tr1::shared_ptr) () from /opt/couchbase/lib/memcached/ep.so #4 0x00002aaaaad2683f in Task::run(Dispatcher&, std::tr1::shared_ptr) () from /opt/couchbase/lib/memcached/ep.so #5 0x00002aaaaad2594d in Dispatcher::run() () from /opt/couchbase/lib/memcached/ep.so #6 0x00002aaaaad260fb in ?? () from /opt/couchbase/lib/memcached/ep.so #7 0x0000003bf340673d in start_thread () from /lib64/libpthread.so.0 #8 0x0000003bf28d44bd in clone () from /lib64/libc.so.6