[root@centos-64-x64 data]# gdb /opt/couchbase/bin/memcached core.memcached.2540 
GNU gdb (GDB) Red Hat Enterprise Linux (7.2-60.el6_4.1)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /opt/couchbase/bin/memcached...done.
[New Thread 12237]
[New Thread 12239]
[New Thread 2546]
[New Thread 12241]
[New Thread 2577]
[New Thread 2540]
[New Thread 2545]
[New Thread 2578]
[New Thread 12236]
[New Thread 2583]
[New Thread 2580]
[New Thread 12235]
[New Thread 2582]
[New Thread 12238]
[New Thread 2579]
[New Thread 2581]
[New Thread 12240]
Reading symbols from /opt/couchbase/bin/../lib/memcached/libmcd_util.so.1.0.0...done.
Loaded symbols for /opt/couchbase/bin/../lib/memcached/libmcd_util.so.1.0.0
Reading symbols from /opt/couchbase/bin/../lib/libcbsasl.so.1.1.1...done.
Loaded symbols for /opt/couchbase/bin/../lib/libcbsasl.so.1.1.1
Reading symbols from /opt/couchbase/bin/../lib/libplatform.so.0.1.0...done.
Loaded symbols for /opt/couchbase/bin/../lib/libplatform.so.0.1.0
Reading symbols from /opt/couchbase/bin/../lib/libcJSON.so.1.0.0...done.
Loaded symbols for /opt/couchbase/bin/../lib/libcJSON.so.1.0.0
Reading symbols from /opt/couchbase/bin/../lib/libJSON_checker.so...done.
Loaded symbols for /opt/couchbase/bin/../lib/libJSON_checker.so
Reading symbols from /opt/couchbase/bin/../lib/libsnappy.so.1...done.
Loaded symbols for /opt/couchbase/bin/../lib/libsnappy.so.1
Reading symbols from /opt/couchbase/bin/../lib/libtcmalloc_minimal.so.4...done.
Loaded symbols for /opt/couchbase/bin/../lib/libtcmalloc_minimal.so.4
Reading symbols from /opt/couchbase/bin/../lib/libevent_core-2.0.so.5...done.
Loaded symbols for /opt/couchbase/bin/../lib/libevent_core-2.0.so.5
Reading symbols from /usr/lib64/libssl.so.6...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/libssl.so.6
Reading symbols from /usr/lib64/libcrypto.so.6...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/libcrypto.so.6
Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done.
[Thread debugging using libthread_db enabled]
Loaded symbols for /lib64/libpthread.so.0
Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libdl.so.2
Reading symbols from /lib64/librt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/librt.so.1
Reading symbols from /usr/lib64/libstdc++.so.6...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/libstdc++.so.6
Reading symbols from /lib64/libm.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libm.so.6
Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libgcc_s.so.1
Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libc.so.6
Reading symbols from /lib64/libgssapi_krb5.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libgssapi_krb5.so.2
Reading symbols from /lib64/libkrb5.so.3...(no debugging symbols found)...done.
Loaded symbols for /lib64/libkrb5.so.3
Reading symbols from /lib64/libcom_err.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libcom_err.so.2
Reading symbols from /lib64/libk5crypto.so.3...(no debugging symbols found)...done.
Loaded symbols for /lib64/libk5crypto.so.3
Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libz.so.1
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /lib64/libkrb5support.so.0...(no debugging symbols found)...done.
Loaded symbols for /lib64/libkrb5support.so.0
Reading symbols from /lib64/libkeyutils.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libkeyutils.so.1
Reading symbols from /lib64/libresolv.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libresolv.so.2
Reading symbols from /lib64/libselinux.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libselinux.so.1
Reading symbols from /opt/couchbase/lib/memcached/stdin_term_handler.so...done.
Loaded symbols for /opt/couchbase/lib/memcached/stdin_term_handler.so
Reading symbols from /opt/couchbase/lib/memcached/file_logger.so...done.
Loaded symbols for /opt/couchbase/lib/memcached/file_logger.so
Reading symbols from /opt/couchbase/lib/memcached/bucket_engine.so...done.
Loaded symbols for /opt/couchbase/lib/memcached/bucket_engine.so
Reading symbols from /opt/couchbase/lib/memcached/ep.so...done.
Loaded symbols for /opt/couchbase/lib/memcached/ep.so
Reading symbols from /opt/couchbase/lib/libcouchstore.so...done.
Loaded symbols for /opt/couchbase/lib/libcouchstore.so
Reading symbols from /opt/couchbase/lib/libdirutils.so.0.1.0...done.
Loaded symbols for /opt/couchbase/lib/libdirutils.so.0.1.0
Reading symbols from /opt/couchbase/lib/libv8.so...done.
Loaded symbols for /opt/couchbase/lib/libv8.so
Reading symbols from /opt/couchbase/lib/libicui18n.so.44...(no debugging symbols found)...done.
Loaded symbols for /opt/couchbase/lib/libicui18n.so.44
Reading symbols from /opt/couchbase/lib/libicuuc.so.44...(no debugging symbols found)...done.
Loaded symbols for /opt/couchbase/lib/libicuuc.so.44
Reading symbols from /opt/couchbase/lib/libicudata.so.44...(no debugging symbols found)...done.
Loaded symbols for /opt/couchbase/lib/libicudata.so.44
Core was generated by `/opt/couchbase/bin/memcached -C /opt/couchbase/var/lib/couchbase/config/memcach'.
Program terminated with signal 6, Aborted.
#0  0x00007fcd864598a5 in raise () from /lib64/libc.so.6
Missing separate debuginfos, use: debuginfo-install couchbase-server-3.0.0-901.x86_64
(gdb) t a a bt

Thread 17 (Thread 0x7fcd7959e700 (LWP 12240)):
#0  0x00007fcd8650885d in fdatasync () from /lib64/libc.so.6
#1  0x00007fcd7e0f2637 in couch_sync (errinfo=0x32e4f6a0, handle=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/couchstore/src/os.c:133
#2  0x00007fcd7e3e6a2b in cfs_sync(struct {...} *, couch_file_handle) (errinfo=0x32e4f6a0, h=0x30e796c0)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/couch-kvstore/couch-fs-stats.cc:128
#3  0x00007fcd7e0dc72a in couchstore_commit (db=0x32e4f680)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/couchstore/src/couch_db.cc:203
#4  0x00007fcd7e3db7b9 in CouchKVStore::setVBucketState (this=0x6f0a000, vbucketId=364, vbstate=..., vb_change_type=2, kvcb=0x7fcd7959dc60, 
    notify=true) at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/couch-kvstore/couch-kvstore.cc:1048
#5  0x00007fcd7e3dbf57 in CouchKVStore::snapshotVBuckets (this=0x6f0a000, vbstates=std::map with 47 elements = {...}, cb=0x7fcd7959dc60)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/couch-kvstore/couch-kvstore.cc:932
#6  0x00007fcd7e32db0f in EventuallyPersistentStore::snapshotVBuckets (this=0x6ef2000, priority=..., shardId=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/ep.cc:851
#7  0x00007fcd7e39a24f in VBSnapshotTask::run (this=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/tasks.cc:44
#8  0x00007fcd7e37596c in ExecutorThread::run (this=0x26185a0)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorthread.cc:95
#9  0x00007fcd7e375ea6 in launch_executor_thread (arg=0x4e)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorthread.cc:33
#10 0x00007fcd885b9bff in platform_thread_wrap (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#11 0x00007fcd8736d851 in start_thread () from /lib64/libpthread.so.0
#12 0x00007fcd8650f90d in clone () from /lib64/libc.so.6

Thread 16 (Thread 0x7fcd80e47700 (LWP 2581)):
#0  0x00007fcd8650ff03 in epoll_wait () from /lib64/libc.so.6
#1  0x00007fcd87b4f376 in epoll_dispatch (base=0x6e84c80, tv=<value optimized out>) at epoll.c:404
#2  0x00007fcd87b3ac44 in event_base_loop (base=0x6e84c80, flags=<value optimized out>) at event.c:1558
#3  0x00007fcd885b9bff in platform_thread_wrap (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#4  0x00007fcd8736d851 in start_thread () from /lib64/libpthread.so.0
#5  0x00007fcd8650f90d in clone () from /lib64/libc.so.6

Thread 15 (Thread 0x7fcd82249700 (LWP 2579)):
#0  0x00007fcd8650ff03 in epoll_wait () from /lib64/libc.so.6
---Type <return> to continue, or q <return> to quit---
#1  0x00007fcd87b4f376 in epoll_dispatch (base=0x6e84780, tv=<value optimized out>) at epoll.c:404
#2  0x00007fcd87b3ac44 in event_base_loop (base=0x6e84780, flags=<value optimized out>) at event.c:1558
#3  0x00007fcd885b9bff in platform_thread_wrap (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#4  0x00007fcd8736d851 in start_thread () from /lib64/libpthread.so.0
#5  0x00007fcd8650f90d in clone () from /lib64/libc.so.6

Thread 14 (Thread 0x7fcd7a9a0700 (LWP 12238)):
#0  0x00007fcd86506253 in poll () from /lib64/libc.so.6
#1  0x00007fcd7e3e8d20 in CouchNotifier::waitForReadable (this=0x6f05000, tryOnce=true)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/couch-kvstore/couch-notifier.cc:719
#2  0x00007fcd7e3e94bd in waitOnce (this=0x6f05000, vbs=..., file_version=1, header_offset=26759168, cb=...)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/couch-kvstore/couch-notifier.cc:769
#3  CouchNotifier::notify_update (this=0x6f05000, vbs=..., file_version=1, header_offset=26759168, cb=...)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/couch-kvstore/couch-notifier.cc:848
#4  0x00007fcd7e3d8db1 in CouchKVStore::saveDocs (this=0x6f0b040, vbid=69, rev=<value optimized out>, docs=0x25c8bf0, docinfos=0x25c88b0, 
    docCount=1, kvctx=...) at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/couch-kvstore/couch-notifier.h:172
#5  0x00007fcd7e3d947b in CouchKVStore::commit2couchstore (this=0x6f0b040, cb=0x7fcd7a99f9a0)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/couch-kvstore/couch-kvstore.cc:1713
#6  0x00007fcd7e3d9775 in CouchKVStore::commit (this=0x7fcd7a99f490, cb=0x1)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/couch-kvstore/couch-kvstore.cc:1138
#7  0x00007fcd7e32d20f in EventuallyPersistentStore::flushVBucket (this=0x6ef2000, vbid=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/ep.cc:2511
#8  0x00007fcd7e36b5ac in Flusher::flushVB (this=0x6f62140)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/flusher.cc:281
#9  0x00007fcd7e36c21e in Flusher::step (this=0x7fcd7a99f490, task=0x6e783c0)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/flusher.cc:172
#10 0x00007fcd7e39a276 in FlusherTask::run (this=0xfffffffffffffdfc)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/tasks.cc:40
#11 0x00007fcd7e37596c in ExecutorThread::run (this=0x2618480)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorthread.cc:95
#12 0x00007fcd7e375ea6 in launch_executor_thread (arg=0x7fcd7a99f490)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorthread.cc:33
#13 0x00007fcd885b9bff in platform_thread_wrap (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#14 0x00007fcd8736d851 in start_thread () from /lib64/libpthread.so.0
#15 0x00007fcd8650f90d in clone () from /lib64/libc.so.6
---Type <return> to continue, or q <return> to quit---

Thread 13 (Thread 0x7fcd80446700 (LWP 2582)):
#0  0x00007fcd87374054 in __lll_lock_wait () from /lib64/libpthread.so.0
#1  0x00007fcd8736f388 in _L_lock_854 () from /lib64/libpthread.so.0
#2  0x00007fcd8736f257 in pthread_mutex_lock () from /lib64/libpthread.so.0
#3  0x00007fcd885b9a89 in cb_mutex_enter (mutex=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:85
#4  0x00007fcd7e37457d in Mutex::acquire (this=0xb612dda0) at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/mutex.cc:31
#5  0x00007fcd7e3aa56e in lock (this=0xb612dd40) at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/locks.h:66
#6  LockHolder (this=0xb612dd40) at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/locks.h:44
#7  PassiveStream::next (this=0xb612dd40) at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/upr-stream.cc:1118
#8  0x00007fcd7e3a024b in UprConsumer::getNextItem (this=0x703a700)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/upr-consumer.cc:593
#9  0x00007fcd7e3a042f in UprConsumer::step (this=0x703a700, producers=0x6222a0)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/upr-consumer.cc:381
#10 0x00007fcd7e33ff52 in EvpUprStep (handle=<value optimized out>, cookie=0x6e17800, producers=0x6222a0)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/ep_engine.cc:1350
#11 0x00007fcd836541d6 in upr_step (handle=<value optimized out>, cookie=0x6e17800, producers=0x6222a0)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/memcached/engines/bucket_engine/bucket_engine.c:2225
#12 0x000000000041347f in ship_upr_log (c=0x6e17800)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/memcached/daemon/memcached.c:3480
#13 conn_ship_log (c=0x6e17800) at /buildbot/build_slave/centos-5-x64-300-builder/build/build/memcached/daemon/memcached.c:6833
#14 0x000000000040a37d in event_handler (fd=<value optimized out>, which=<value optimized out>, arg=0x6e17800)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/memcached/daemon/memcached.c:7276
#15 0x00007fcd87b3ad3c in event_process_active_single_queue (base=0x6e84f00, flags=<value optimized out>) at event.c:1308
#16 event_process_active (base=0x6e84f00, flags=<value optimized out>) at event.c:1375
#17 event_base_loop (base=0x6e84f00, flags=<value optimized out>) at event.c:1572
#18 0x00007fcd885b9bff in platform_thread_wrap (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#19 0x00007fcd8736d851 in start_thread () from /lib64/libpthread.so.0
#20 0x00007fcd8650f90d in clone () from /lib64/libc.so.6

Thread 12 (Thread 0x7fcd7f044700 (LWP 12235)):
#0  0x00007fcd864d3b8d in nanosleep () from /lib64/libc.so.6
#1  0x00007fcd86508d64 in usleep () from /lib64/libc.so.6
#2  0x00007fcd7e373155 in updateStatsThread (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/memory_tracker.cc:36
---Type <return> to continue, or q <return> to quit---
#3  0x00007fcd885b9bff in platform_thread_wrap (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#4  0x00007fcd8736d851 in start_thread () from /lib64/libpthread.so.0
#5  0x00007fcd8650f90d in clone () from /lib64/libc.so.6

Thread 11 (Thread 0x7fcd81848700 (LWP 2580)):
#0  0x00007fcd8650ff03 in epoll_wait () from /lib64/libc.so.6
#1  0x00007fcd87b4f376 in epoll_dispatch (base=0x6e84a00, tv=<value optimized out>) at epoll.c:404
#2  0x00007fcd87b3ac44 in event_base_loop (base=0x6e84a00, flags=<value optimized out>) at event.c:1558
#3  0x00007fcd885b9bff in platform_thread_wrap (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#4  0x00007fcd8736d851 in start_thread () from /lib64/libpthread.so.0
#5  0x00007fcd8650f90d in clone () from /lib64/libc.so.6

Thread 10 (Thread 0x7fcd7fa45700 (LWP 2583)):
#0  0x00007fcd8650ff03 in epoll_wait () from /lib64/libc.so.6
#1  0x00007fcd87b4f376 in epoll_dispatch (base=0x6e85180, tv=<value optimized out>) at epoll.c:404
#2  0x00007fcd87b3ac44 in event_base_loop (base=0x6e85180, flags=<value optimized out>) at event.c:1558
#3  0x00007fcd885b9bff in platform_thread_wrap (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#4  0x00007fcd8736d851 in start_thread () from /lib64/libpthread.so.0
#5  0x00007fcd8650f90d in clone () from /lib64/libc.so.6

Thread 9 (Thread 0x7fcd7bda2700 (LWP 12236)):
#0  0x00007fcd873717bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007fcd885b997b in cb_cond_timedwait (cond=0x703a058, mutex=0x703a020, ms=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:156
#2  0x00007fcd7e363f5c in ExecutorPool::trySleep (this=0x703a000, t=..., now=...)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/syncobject.h:74
#3  0x00007fcd7e36416b in ExecutorPool::_nextTask (this=0x703a000, t=..., tick=0 '\000')
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorpool.cc:139
#4  0x00007fcd7e3641de in ExecutorPool::nextTask (this=0x703a000, t=..., tick=235 '\353')
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorpool.cc:165
#5  0x00007fcd7e3758d8 in ExecutorThread::run (this=0x2618360)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorthread.cc:77
#6  0x00007fcd7e375ea6 in launch_executor_thread (arg=0x703a05c)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorthread.cc:33
---Type <return> to continue, or q <return> to quit---
#7  0x00007fcd885b9bff in platform_thread_wrap (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#8  0x00007fcd8736d851 in start_thread () from /lib64/libpthread.so.0
#9  0x00007fcd8650f90d in clone () from /lib64/libc.so.6

Thread 8 (Thread 0x7fcd82c4a700 (LWP 2578)):
#0  0x00007fcd8650ff03 in epoll_wait () from /lib64/libc.so.6
#1  0x00007fcd87b4f376 in epoll_dispatch (base=0x6e84500, tv=<value optimized out>) at epoll.c:404
#2  0x00007fcd87b3ac44 in event_base_loop (base=0x6e84500, flags=<value optimized out>) at event.c:1558
#3  0x00007fcd885b9bff in platform_thread_wrap (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#4  0x00007fcd8736d851 in start_thread () from /lib64/libpthread.so.0
#5  0x00007fcd8650f90d in clone () from /lib64/libc.so.6

Thread 7 (Thread 0x7fcd84e6e700 (LWP 2545)):
#0  0x00007fcd8650260d in read () from /lib64/libc.so.6
#1  0x00007fcd86498f68 in _IO_new_file_underflow () from /lib64/libc.so.6
#2  0x00007fcd8649aa6e in _IO_default_uflow_internal () from /lib64/libc.so.6
#3  0x00007fcd8648f14a in _IO_getline_info_internal () from /lib64/libc.so.6
#4  0x00007fcd8648dfa9 in fgets () from /lib64/libc.so.6
#5  0x00007fcd84e6f8b1 in check_stdin_thread (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/memcached/extensions/daemon/stdin_check.c:38
#6  0x00007fcd885b9bff in platform_thread_wrap (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#7  0x00007fcd8736d851 in start_thread () from /lib64/libpthread.so.0
#8  0x00007fcd8650f90d in clone () from /lib64/libc.so.6

Thread 6 (Thread 0x7fcd88dd17e0 (LWP 2540)):
#0  0x00007fcd8650ff03 in epoll_wait () from /lib64/libc.so.6
#1  0x00007fcd87b4f376 in epoll_dispatch (base=0x6e84000, tv=<value optimized out>) at epoll.c:404
#2  0x00007fcd87b3ac44 in event_base_loop (base=0x6e84000, flags=<value optimized out>) at event.c:1558
#3  0x000000000040f71c in main (argc=<value optimized out>, argv=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/memcached/daemon/memcached.c:8768

Thread 5 (Thread 0x7fcd8364b700 (LWP 2577)):
#0  0x00007fcd86ce4583 in std::basic_ostream<char, std::char_traits<char> >& std::operator<< <char, std::char_traits<char>, std::allocator<char> >(std::basic_ostream<char, std::char_traits<char> >&, std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) ()
---Type <return> to continue, or q <return> to quit---
   from /usr/lib64/libstdc++.so.6
#1  0x00007fcd7e3a2a6e in Processer::getDescription (this=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/upr-consumer.cc:67
#2  0x00007fcd7e39d92a in TaskQueue::_wake (this=0x262d4a0, task=...)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/taskqueue.cc:228
#3  0x00007fcd7e39e0f3 in TaskQueue::wake (this=0x262d4a0, task=...)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/taskqueue.cc:265
#4  0x00007fcd7e36363f in ExecutorPool::_wake (this=<value optimized out>, taskId=102)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorpool.cc:329
#5  0x00007fcd7e3636a3 in ExecutorPool::wake (this=0x703a000, taskId=102)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorpool.cc:337
#6  0x00007fcd7e3a1e66 in UprConsumer::snapshotMarker (this=<value optimized out>, opaque=431, vbucket=<value optimized out>, start_seqno=104354, 
    end_seqno=18446744073709551615, flags=0) at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/upr-consumer.cc:288
#7  0x00007fcd7e340190 in EvpUprSnapshotMarker (handle=<value optimized out>, cookie=0x6dc9000, opaque=431, vbucket=483, start_seqno=104354, 
    end_seqno=18446744073709551615, flags=0) at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/ep_engine.cc:1470
#8  0x00007fcd836535cf in upr_snapshot_marker (handle=<value optimized out>, cookie=0x6dc9000, opaque=431, vbucket=483, start_seqno=104354, 
    end_seqno=18446744073709551615, flags=0)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/memcached/engines/bucket_engine/bucket_engine.c:2402
#9  0x0000000000411734 in upr_snapshot_marker_executor (c=0x6dc9000, packet=0xd95fc000)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/memcached/daemon/memcached.c:4352
#10 0x000000000041832e in process_bin_packet (c=0x6dc9000)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/memcached/daemon/memcached.c:5390
#11 complete_nread (c=0x6dc9000) at /buildbot/build_slave/centos-5-x64-300-builder/build/build/memcached/daemon/memcached.c:5796
#12 conn_nread (c=0x6dc9000) at /buildbot/build_slave/centos-5-x64-300-builder/build/build/memcached/daemon/memcached.c:7003
#13 0x000000000040a37d in event_handler (fd=<value optimized out>, which=<value optimized out>, arg=0x6dc9000)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/memcached/daemon/memcached.c:7276
#14 0x00007fcd87b3ad3c in event_process_active_single_queue (base=0x6e84280, flags=<value optimized out>) at event.c:1308
#15 event_process_active (base=0x6e84280, flags=<value optimized out>) at event.c:1375
#16 event_base_loop (base=0x6e84280, flags=<value optimized out>) at event.c:1572
#17 0x00007fcd885b9bff in platform_thread_wrap (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#18 0x00007fcd8736d851 in start_thread () from /lib64/libpthread.so.0
#19 0x00007fcd8650f90d in clone () from /lib64/libc.so.6

Thread 4 (Thread 0x7fcd78b9d700 (LWP 12241)):
#0  0x00007fcd7e37112e in gimme (this=<value optimized out>, id=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/atomic.h:109
---Type <return> to continue, or q <return> to quit---
#1  RCPtr (this=<value optimized out>, id=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/atomic.h:311
#2  KVShard::getBucket (this=<value optimized out>, id=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/kvshard.cc:75
#3  0x00007fcd7e3b7858 in VBucketMap::getBucket (this=0x6ef2028, id=167)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/vbucketmap.cc:63
#4  0x00007fcd7e3222b1 in EventuallyPersistentStore::visit (this=<value optimized out>, visitor=...)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/ep.cc:2782
#5  0x00007fcd7e32dadb in EventuallyPersistentStore::snapshotVBuckets (this=0x6ef2000, priority=..., shardId=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/ep.cc:847
#6  0x00007fcd7e39a24f in VBSnapshotTask::run (this=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/tasks.cc:44
#7  0x00007fcd7e37596c in ExecutorThread::run (this=0x2618630)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorthread.cc:95
#8  0x00007fcd7e375ea6 in launch_executor_thread (arg=0x6fe8a80)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorthread.cc:33
#9  0x00007fcd885b9bff in platform_thread_wrap (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#10 0x00007fcd8736d851 in start_thread () from /lib64/libpthread.so.0
#11 0x00007fcd8650f90d in clone () from /lib64/libc.so.6

Thread 3 (Thread 0x7fcd84259700 (LWP 2546)):
#0  0x00007fcd873717bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007fcd885b997b in cb_cond_timedwait (cond=0x7fcd8446de60, mutex=0x7fcd8446de20, ms=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:156
#2  0x00007fcd8425d548 in logger_thead_main (arg=0x2604900)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/memcached/extensions/loggers/file_logger.c:372
#3  0x00007fcd885b9bff in platform_thread_wrap (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#4  0x00007fcd8736d851 in start_thread () from /lib64/libpthread.so.0
#5  0x00007fcd8650f90d in clone () from /lib64/libc.so.6

Thread 2 (Thread 0x7fcd79f9f700 (LWP 12239)):
#0  0x00007fcd873717bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1  0x00007fcd885b997b in cb_cond_timedwait (cond=0x703a058, mutex=0x703a020, ms=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:156
#2  0x00007fcd7e363f5c in ExecutorPool::trySleep (this=0x703a000, t=..., now=...)
---Type <return> to continue, or q <return> to quit---
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/syncobject.h:74
#3  0x00007fcd7e36416b in ExecutorPool::_nextTask (this=0x703a000, t=..., tick=3 '\003')
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorpool.cc:139
#4  0x00007fcd7e3641de in ExecutorPool::nextTask (this=0x703a000, t=..., tick=10 '\n')
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorpool.cc:165
#5  0x00007fcd7e3758d8 in ExecutorThread::run (this=0x2618510)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorthread.cc:77
#6  0x00007fcd7e375ea6 in launch_executor_thread (arg=0x703a05c)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorthread.cc:33
#7  0x00007fcd885b9bff in platform_thread_wrap (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#8  0x00007fcd8736d851 in start_thread () from /lib64/libpthread.so.0
#9  0x00007fcd8650f90d in clone () from /lib64/libc.so.6

Thread 1 (Thread 0x7fcd7b3a1700 (LWP 12237)):
#0  0x00007fcd864598a5 in raise () from /lib64/libc.so.6
#1  0x00007fcd8645b085 in abort () from /lib64/libc.so.6
#2  0x00007fcd86452a1e in __assert_fail_base () from /lib64/libc.so.6
#3  0x00007fcd86452ae0 in __assert_fail () from /lib64/libc.so.6
#4  0x00007fcd7e3af952 in PassiveStream::~PassiveStream (this=0xb612dd40, __in_chrg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/upr-stream.cc:856
#5  0x00007fcd7e3a1545 in UprConsumer::processBufferedItems (this=0x703a700)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/atomic.h:397
#6  0x00007fcd7e3a15fa in Processer::run (this=0x2618c60)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/upr-consumer.cc:48
#7  0x00007fcd7e37596c in ExecutorThread::run (this=0x26183f0)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorthread.cc:95
#8  0x00007fcd7e375ea6 in launch_executor_thread (arg=0x9ec)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/ep-engine/src/executorthread.cc:33
#9  0x00007fcd885b9bff in platform_thread_wrap (arg=<value optimized out>)
    at /buildbot/build_slave/centos-5-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#10 0x00007fcd8736d851 in start_thread () from /lib64/libpthread.so.0
#11 0x00007fcd8650f90d in clone () from /lib64/libc.so.6