Memcached crashes with seg fault during views + rebalance test

Test :
./testrunner -i /tmp/centos64.ini max-dupe-result-count=10,get-cbcollect-info=True,num-tries=60,attempt-num=60,get-delays=True -t view.createdeleteview.CreateDeleteViewTests.incremental_rebalance_out_with_ddoc_ops,ddoc_ops=create,test_with_view=True,num_ddocs=2,num_views_per_ddoc=1,items=200000

Stack from the node
[[root@tambran-s21713 cores]# gdb /opt/couchbase/bin/memcached core.memcached.26307
GNU gdb (GDB) Red Hat Enterprise Linux (7.2-60.el6_4.1)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /opt/couchbase/bin/memcached...done.
[New Thread 26332]
[New Thread 26335]
[New Thread 26333]
[New Thread 9753]
[New Thread 26334]
[New Thread 26336]
[New Thread 26581]
[New Thread 26307]
[New Thread 26318]
[New Thread 26317]
[New Thread 9752]
[New Thread 9751]
[New Thread 9750]
Reading symbols from /opt/couchbase/bin/../lib/memcached/libmcd_util.so.1.0.0...done.
Loaded symbols for /opt/couchbase/bin/../lib/memcached/libmcd_util.so.1.0.0
Reading symbols from /opt/couchbase/bin/../lib/libcbsasl.so.1.1.1...done.
Loaded symbols for /opt/couchbase/bin/../lib/libcbsasl.so.1.1.1
Reading symbols from /opt/couchbase/bin/../lib/libplatform.so.0.1.0...done.
Loaded symbols for /opt/couchbase/bin/../lib/libplatform.so.0.1.0
Reading symbols from /opt/couchbase/bin/../lib/libcJSON.so.1.0.0...done.
Loaded symbols for /opt/couchbase/bin/../lib/libcJSON.so.1.0.0
Reading symbols from /opt/couchbase/bin/../lib/libsnappy.so.1...done.
Loaded symbols for /opt/couchbase/bin/../lib/libsnappy.so.1
Reading symbols from /opt/couchbase/bin/../lib/libtcmalloc_minimal.so.4...done.
Loaded symbols for /opt/couchbase/bin/../lib/libtcmalloc_minimal.so.4
Reading symbols from /opt/couchbase/bin/../lib/libevent_core-2.0.so.5...done.
Loaded symbols for /opt/couchbase/bin/../lib/libevent_core-2.0.so.5
Reading symbols from /usr/lib64/libssl.so.6...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/libssl.so.6
Reading symbols from /usr/lib64/libcrypto.so.6...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/libcrypto.so.6
Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done.
[Thread debugging using libthread_db enabled]
Loaded symbols for /lib64/libpthread.so.0
Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libdl.so.2
Reading symbols from /lib64/librt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/librt.so.1
Reading symbols from /lib64/libm.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libm.so.6
Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libc.so.6
Reading symbols from /usr/lib64/libstdc++.so.6...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/libstdc++.so.6
Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libgcc_s.so.1
Reading symbols from /lib64/libgssapi_krb5.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libgssapi_krb5.so.2
Reading symbols from /lib64/libkrb5.so.3...(no debugging symbols found)...done.
Loaded symbols for /lib64/libkrb5.so.3
Reading symbols from /lib64/libcom_err.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libcom_err.so.2
Reading symbols from /lib64/libk5crypto.so.3...(no debugging symbols found)...done.
Loaded symbols for /lib64/libk5crypto.so.3
Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libz.so.1
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /lib64/libkrb5support.so.0...(no debugging symbols found)...done.
Loaded symbols for /lib64/libkrb5support.so.0
Reading symbols from /lib64/libkeyutils.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libkeyutils.so.1
Reading symbols from /lib64/libresolv.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libresolv.so.2
Reading symbols from /lib64/libselinux.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libselinux.so.1
Reading symbols from /opt/couchbase/lib/memcached/stdin_term_handler.so...done.
Loaded symbols for /opt/couchbase/lib/memcached/stdin_term_handler.so
Reading symbols from /opt/couchbase/lib/memcached/file_logger.so...done.
Loaded symbols for /opt/couchbase/lib/memcached/file_logger.so
Reading symbols from /opt/couchbase/lib/memcached/bucket_engine.so...done.
Loaded symbols for /opt/couchbase/lib/memcached/bucket_engine.so
Reading symbols from /opt/couchbase/lib/memcached/ep.so...done.
Loaded symbols for /opt/couchbase/lib/memcached/ep.so
Reading symbols from /opt/couchbase/lib/libcouchstore.so...done.
Loaded symbols for /opt/couchbase/lib/libcouchstore.so
Reading symbols from /opt/couchbase/lib/libdirutils.so.0.1.0...done.
Loaded symbols for /opt/couchbase/lib/libdirutils.so.0.1.0
Reading symbols from /opt/couchbase/lib/libv8.so...done.
Loaded symbols for /opt/couchbase/lib/libv8.so
Reading symbols from /opt/couchbase/lib/libicui18n.so.44...done.
Loaded symbols for /opt/couchbase/lib/libicui18n.so.44
Reading symbols from /opt/couchbase/lib/libicuuc.so.44...done.
Loaded symbols for /opt/couchbase/lib/libicuuc.so.44
Reading symbols from /opt/couchbase/lib/libicudata.so.44...(no debugging symbols found)...done.
Loaded symbols for /opt/couchbase/lib/libicudata.so.44
Core was generated by `/opt/couchbase/bin/memcached -C /opt/couchbase/var/lib/couchbase/config/memcach'.
Program terminated with signal 11, Segmentation fault.
#0 isLastMutationItemInCheckpoint (this=0x12abf298, name=<value optimized out>, isLastMutationItem=@0x7f5bc06a181f)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/item.h:498
498 /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/item.h: No such file or directory.
in /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/item.h
Missing separate debuginfos, use: debuginfo-install couchbase-server-3.0.0-446.x86_64
(gdb) t a a bt

Thread 13 (Thread 0x7f5bb9a40700 (LWP 9750)):
#0 0x00007f5bc43b8251 in pthread_mutex_lock () from /lib64/libpthread.so.0
#1 0x00007f5bc53fea09 in cb_mutex_enter (mutex=<value optimized out>)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/platform/src/cb_pthreads.c:85
#2 0x00007f5bbc7dc2ad in Mutex::acquire (this=0xbbf4da0)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/mutex.cc:32
#3 0x00007f5bbc7cca45 in lock (this=0xbbf4d80, curTaskType=@0x0)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/locks.h:66
#4 LockHolder (this=0xbbf4d80, curTaskType=@0x0) at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/locks.h:44
#5 ExecutorPool::doneWork (this=0xbbf4d80, curTaskType=@0x0)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/executorpool.cc:224
#6 0x00007f5bbc8040c0 in TaskQueue::fetchNextTask (this=0xbb9d080, task=..., waketime=..., taskType=@0xfbd1798, now=...)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/taskqueue.cc:75
#7 0x00007f5bbc7cd020 in ExecutorPool::nextTask (this=0xbbf4d80, t=..., tick=<value optimized out>)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/executorpool.cc:146
#8 0x00007f5bbc7dd2c9 in ExecutorThread::run (this=0xfbd1750)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/executorthread.cc:77
#9 0x00007f5bbc7dd856 in launch_executor_thread (arg=0x1)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/executorthread.cc:33
#10 0x00007f5bc53feb7f in platform_thread_wrap (arg=0x2815d90)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/platform/src/cb_pthreads.c:19
#11 0x00007f5bc43b6851 in start_thread () from /lib64/libpthread.so.0
#12 0x00007f5bc3a7490d in clone () from /lib64/libc.so.6

Thread 12 (Thread 0x7f5bba441700 (LWP 9751)):
#0 0x00007f5bc43bd054 in __lll_lock_wait () from /lib64/libpthread.so.0
#1 0x00007f5bc43b8388 in _L_lock_854 () from /lib64/libpthread.so.0
#2 0x00007f5bc43b8257 in pthread_mutex_lock () from /lib64/libpthread.so.0
#3 0x00007f5bc53fea09 in cb_mutex_enter (mutex=<value optimized out>)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/platform/src/cb_pthreads.c:85
#4 0x00007f5bbc7dc2ad in Mutex::acquire (this=0xbb9d080)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/mutex.cc:32
#5 0x00007f5bbc805590 in lock (this=0xbb9d088, task=...)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/locks.h:66
#6 LockHolder (this=0xbb9d088, task=...) at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/locks.h:44
#7 TaskQueue::reschedule (this=0xbb9d088, task=...)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/taskqueue.cc:122
#8 0x00007f5bbc7dd433 in ExecutorThread::run (this=0x1137a8c0)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/executorthread.cc:106
#9 0x00007f5bbc7dd856 in launch_executor_thread (arg=0xbb9d088)
--Type <return> to continue, or q <return> to quit--
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/executorthread.cc:33
#10 0x00007f5bc53feb7f in platform_thread_wrap (arg=0x2814840)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/platform/src/cb_pthreads.c:19
#11 0x00007f5bc43b6851 in start_thread () from /lib64/libpthread.so.0
#12 0x00007f5bc3a7490d in clone () from /lib64/libc.so.6

Thread 11 (Thread 0x7f5bb903f700 (LWP 9752)):
#0 0x00007f5bc43ba7bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00007f5bc53fe8fb in cb_cond_timedwait (cond=0xbbf4de0, mutex=0xbbf4da8, ms=<value optimized out>)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/platform/src/cb_pthreads.c:156
#2 0x00007f5bbc7cce57 in wait (this=0xbbf4d80, t=..., now=...)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/syncobject.h:74
#3 ExecutorPool::trySleep (this=0xbbf4d80, t=..., now=...)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/executorpool.cc:177
#4 0x00007f5bbc7cd0a5 in ExecutorPool::nextTask (this=0xbbf4d80, t=..., tick=8 '\b')
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/executorpool.cc:151
#5 0x00007f5bbc7dd2c9 in ExecutorThread::run (this=0xc1c1e30)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/executorthread.cc:77
#6 0x00007f5bbc7dd856 in launch_executor_thread (arg=0xbbf4de4)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/executorthread.cc:33
#7 0x00007f5bc53feb7f in platform_thread_wrap (arg=0x2816990)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/platform/src/cb_pthreads.c:19
#8 0x00007f5bc43b6851 in start_thread () from /lib64/libpthread.so.0
#9 0x00007f5bc3a7490d in clone () from /lib64/libc.so.6

Thread 10 (Thread 0x7f5bc1eb7700 (LWP 26317)):
#0 0x00007f5bc3a6760d in read () from /lib64/libc.so.6
#1 0x00007f5bc39fdf68 in _IO_new_file_underflow () from /lib64/libc.so.6
#2 0x00007f5bc39ffa6e in _IO_default_uflow_internal () from /lib64/libc.so.6
#3 0x00007f5bc39f414a in _IO_getline_info_internal () from /lib64/libc.so.6
#4 0x00007f5bc39f2fa9 in fgets () from /lib64/libc.so.6
#5 0x00007f5bc1eb88c1 in check_stdin_thread (arg=<value optimized out>)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/memcached/extensions/daemon/stdin_check.c:38
#6 0x00007f5bc53feb7f in platform_thread_wrap (arg=0x2814080)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/platform/src/cb_pthreads.c:19
#7 0x00007f5bc43b6851 in start_thread () from /lib64/libpthread.so.0
#8 0x00007f5bc3a7490d in clone () from /lib64/libc.so.6

Thread 9 (Thread 0x7f5bc12b3700 (LWP 26318)):
#0 0x00007f5bc43ba7bb in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00007f5bc53fe8fb in cb_cond_timedwait (cond=0x7f5bc14b6800, mutex=0x7f5bc14b67c0, ms=<value optimized out>)
--Type <return> to continue, or q <return> to quit--
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/platform/src/cb_pthreads.c:156
#2 0x00007f5bc12b5d4d in logger_thead_main (arg=0x284cb00)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/memcached/extensions/loggers/file_logger.c:363
#3 0x00007f5bc53feb7f in platform_thread_wrap (arg=0x2814090)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/platform/src/cb_pthreads.c:19
#4 0x00007f5bc43b6851 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f5bc3a7490d in clone () from /lib64/libc.so.6

Thread 8 (Thread 0x7f5bc5c167e0 (LWP 26307)):
#0 0x00007f5bc3a74f03 in epoll_wait () from /lib64/libc.so.6
#1 0x00007f5bc4b97376 in epoll_dispatch (base=0xbb98000, tv=<value optimized out>) at epoll.c:404
#2 0x00007f5bc4b82c44 in event_base_loop (base=0xbb98000, flags=<value optimized out>) at event.c:1558
#3 0x000000000040dc6b in main (argc=<value optimized out>, argv=<value optimized out>)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/memcached/daemon/memcached.c:8285

Thread 7 (Thread 0x7f5bbd4a1700 (LWP 26581)):
#0 0x00007f5bc3a38b8d in nanosleep () from /lib64/libc.so.6
#1 0x00007f5bc3a6dd64 in usleep () from /lib64/libc.so.6
#2 0x00007f5bbc7db0f5 in updateStatsThread (arg=<value optimized out>)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/memory_tracker.cc:36
#3 0x00007f5bc53feb7f in platform_thread_wrap (arg=0x28141b0)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/platform/src/cb_pthreads.c:19
#4 0x00007f5bc43b6851 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f5bc3a7490d in clone () from /lib64/libc.so.6

Thread 6 (Thread 0x7f5bbdea2700 (LWP 26336)):
#0 0x00007f5bc3a74f03 in epoll_wait () from /lib64/libc.so.6
#1 0x00007f5bc4b97376 in epoll_dispatch (base=0xbb98780, tv=<value optimized out>) at epoll.c:404
#2 0x00007f5bc4b82c44 in event_base_loop (base=0xbb98780, flags=<value optimized out>) at event.c:1558
#3 0x00007f5bc53feb7f in platform_thread_wrap (arg=0x2814160)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/platform/src/cb_pthreads.c:19
#4 0x00007f5bc43b6851 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f5bc3a7490d in clone () from /lib64/libc.so.6

Thread 5 (Thread 0x7f5bbf2a4700 (LWP 26334)):
#0 0x00007f5bc3a74f03 in epoll_wait () from /lib64/libc.so.6
#1 0x00007f5bc4b97376 in epoll_dispatch (base=0xbb98c80, tv=<value optimized out>) at epoll.c:404
#2 0x00007f5bc4b82c44 in event_base_loop (base=0xbb98c80, flags=<value optimized out>) at event.c:1558
#3 0x00007f5bc53feb7f in platform_thread_wrap (arg=0x2814180)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/platform/src/cb_pthreads.c:19
#4 0x00007f5bc43b6851 in start_thread () from /lib64/libpthread.so.0
--Type <return> to continue, or q <return> to quit--
#5 0x00007f5bc3a7490d in clone () from /lib64/libc.so.6

Thread 4 (Thread 0x7f5bb863e700 (LWP 9753)):
#0 0x00007f5bbc7ccfc7 in ExecutorPool::nextTask (this=0xbbf4d80, t=..., tick=0 '\000')
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/executorpool.cc:150
#1 0x00007f5bbc7dd2c9 in ExecutorThread::run (this=0x11c09b60)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/executorthread.cc:77
#2 0x00007f5bbc7dd856 in launch_executor_thread (arg=0xbb9c908)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/executorthread.cc:33
#3 0x00007f5bc53feb7f in platform_thread_wrap (arg=0x2814280)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/platform/src/cb_pthreads.c:19
#4 0x00007f5bc43b6851 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f5bc3a7490d in clone () from /lib64/libc.so.6

Thread 3 (Thread 0x7f5bbfca5700 (LWP 26333)):
#0 0x00007f5bc3a74f03 in epoll_wait () from /lib64/libc.so.6
#1 0x00007f5bc4b97376 in epoll_dispatch (base=0xbb98280, tv=<value optimized out>) at epoll.c:404
#2 0x00007f5bc4b82c44 in event_base_loop (base=0xbb98280, flags=<value optimized out>) at event.c:1558
#3 0x00007f5bc53feb7f in platform_thread_wrap (arg=0x2814190)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/platform/src/cb_pthreads.c:19
#4 0x00007f5bc43b6851 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f5bc3a7490d in clone () from /lib64/libc.so.6

Thread 2 (Thread 0x7f5bbe8a3700 (LWP 26335)):
#0 0x00007f5bc3a74f03 in epoll_wait () from /lib64/libc.so.6
#1 0x00007f5bc4b97376 in epoll_dispatch (base=0xbb98a00, tv=<value optimized out>) at epoll.c:404
#2 0x00007f5bc4b82c44 in event_base_loop (base=0xbb98a00, flags=<value optimized out>) at event.c:1558
#3 0x00007f5bc53feb7f in platform_thread_wrap (arg=0x2814170)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/platform/src/cb_pthreads.c:19
#4 0x00007f5bc43b6851 in start_thread () from /lib64/libpthread.so.0
#5 0x00007f5bc3a7490d in clone () from /lib64/libc.so.6

Thread 1 (Thread 0x7f5bc06a6700 (LWP 26332)):
#0 isLastMutationItemInCheckpoint (this=0x12abf298, name=<value optimized out>, isLastMutationItem=@0x7f5bc06a181f)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/item.h:498
#1 CheckpointManager::nextItem (this=0x12abf298, name=<value optimized out>, isLastMutationItem=@0x7f5bc06a181f)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/checkpoint.cc:862
#2 0x00007f5bbc7e91ef in TapProducer::nextFgFetched_UNLOCKED (this=0xf402d00, shouldPause=@0x7f5bc06a18f8)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/tapconnection.cc:1227
#3 0x00007f5bbc7eb8a3 in TapProducer::getNextItem (this=0xf402d00, c=0xbaf3600, vbucket=0x7f5bc06a5c48, ret=@0x7f5bc06a1a0c,
nru=@0x7f5bc06a1a0f) at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/tapconnection.cc:1846
--Type <return> to continue, or q <return> to quit--
#4 0x00007f5bbc7cbf89 in EventuallyPersistentEngine::doWalkTapQueue (this=0x10d52000, cookie=0xbaf3600, itm=0x7f5bc06a5c38,
es=0x7f5bc06a5c30, nes=0x7f5bc06a5c4c, ttl=<value optimized out>, flags=0x7f5bc06a5c4a, seqno=0x7f5bc06a5c44, vbucket=0x7f5bc06a5c48,
connection=0xf402d00, retry=@0x7f5bc06a1aa7) at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/ep_engine.cc:2155
#5 0x00007f5bbc7c15fd in EventuallyPersistentEngine::walkTapQueue (this=0x10d52000, cookie=0xbaf3600, itm=0x7f5bc06a5c38,
es=0x7f5bc06a5c30, nes=0x7f5bc06a5c4c, ttl=0x7f5bc06a5c4f "\377", flags=0x7f5bc06a5c4a, seqno=0x7f5bc06a5c44, vbucket=0x7f5bc06a5c48)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/ep_engine.cc:2227
#6 0x00007f5bbc7c177f in EvpTapIterator (handle=0x10d52000, cookie=0xbaf3600, itm=0x7f5bc06a5c38, es=0x7f5bc06a5c30, nes=0x7f5bc06a5c4c,
ttl=0x7f5bc06a5c4f "\377", flags=0x7f5bc06a5c4a, seqno=0x7f5bc06a5c44, vbucket=0x7f5bc06a5c48)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/ep-engine/src/ep_engine.cc:1252
#7 0x00007f5bc06abd80 in bucket_tap_iterator_shim (handle=0x7f5bc08b2ba0, cookie=0xbaf3600, itm=0x7f5bc06a5c38,
engine_specific=0x7f5bc06a5c30, nengine_specific=0x7f5bc06a5c4c, ttl=<value optimized out>, flags=0x7f5bc06a5c4a, seqno=0x7f5bc06a5c44,
vbucket=0x7f5bc06a5c48) at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/memcached/engines/bucket_engine/bucket_engine.c:2115
#8 0x000000000040b61e in ship_tap_log (c=0xbaf3600)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/memcached/daemon/memcached.c:2530
#9 0x0000000000411a6d in conn_ship_log (c=0xbaf3600)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/memcached/daemon/memcached.c:6389
#10 0x0000000000408fed in event_handler (fd=<value optimized out>, which=<value optimized out>, arg=0xbaf3600)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/memcached/daemon/memcached.c:6829
#11 0x00007f5bc4b82d3c in event_process_active_single_queue (base=0xbb98500, flags=<value optimized out>) at event.c:1308
#12 event_process_active (base=0xbb98500, flags=<value optimized out>) at event.c:1375
#13 event_base_loop (base=0xbb98500, flags=<value optimized out>) at event.c:1572
#14 0x00007f5bc53feb7f in platform_thread_wrap (arg=0x28141a0)
at /home/buildbot/centos-5-x64-300-builder/build/build/cmake/platform/src/cb_pthreads.c:19
#15 0x00007f5bc43b6851 in start_thread () from /lib64/libpthread.so.0
#16 0x00007f5bc3a7490d in clone () from /lib64/libc.so.6
(gdb) thread 1