{UPR} :: Memcached crashed during Rebalance operation

Jenkins Ref Link:
http://qa.sc.couchbase.com/job/centos_x64--29_01--create_view_all-P1/88/consoleFull

Tests Failed:
./testrunner -i <yourfile>.ini get-cbcollect-info=True,get-logs=True, -t view.createdeleteview.CreateDeleteViewTests.ddoc_ops_during_failover,ddoc_ops=create,test_with_view=True,num_ddocs=3,num_views_per_ddoc=2,items=200000,nodes_out=2,replicas=2
./testrunner -i <youfile>.ini get-cbcollect-info=True,get-logs=True, -t view.createdeleteview.CreateDeleteViewTests.ddoc_ops_during_failover,ddoc_ops=delete,test_with_view=False,num_ddocs=2,num_views_per_ddoc=3,items=200000,nodes_out=1,sasl_buckets=1,standard_buckets=1

Note: Failed tests might not deterministically reproduce the error

Logs:
[user:info,2014-06-10T1:24:30.781,ns_1@172.23.107.24:<0.1427.0>:ns_orchestrator:handle_info:480]Rebalance exited with reason {unexpected_exit,
{'EXIT',<0.32.33>,
{bulk_set_vbucket_state_failed,
[{'ns_1@172.23.107.24',
{'EXIT',
{{{{{child_interrupted,
{'EXIT',<0.14685.32>,normal}},
[{upr_replicator,spawn_and_wait,1,
[

{file,"src/upr_replicator.erl"},
{line,212}]},
{upr_replicator,handle_call,3,
[{file,"src/upr_replicator.erl"}

,

{line,112}

]},
{gen_server,handle_msg,5,
[

{file,"gen_server.erl"}

,

{line,585}

]},
{proc_lib,init_p_do_apply,3,
[

{file,"proc_lib.erl"}

,

{line,239}

]}]},
{gen_server,call,
['upr_replicator-default-ns_1@172.23.107.27',

{setup_replication, [835,839,841,843,847,851,852,853,854, 855,856,857,858,859,860,861,862,863, 864,865,866,867,868,869,870,871,872, 873,874,875,876,877,878,879,880,881, 882,883,884,885,886,887,888,932,933, 934,935,936,937,938,939,940,941,942, 943,944,945,946,947,948,949,950,951, 952,953,954,955,956,957,958,959,960, 961,962,963,964,965,966,967,968,969, 970,971,972,973,974,975,976,977,978, 979,980]}

,
infinity]}},
{gen_server,call,
['replication_manager-default',

{change_vbucket_replication,841, 'ns_1@172.23.107.27'}

,
infinity]}},
{gen_server,call,
[

{'janitor_agent-default', 'ns_1@172.23.107.24'}

,
{if_rebalance,<0.9944.32>,
{update_vbucket_state,845,replica,
undefined,'ns_1@172.23.107.27'}},
infinity]}}}}]}}}

Crash Logs:
gdb /opt/couchbase/bin/memcached core.memcached.25954
GNU gdb (Ubuntu/Linaro 7.4-2012.04-0ubuntu2.1) 7.4-2012.04
Copyright (C) 2012 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
For bug reporting instructions, please see:
<http://bugs.launchpad.net/gdb-linaro/>...
Reading symbols from /opt/couchbase/bin/memcached...done.
[New LWP 25957]
[New LWP 25961]
[New LWP 25955]
[New LWP 25954]
[New LWP 25956]
[New LWP 25960]
[New LWP 25958]
[New LWP 26005]
[New LWP 25959]
[New LWP 26007]
[New LWP 26010]
[New LWP 26008]
[New LWP 26009]

warning: Can't read pathname for load map: Input/output error.
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/opt/couchbase/bin/memcached -C /opt/couchbase/var/lib/couchbase/config/memcach'.
Program terminated with signal 6, Aborted.
#0 0x00007f8178444425 in raise () from /lib/x86_64-linux-gnu/libc.so.6
(gdb) t a a bt

Thread 13 (Thread 0x7f816fcdf700 (LWP 26009)):
#0 0x00007f81784fb25d in fdatasync () from /lib/x86_64-linux-gnu/libc.so.6
#1 0x00007f8172f92037 in couch_sync (errinfo=0x7059b20, handle=<optimized out>) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/couchstore/src/os.c:133
#2 0x00007f81732770d6 in cfs_sync (errinfo=0x7059b20, h=0x7d254e0) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/couch-kvstore/couch-fs-stats.cc:128
#3 0x00007f8172f79f8a in couchstore_commit (db=0x7059b00) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/couchstore/src/couch_db.cc:194
#4 0x00007f81732697ad in CouchKVStore::setVBucketState (this=0x6d34d00, vbucketId=833, vbstate=..., vb_change_type=1, kvcb=0x7f816fcdecf0, notify=true)
at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/couch-kvstore/couch-kvstore.cc:1040
#5 0x00007f8173270725 in CouchKVStore::snapshotVBuckets (this=0x6d34d00, vbstates=..., cb=0x7f816fcdecf0)
at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/couch-kvstore/couch-kvstore.cc:924
#6 0x00007f81731d39cc in EventuallyPersistentStore::snapshotVBuckets (this=0x6ccc240, priority=..., shardId=<optimized out>)
at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/ep.cc:853
#7 0x00007f817322c30f in VBSnapshotTask::run (this=<optimized out>) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/tasks.cc:44
#8 0x00007f817320f461 in ExecutorThread::run (this=0x243e480) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/executorthread.cc:94
#9 0x00007f817320f9e9 in launch_executor_thread (arg=0x243e480) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/executorthread.cc:33
#10 0x00007f8179fb034f in platform_thread_wrap (arg=0x23e6bc0) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#11 0x00007f8178ceae9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#12 0x00007f8178501cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
#13 0x0000000000000000 in ?? ()

Thread 12 (Thread 0x7f81704e0700 (LWP 26008)):
#0 0x00007f81784fb25d in fdatasync () from /lib/x86_64-linux-gnu/libc.so.6
#1 0x00007f8172f92037 in couch_sync (errinfo=0x23f3720, handle=<optimized out>) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/couchstore/src/os.c:133
#2 0x00007f81732770d6 in cfs_sync (errinfo=0x23f3720, h=0x776b400) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/couch-kvstore/couch-fs-stats.cc:128
#3 0x00007f8172f79fba in couchstore_commit (db=0x23f3700) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/couchstore/src/couch_db.cc:203
#4 0x00007f81732697ad in CouchKVStore::setVBucketState (this=0x6d34000, vbucketId=832, vbstate=..., vb_change_type=1, kvcb=0x7f81704dfcf0, notify=true)
at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/couch-kvstore/couch-kvstore.cc:1040
#5 0x00007f8173270725 in CouchKVStore::snapshotVBuckets (this=0x6d34000, vbstates=..., cb=0x7f81704dfcf0)
at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/couch-kvstore/couch-kvstore.cc:924
#6 0x00007f81731d39cc in EventuallyPersistentStore::snapshotVBuckets (this=0x6ccc240, priority=..., shardId=<optimized out>)
at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/ep.cc:853
#7 0x00007f817322c30f in VBSnapshotTask::run (this=<optimized out>) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/tasks.cc:44
#8 0x00007f817320f461 in ExecutorThread::run (this=0x243e3f0) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/executorthread.cc:94
#9 0x00007f817320f9e9 in launch_executor_thread (arg=0x243e3f0) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/executorthread.cc:33
#10 0x00007f8179fb034f in platform_thread_wrap (arg=0x23e6bd0) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#11 0x00007f8178ceae9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#12 0x00007f8178501cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
#13 0x0000000000000000 in ?? ()

Thread 11 (Thread 0x7f816f4de700 (LWP 26010)):
#0 0x00007f8178cef0fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1 0x00007f8179fb0695 in cb_cond_timedwait (cond=0x6d09940, mutex=0x6d09908, ms=<optimized out>) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/platform/src/cb_pthreads.c:156
#2 0x00007f81731fd3b0 in wait (tv=..., this=0x6d09900) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/syncobject.h:74
#3 ExecutorPool::trySleep (this=0x6d098e0, t=..., now=...) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/executorpool.cc:177
#4 0x00007f81731fd84d in ExecutorPool::nextTask (this=0x6d098e0, t=..., tick=<optimized out>) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/executorpool.cc:151
#5 0x00007f817320f3c0 in ExecutorThread::run (this=0x243e510) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/executorthread.cc:77
#6 0x00007f817320f9e9 in launch_executor_thread (arg=0x243e510) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/executorthread.cc:33
#7 0x00007f8179fb034f in platform_thread_wrap (arg=0x23e6be0) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#8 0x00007f8178ceae9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#9 0x00007f8178501cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
#10 0x0000000000000000 in ?? ()

Thread 10 (Thread 0x7f8170ce1700 (LWP 26007)):
#0 0x00007f8178cef0fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1 0x00007f8179fb0695 in cb_cond_timedwait (cond=0x6d09940, mutex=0x6d09908, ms=<optimized out>) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/platform/src/cb_pthreads.c:156
--Type <return> to continue, or q <return> to quit--
#2 0x00007f81731fd3b0 in wait (tv=..., this=0x6d09900) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/syncobject.h:74
#3 ExecutorPool::trySleep (this=0x6d098e0, t=..., now=...) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/executorpool.cc:177
#4 0x00007f81731fd84d in ExecutorPool::nextTask (this=0x6d098e0, t=..., tick=<optimized out>) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/executorpool.cc:151
#5 0x00007f817320f3c0 in ExecutorThread::run (this=0x243e360) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/executorthread.cc:77
#6 0x00007f817320f9e9 in launch_executor_thread (arg=0x243e360) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/executorthread.cc:33
#7 0x00007f8179fb034f in platform_thread_wrap (arg=0x23e6bb0) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#8 0x00007f8178ceae9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#9 0x00007f8178501cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
#10 0x0000000000000000 in ?? ()

Thread 9 (Thread 0x7f81754d5700 (LWP 25959)):
#0 0x00007f8178502353 in epoll_wait () from /lib/x86_64-linux-gnu/libc.so.6
#1 0x00007f8179546337 in epoll_dispatch (base=0x6ca6780, tv=<optimized out>) at epoll.c:404
#2 0x00007f8179531081 in event_base_loop (base=0x6ca6780, flags=<optimized out>) at event.c:1558
#3 0x00007f8179fb034f in platform_thread_wrap (arg=0x23e6110) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#4 0x00007f8178ceae9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#5 0x00007f8178501cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
#6 0x0000000000000000 in ?? ()

Thread 8 (Thread 0x7f8173cd2700 (LWP 26005)):
#0 0x00007f81784cd83d in nanosleep () from /lib/x86_64-linux-gnu/libc.so.6
#1 0x00007f81784fb774 in usleep () from /lib/x86_64-linux-gnu/libc.so.6
#2 0x00007f817320e215 in updateStatsThread (arg=0x2436200) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/memory_tracker.cc:36
#3 0x00007f8179fb034f in platform_thread_wrap (arg=0x23e6200) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#4 0x00007f8178ceae9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#5 0x00007f8178501cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
#6 0x0000000000000000 in ?? ()

Thread 7 (Thread 0x7f8175cd6700 (LWP 25958)):
#0 0x00007f8178502353 in epoll_wait () from /lib/x86_64-linux-gnu/libc.so.6
#1 0x00007f8179546337 in epoll_dispatch (base=0x6ca6500, tv=<optimized out>) at epoll.c:404
#2 0x00007f8179531081 in event_base_loop (base=0x6ca6500, flags=<optimized out>) at event.c:1558
#3 0x00007f8179fb034f in platform_thread_wrap (arg=0x23e6100) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#4 0x00007f8178ceae9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#5 0x00007f8178501cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
#6 0x0000000000000000 in ?? ()

Thread 6 (Thread 0x7f8174cd4700 (LWP 25960)):
#0 0x00007f8178502353 in epoll_wait () from /lib/x86_64-linux-gnu/libc.so.6
#1 0x00007f8179546337 in epoll_dispatch (base=0x6ca6a00, tv=<optimized out>) at epoll.c:404
#2 0x00007f8179531081 in event_base_loop (base=0x6ca6a00, flags=<optimized out>) at event.c:1558
#3 0x00007f8179fb034f in platform_thread_wrap (arg=0x23e6120) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#4 0x00007f8178ceae9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#5 0x00007f8178501cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
#6 0x0000000000000000 in ?? ()

Thread 5 (Thread 0x7f8176ee7700 (LWP 25956)):
#0 0x00007f8178cef0fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1 0x00007f8179fb0695 in cb_cond_timedwait (cond=0x7f81770eb200, mutex=0x7f81770eb1c0, ms=<optimized out>)
at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/platform/src/cb_pthreads.c:156
#2 0x00007f8176ee9bb0 in logger_thead_main (arg=0x2436900) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/memcached/extensions/loggers/file_logger.c:372
#3 0x00007f8179fb034f in platform_thread_wrap (arg=0x23e6070) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#4 0x00007f8178ceae9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#5 0x00007f8178501cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
#6 0x0000000000000000 in ?? ()
--Type <return> to continue, or q <return> to quit--

Thread 4 (Thread 0x7f817a7cd740 (LWP 25954)):
#0 0x00007f8178502353 in epoll_wait () from /lib/x86_64-linux-gnu/libc.so.6
#1 0x00007f8179546337 in epoll_dispatch (base=0x6ca6000, tv=<optimized out>) at epoll.c:404
#2 0x00007f8179531081 in event_base_loop (base=0x6ca6000, flags=<optimized out>) at event.c:1558
#3 0x0000000000405fc5 in main (argc=<optimized out>, argv=<optimized out>) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/memcached/daemon/memcached.c:8822

Thread 3 (Thread 0x7f81778ec700 (LWP 25955)):
#0 0x00007f81784f48bd in read () from /lib/x86_64-linux-gnu/libc.so.6
#1 0x00007f8178488ff8 in _IO_file_underflow () from /lib/x86_64-linux-gnu/libc.so.6
#2 0x00007f817848a03e in _IO_default_uflow () from /lib/x86_64-linux-gnu/libc.so.6
#3 0x00007f817847e18a in _IO_getline_info () from /lib/x86_64-linux-gnu/libc.so.6
#4 0x00007f817847d06b in fgets () from /lib/x86_64-linux-gnu/libc.so.6
#5 0x00007f81778ed901 in fgets (__stream=<optimized out>, __n=80, __s=0x7f81778ebe10 "\005") at /usr/include/x86_64-linux-gnu/bits/stdio2.h:255
#6 check_stdin_thread (arg=<optimized out>) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/memcached/extensions/daemon/stdin_check.c:38
#7 0x00007f8179fb034f in platform_thread_wrap (arg=0x23e6060) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#8 0x00007f8178ceae9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#9 0x00007f8178501cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
#10 0x0000000000000000 in ?? ()

Thread 2 (Thread 0x7f81744d3700 (LWP 25961)):
#0 0x00007f8178502353 in epoll_wait () from /lib/x86_64-linux-gnu/libc.so.6
#1 0x00007f8179546337 in epoll_dispatch (base=0x6ca6c80, tv=<optimized out>) at epoll.c:404
#2 0x00007f8179531081 in event_base_loop (base=0x6ca6c80, flags=<optimized out>) at event.c:1558
#3 0x00007f8179fb034f in platform_thread_wrap (arg=0x23e6130) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#4 0x00007f8178ceae9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#5 0x00007f8178501cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
#6 0x0000000000000000 in ?? ()

Thread 1 (Thread 0x7f81764d7700 (LWP 25957)):
#0 0x00007f8178444425 in raise () from /lib/x86_64-linux-gnu/libc.so.6
#1 0x00007f8178447b8b in abort () from /lib/x86_64-linux-gnu/libc.so.6
#2 0x00007f817843d0ee in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#3 0x00007f817843d192 in __assert_fail () from /lib/x86_64-linux-gnu/libc.so.6
#4 0x00007f8173246869 in PassiveStream::~PassiveStream (this=0x7ed4480, __in_chrg=<optimized out>) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/upr-stream.cc:828
#5 0x00007f81732468a9 in PassiveStream::~PassiveStream (this=0x7ed4480, __in_chrg=<optimized out>) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/upr-stream.cc:830
#6 0x00007f8173238ca9 in ~SingleThreadedRCPtr (this=0x7f81764d6c30, __in_chrg=<optimized out>) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/atomic.h:397
#7 ~SingleThreadedRCPtr (this=0x7f81764d6c30, __in_chrg=<optimized out>) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/upr-consumer.cc:93
#8 UprConsumer::addStream (this=0x6cdc300, opaque=1157824512, vbucket=837, flags=1) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/upr-consumer.cc:125
#9 0x00007f81731e3b6d in EvpUprAddStream (handle=<optimized out>, cookie=0x6b5ac00, opaque=1157824512, vbucket=837, flags=1)
at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/ep-engine/src/ep_engine.cc:1383
#10 0x00007f81764de31f in upr_add_stream (handle=<optimized out>, cookie=0x6b5ac00, opaque=1157824512, vbucket=837, flags=1)
at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/memcached/engines/bucket_engine/bucket_engine.c:2274
#11 0x0000000000412992 in upr_add_stream_executor (c=0x6b5ac00, packet=<optimized out>) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/memcached/daemon/memcached.c:4079
#12 0x0000000000416bfe in process_bin_packet (c=0x6b5ac00) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/memcached/daemon/memcached.c:5411
#13 complete_nread (c=0x6b5ac00) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/memcached/daemon/memcached.c:5817
#14 conn_nread (c=0x6b5ac00) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/memcached/daemon/memcached.c:7024
#15 0x000000000040af85 in event_handler (arg=0x6b5ac00, which=4, fd=<optimized out>) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/memcached/daemon/memcached.c:7297
#16 event_handler (fd=<optimized out>, which=4, arg=0x6b5ac00) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/memcached/daemon/memcached.c:7256
#17 0x00007f817953117c in event_process_active_single_queue (activeq=<optimized out>, base=<optimized out>) at event.c:1308
#18 event_process_active (base=<optimized out>) at event.c:1375
#19 event_base_loop (base=0x6ca6280, flags=<optimized out>) at event.c:1572
#20 0x00007f8179fb034f in platform_thread_wrap (arg=0x23e60f0) at /home/buildbot/buildbot_slave/ubuntu-1204-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
#21 0x00007f8178ceae9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#22 0x00007f8178501cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
--Type <return> to continue, or q <return> to quit--
#23 0x0000000000000000 in ?? ()

Uploading Logs