Details
-
Bug
-
Resolution: Won't Fix
-
Blocker
-
1.8.1-release-candidate
-
Security Level: Public
-
None
-
815+Bucket-engine fixes
Description
New stack trace due to SIGILL (MemoryTracker)
Program terminated with signal 4, Illegal instruction.
#0 0x00002aaaaad4fff8 in MemoryTracker::MemoryTracker (this=0xcf88180) at memory_tracker.cc:72
Core was generated by `/opt/couchbase/bin/memcached -X /opt/couchbase/lib/memcached/stdin_term_handler'.
Program terminated with signal 4, Illegal instruction.
#0 0x00002aaaaad4fff8 in MemoryTracker::MemoryTracker (this=0xcf88180) at memory_tracker.cc:72
72 memory_tracker.cc: No such file or directory.
in memory_tracker.cc
(gdb) t a a bt
Thread 12 (Thread 0x2abc4a1ba1c0 (LWP 6823)):
#0 0x0000003b88a07b35 in pthread_join () from /lib64/libpthread.so.0
#1 0x0000000000412470 in threads_shutdown () at daemon/thread.c:706
#2 0x000000000040995c in main (argc=<value optimized out>, argv=<value optimized out>) at daemon/memcached.c:7510
Thread 11 (Thread 6833):
#0 0x0000003b87e9a541 in nanosleep () from /lib64/libc.so.6
#1 0x0000003b87e9a364 in sleep () from /lib64/libc.so.6
#2 0x0000000000414b48 in check_isasl_db_thread (arg=<value optimized out>) at daemon/isasl.c:233
#3 0x0000003b88a0673d in start_thread () from /lib64/libpthread.so.0
#4 0x0000003b87ed44bd in clone () from /lib64/libc.so.6
Thread 10 (Thread 6834):
#0 0x0000003b88a0d524 in __lll_lock_wait () from /lib64/libpthread.so.0
#1 0x0000003b88a08e1a in _L_lock_1034 () from /lib64/libpthread.so.0
#2 0x0000003b88a08cdc in pthread_mutex_lock () from /lib64/libpthread.so.0
#3 0x00002aaaaad70285 in acquire (this=0x2aaaac01a238, name=<value optimized out>) at mutex.hh:73
#4 lock (this=0x2aaaac01a238, name=<value optimized out>) at locks.hh:48
#5 LockHolder (this=0x2aaaac01a238, name=<value optimized out>) at locks.hh:26
#6 TapConnMap::checkConnectivity (this=0x2aaaac01a238, name=<value optimized out>) at tapconnmap.cc:306
#7 0x000000000d0b4e60 in ?? ()
#8 0x000000000d0b4e60 in ?? ()
#9 0x00002aaaaacb27c0 in ?? () from /opt/couchbase/lib/memcached/bucket_engine.so
#10 0x0000000000000000 in ?? ()
Thread 9 (Thread 6835):
#0 0x0000003b88a0d524 in __lll_lock_wait () from /lib64/libpthread.so.0
#1 0x0000003b88a08e1a in _L_lock_1034 () from /lib64/libpthread.so.0
#2 0x0000003b88a08cdc in pthread_mutex_lock () from /lib64/libpthread.so.0
#3 0x00002aaaaad70b9a in _Rb_tree (this=<value optimized out>) at /usr/lib/gcc/x86_64-redhat-linux/4.1.2/../../../../include/c++/4.1.2/bits/stl_tree.h:105
#4 set (this=<value optimized out>) at /usr/lib/gcc/x86_64-redhat-linux/4.1.2/../../../../include/c++/4.1.2/bits/stl_set.h:208
#5 VBucketFilter (this=<value optimized out>) at vbucket.hh:26
#6 TapConnMap::resetReplicaChain (this=<value optimized out>) at tapconnmap.cc:417
#7 0x00002abc49f8a594 in PackedCache<35, unsigned long>::GetOrDefault(unsigned long, unsigned long) const () from /opt/couchbase/lib/libtcmalloc_minimal.so.4
Backtrace stopped: previous frame inner to this frame (corrupt stack?)
Thread 8 (Thread 6836):
#0 0x0000003b88a0d524 in __lll_lock_wait () from /lib64/libpthread.so.0
#1 0x0000003b88a08e1a in _L_lock_1034 () from /lib64/libpthread.so.0
#2 0x0000003b88a08cdc in pthread_mutex_lock () from /lib64/libpthread.so.0
#3 0x00002aaaaad70285 in acquire (this=0x2aaaac07e5a8, name=<value optimized out>) at mutex.hh:73
#4 lock (this=0x2aaaac07e5a8, name=<value optimized out>) at locks.hh:48
#5 LockHolder (this=0x2aaaac07e5a8, name=<value optimized out>) at locks.hh:26
#6 TapConnMap::checkConnectivity (this=0x2aaaac07e5a8, name=<value optimized out>) at tapconnmap.cc:306
#7 0x000000000d0b4e60 in ?? ()
#8 0x000000000d0b4e60 in ?? ()
#9 0x00002aaaaacb27c0 in ?? () from /opt/couchbase/lib/memcached/bucket_engine.so
#10 0x0000000000000000 in ?? ()
Thread 7 (Thread 6837):
Cannot access memory at address 0x2aaa00000008
Thread 6 (Thread 6838):
#0 0x0000003b87ed48a8 in epoll_wait () from /lib64/libc.so.6
#1 0x00002abc49d3cbe8 in epoll_dispatch (base=0xd0b64b0, tv=<value optimized out>) at epoll.c:404
#2 0x00002abc49d2ad5a in event_base_loop (base=0xd0b64b0, flags=<value optimized out>) at event.c:1558
#3 0x0000000000412ff4 in worker_libevent (arg=0xd0b3fe0) at daemon/thread.c:301
#4 0x0000003b88a0673d in start_thread () from /lib64/libpthread.so.0
#5 0x0000003b87ed44bd in clone () from /lib64/libc.so.6
Thread 5 (Thread 6853):
#0 0x0000003b88a0aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00002aaaaad06eba in less_tv (this=0xd006380) at common.hh:113
--Type <return> to continue, or q <return> to quit--
#2 Dispatcher::run (this=0xd006380) at dispatcher.cc:106
#3 0x00002aaaaad0792b in Dispatcher::wake (this=0xd0063d4, task=std::tr1::shared_ptr (count 0) 0x80, outtid=0x1) at dispatcher.cc:187
#4 0x0000000000000000 in ?? ()
Thread 4 (Thread 6854):
#0 0x0000003b88a0b150 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00002aaaaad04d90 in wait (this=0xd00a000, d=<value optimized out>) at syncobject.hh:50
#2 IdleTask::run (this=0xd00a000, d=<value optimized out>) at dispatcher.cc:286
#3 0x00002aaaaad07086 in Dispatcher::run (this=0xd006000) at dispatcher.cc:137
#4 0x00002aaaaad0792b in Dispatcher::wake (this=0xd006054, task=std::tr1::shared_ptr (count 0) 0xd006010, outtid=0x17c1) at dispatcher.cc:187
#5 0x0000000000000000 in ?? ()
Thread 3 (Thread 6855):
#0 0x0000003b88a0b150 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00002aaaaad04d90 in wait (this=0xd00a080, d=<value optimized out>) at syncobject.hh:50
#2 IdleTask::run (this=0xd00a080, d=<value optimized out>) at dispatcher.cc:286
#3 0x00002aaaaad07086 in Dispatcher::run (this=0xd0061c0) at dispatcher.cc:137
#4 0x00002aaaaad0792b in Dispatcher::wake (this=0xd006214, task=std::tr1::shared_ptr (count 0) 0xd0061d0, outtid=0xb13) at dispatcher.cc:187
#5 0x0000000000000000 in ?? ()
Thread 2 (Thread 6856):
#0 0x0000003b88a0d524 in __lll_lock_wait () from /lib64/libpthread.so.0
#1 0x0000003b88a08e1a in _L_lock_1034 () from /lib64/libpthread.so.0
#2 0x0000003b88a08cdc in pthread_mutex_lock () from /lib64/libpthread.so.0
#3 0x000000000040491e in release_cookie (cookie=0x2aaaae7576f8) at daemon/memcached.c:6302
#4 0x00002aaaaaaae1a5 in bucket_engine_release_cookie (cookie=0x2aaaae7576f8) at bucket_engine.c:2425
#5 0x00002aaaaad60519 in acquire (this=0x10da1ed8, key=Traceback (most recent call last):
File "/usr/share/gdb/python/libstdcxx/v6/printers.py", line 467, in to_string
header = ptr.cast(reptype) - 1
RuntimeError: Cannot access memory at address 0x0
, id=24, vb=<value optimized out>, vbv=65048, c=0x2aaaaad731cc) at mutex.hh:73
#6 lock (this=0x10da1ed8, key=Traceback (most recent call last):
File "/usr/share/gdb/python/libstdcxx/v6/printers.py", line 467, in to_string
header = ptr.cast(reptype) - 1
RuntimeError: Cannot access memory at address 0x0
, id=24, vb=<value optimized out>, vbv=65048, c=0x2aaaaad731cc) at locks.hh:48
#7 LockHolder (this=0x10da1ed8, key=Traceback (most recent call last):
File "/usr/share/gdb/python/libstdcxx/v6/printers.py", line 467, in to_string
header = ptr.cast(reptype) - 1
RuntimeError: Cannot access memory at address 0x0
, id=24, vb=<value optimized out>, vbv=65048, c=0x2aaaaad731cc) at locks.hh:26
#8 TapProducer::queueBGFetch (this=0x10da1ed8, key=Traceback (most recent call last):
File "/usr/share/gdb/python/libstdcxx/v6/printers.py", line 467, in to_string
header = ptr.cast(reptype) - 1
RuntimeError: Cannot access memory at address 0x0
, id=24, vb=<value optimized out>, vbv=65048, c=0x2aaaaad731cc) at tapconnection.cc:1003
#9 0x0000003b9aae6630 in vtable for std::ios_base () from /usr/lib64/libstdc++.so.6
#10 0x0000000000000006 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 1 (Thread 0x458be940 (LWP 6852)):
#0 0x00002aaaaad4fff8 in MemoryTracker::MemoryTracker (this=0xcf88180) at memory_tracker.cc:72
#1 0x0000000000000000 in ?? ()