Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-5301

Memcached core due to SIGILL (MemoryTracker)

    XMLWordPrintable

Details

    • Bug
    • Resolution: Won't Fix
    • Blocker
    • 1.8.1
    • 1.8.1-release-candidate
    • couchbase-bucket
    • Security Level: Public
    • None
    • 815+Bucket-engine fixes

    Description

      New stack trace due to SIGILL (MemoryTracker)

      Program terminated with signal 4, Illegal instruction.
      #0 0x00002aaaaad4fff8 in MemoryTracker::MemoryTracker (this=0xcf88180) at memory_tracker.cc:72

      Core was generated by `/opt/couchbase/bin/memcached -X /opt/couchbase/lib/memcached/stdin_term_handler'.
      Program terminated with signal 4, Illegal instruction.
      #0 0x00002aaaaad4fff8 in MemoryTracker::MemoryTracker (this=0xcf88180) at memory_tracker.cc:72
      72 memory_tracker.cc: No such file or directory.
      in memory_tracker.cc
      (gdb) t a a bt

      Thread 12 (Thread 0x2abc4a1ba1c0 (LWP 6823)):
      #0 0x0000003b88a07b35 in pthread_join () from /lib64/libpthread.so.0
      #1 0x0000000000412470 in threads_shutdown () at daemon/thread.c:706
      #2 0x000000000040995c in main (argc=<value optimized out>, argv=<value optimized out>) at daemon/memcached.c:7510

      Thread 11 (Thread 6833):
      #0 0x0000003b87e9a541 in nanosleep () from /lib64/libc.so.6
      #1 0x0000003b87e9a364 in sleep () from /lib64/libc.so.6
      #2 0x0000000000414b48 in check_isasl_db_thread (arg=<value optimized out>) at daemon/isasl.c:233
      #3 0x0000003b88a0673d in start_thread () from /lib64/libpthread.so.0
      #4 0x0000003b87ed44bd in clone () from /lib64/libc.so.6

      Thread 10 (Thread 6834):
      #0 0x0000003b88a0d524 in __lll_lock_wait () from /lib64/libpthread.so.0
      #1 0x0000003b88a08e1a in _L_lock_1034 () from /lib64/libpthread.so.0
      #2 0x0000003b88a08cdc in pthread_mutex_lock () from /lib64/libpthread.so.0
      #3 0x00002aaaaad70285 in acquire (this=0x2aaaac01a238, name=<value optimized out>) at mutex.hh:73
      #4 lock (this=0x2aaaac01a238, name=<value optimized out>) at locks.hh:48
      #5 LockHolder (this=0x2aaaac01a238, name=<value optimized out>) at locks.hh:26
      #6 TapConnMap::checkConnectivity (this=0x2aaaac01a238, name=<value optimized out>) at tapconnmap.cc:306
      #7 0x000000000d0b4e60 in ?? ()
      #8 0x000000000d0b4e60 in ?? ()
      #9 0x00002aaaaacb27c0 in ?? () from /opt/couchbase/lib/memcached/bucket_engine.so
      #10 0x0000000000000000 in ?? ()

      Thread 9 (Thread 6835):
      #0 0x0000003b88a0d524 in __lll_lock_wait () from /lib64/libpthread.so.0
      #1 0x0000003b88a08e1a in _L_lock_1034 () from /lib64/libpthread.so.0
      #2 0x0000003b88a08cdc in pthread_mutex_lock () from /lib64/libpthread.so.0
      #3 0x00002aaaaad70b9a in _Rb_tree (this=<value optimized out>) at /usr/lib/gcc/x86_64-redhat-linux/4.1.2/../../../../include/c++/4.1.2/bits/stl_tree.h:105
      #4 set (this=<value optimized out>) at /usr/lib/gcc/x86_64-redhat-linux/4.1.2/../../../../include/c++/4.1.2/bits/stl_set.h:208
      #5 VBucketFilter (this=<value optimized out>) at vbucket.hh:26
      #6 TapConnMap::resetReplicaChain (this=<value optimized out>) at tapconnmap.cc:417
      #7 0x00002abc49f8a594 in PackedCache<35, unsigned long>::GetOrDefault(unsigned long, unsigned long) const () from /opt/couchbase/lib/libtcmalloc_minimal.so.4
      Backtrace stopped: previous frame inner to this frame (corrupt stack?)

      Thread 8 (Thread 6836):
      #0 0x0000003b88a0d524 in __lll_lock_wait () from /lib64/libpthread.so.0
      #1 0x0000003b88a08e1a in _L_lock_1034 () from /lib64/libpthread.so.0
      #2 0x0000003b88a08cdc in pthread_mutex_lock () from /lib64/libpthread.so.0
      #3 0x00002aaaaad70285 in acquire (this=0x2aaaac07e5a8, name=<value optimized out>) at mutex.hh:73
      #4 lock (this=0x2aaaac07e5a8, name=<value optimized out>) at locks.hh:48
      #5 LockHolder (this=0x2aaaac07e5a8, name=<value optimized out>) at locks.hh:26
      #6 TapConnMap::checkConnectivity (this=0x2aaaac07e5a8, name=<value optimized out>) at tapconnmap.cc:306
      #7 0x000000000d0b4e60 in ?? ()
      #8 0x000000000d0b4e60 in ?? ()
      #9 0x00002aaaaacb27c0 in ?? () from /opt/couchbase/lib/memcached/bucket_engine.so
      #10 0x0000000000000000 in ?? ()

      Thread 7 (Thread 6837):
      Cannot access memory at address 0x2aaa00000008

      Thread 6 (Thread 6838):
      #0 0x0000003b87ed48a8 in epoll_wait () from /lib64/libc.so.6
      #1 0x00002abc49d3cbe8 in epoll_dispatch (base=0xd0b64b0, tv=<value optimized out>) at epoll.c:404
      #2 0x00002abc49d2ad5a in event_base_loop (base=0xd0b64b0, flags=<value optimized out>) at event.c:1558
      #3 0x0000000000412ff4 in worker_libevent (arg=0xd0b3fe0) at daemon/thread.c:301
      #4 0x0000003b88a0673d in start_thread () from /lib64/libpthread.so.0
      #5 0x0000003b87ed44bd in clone () from /lib64/libc.so.6

      Thread 5 (Thread 6853):
      #0 0x0000003b88a0aee9 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
      #1 0x00002aaaaad06eba in less_tv (this=0xd006380) at common.hh:113
      --Type <return> to continue, or q <return> to quit--
      #2 Dispatcher::run (this=0xd006380) at dispatcher.cc:106
      #3 0x00002aaaaad0792b in Dispatcher::wake (this=0xd0063d4, task=std::tr1::shared_ptr (count 0) 0x80, outtid=0x1) at dispatcher.cc:187
      #4 0x0000000000000000 in ?? ()

      Thread 4 (Thread 6854):
      #0 0x0000003b88a0b150 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
      #1 0x00002aaaaad04d90 in wait (this=0xd00a000, d=<value optimized out>) at syncobject.hh:50
      #2 IdleTask::run (this=0xd00a000, d=<value optimized out>) at dispatcher.cc:286
      #3 0x00002aaaaad07086 in Dispatcher::run (this=0xd006000) at dispatcher.cc:137
      #4 0x00002aaaaad0792b in Dispatcher::wake (this=0xd006054, task=std::tr1::shared_ptr (count 0) 0xd006010, outtid=0x17c1) at dispatcher.cc:187
      #5 0x0000000000000000 in ?? ()

      Thread 3 (Thread 6855):
      #0 0x0000003b88a0b150 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
      #1 0x00002aaaaad04d90 in wait (this=0xd00a080, d=<value optimized out>) at syncobject.hh:50
      #2 IdleTask::run (this=0xd00a080, d=<value optimized out>) at dispatcher.cc:286
      #3 0x00002aaaaad07086 in Dispatcher::run (this=0xd0061c0) at dispatcher.cc:137
      #4 0x00002aaaaad0792b in Dispatcher::wake (this=0xd006214, task=std::tr1::shared_ptr (count 0) 0xd0061d0, outtid=0xb13) at dispatcher.cc:187
      #5 0x0000000000000000 in ?? ()

      Thread 2 (Thread 6856):
      #0 0x0000003b88a0d524 in __lll_lock_wait () from /lib64/libpthread.so.0
      #1 0x0000003b88a08e1a in _L_lock_1034 () from /lib64/libpthread.so.0
      #2 0x0000003b88a08cdc in pthread_mutex_lock () from /lib64/libpthread.so.0
      #3 0x000000000040491e in release_cookie (cookie=0x2aaaae7576f8) at daemon/memcached.c:6302
      #4 0x00002aaaaaaae1a5 in bucket_engine_release_cookie (cookie=0x2aaaae7576f8) at bucket_engine.c:2425
      #5 0x00002aaaaad60519 in acquire (this=0x10da1ed8, key=Traceback (most recent call last):
      File "/usr/share/gdb/python/libstdcxx/v6/printers.py", line 467, in to_string
      header = ptr.cast(reptype) - 1
      RuntimeError: Cannot access memory at address 0x0
      , id=24, vb=<value optimized out>, vbv=65048, c=0x2aaaaad731cc) at mutex.hh:73
      #6 lock (this=0x10da1ed8, key=Traceback (most recent call last):
      File "/usr/share/gdb/python/libstdcxx/v6/printers.py", line 467, in to_string
      header = ptr.cast(reptype) - 1
      RuntimeError: Cannot access memory at address 0x0
      , id=24, vb=<value optimized out>, vbv=65048, c=0x2aaaaad731cc) at locks.hh:48
      #7 LockHolder (this=0x10da1ed8, key=Traceback (most recent call last):
      File "/usr/share/gdb/python/libstdcxx/v6/printers.py", line 467, in to_string
      header = ptr.cast(reptype) - 1
      RuntimeError: Cannot access memory at address 0x0
      , id=24, vb=<value optimized out>, vbv=65048, c=0x2aaaaad731cc) at locks.hh:26
      #8 TapProducer::queueBGFetch (this=0x10da1ed8, key=Traceback (most recent call last):
      File "/usr/share/gdb/python/libstdcxx/v6/printers.py", line 467, in to_string
      header = ptr.cast(reptype) - 1
      RuntimeError: Cannot access memory at address 0x0
      , id=24, vb=<value optimized out>, vbv=65048, c=0x2aaaaad731cc) at tapconnection.cc:1003
      #9 0x0000003b9aae6630 in vtable for std::ios_base () from /usr/lib64/libstdc++.so.6
      #10 0x0000000000000006 in ?? ()
      #11 0x0000000000000000 in ?? ()

      Thread 1 (Thread 0x458be940 (LWP 6852)):
      #0 0x00002aaaaad4fff8 in MemoryTracker::MemoryTracker (this=0xcf88180) at memory_tracker.cc:72
      #1 0x0000000000000000 in ?? ()

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            chiyoung Chiyoung Seo (Inactive)
            karan Karan Kumar (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty