Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-11400

Assertion `curTaskType != NO_TASK_TYPE' failed

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 3.0
    • 3.0
    • None
    • Security Level: Public
    • None
    • Untriaged
    • Yes

    Description

      while running pyupr in vm on build 3.0-803:

      ./pyupr -h 127.0.0.1:8091 -o test_add_stream_n_consumers_n_streams

      test fails due to mc abort

      Program received signal SIGABRT, Aborted.
      [Switching to Thread 0x7f1fa7136700 (LWP 537)]
      0x00007f1faea1a425 in raise () from /lib/x86_64-linux-gnu/libc.so.6
      (gdb) t a a bt

      Thread 16 (Thread 0x7f1fa5933700 (LWP 542)):
      #0 0x00007f1faf9caeb4 in pthread_mutex_lock () from /lib/x86_64-linux-gnu/libpthread.so.0
      #1 0x00007f1fb0c4aef9 in cb_mutex_enter (mutex=0x1) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:85
      #2 0x00007f1fa9ef3f5d in Mutex::acquire (this=0x6e7a2e0) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/mutex.cc:31
      #3 0x00007f1fa9ea1af3 in lock (this=<optimized out>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/locks.h:66
      #4 LockHolder (m=..., this=<optimized out>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/locks.h:44
      #5 hasPendingBGFetchItems (this=<optimized out>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/vbucket.h:310
      #6 BgFetcher::pendingJob (this=0x6c26000) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/bgfetcher.cc:182
      #7 0x00007f1fa9eb2669 in stopBgFetcher (this=<optimized out>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/ep.cc:453
      #8 EventuallyPersistentStore::~EventuallyPersistentStore (this=0x6c06240, __in_chrg=<optimized out>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/ep.cc:354
      #9 0x00007f1fa9ecaf65 in EventuallyPersistentEngine::~EventuallyPersistentEngine (this=0x6c1a000, __in_chrg=<optimized out>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/ep_engine.cc:5506
      #10 0x00007f1fa9ecb1bd in EvpDestroy (handle=0x6c1a000, force=<optimized out>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/ep_engine.cc:143
      #11 0x00007f1fad1baf16 in engine_shutdown_thread (arg=0x6bdc2a0) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/memcached/engines/bucket_engine/bucket_engine.c:1564
      #12 0x00007f1fb0c4b09f in platform_thread_wrap (arg=0x2316c90) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
      #13 0x00007f1faf9c8e9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
      #14 0x00007f1faead7cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
      #15 0x0000000000000000 in ?? ()

      Thread 14 (Thread 0x7f1fa6134700 (LWP 539)):
      #0 0x00007f1faf9cd0fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
      #1 0x00007f1fb0c4b18b in cb_cond_timedwait (cond=0x6c2d940, mutex=0x6c2d908, ms=<optimized out>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:156
      #2 0x00007f1fa9ee858f in SyncObject::wait (this=0x6c2d900, tv=...) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/syncobject.h:74
      #3 0x00007f1fa9ee3f80 in ExecutorPool::trySleep (this=0x6c2d8e0, t=..., now=...) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/executorpool.cc:177
      #4 0x00007f1fa9ee42c4 in ExecutorPool::nextTask (this=0x6c2d8e0, t=..., tick=16 '\020') at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/executorpool.cc:151
      #5 0x00007f1fa9ef4a87 in ExecutorThread::run (this=0x2362480) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/executorthread.cc:77
      #6 0x00007f1fa9ef4ebd in launch_executor_thread (arg=0x6c2d944) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/executorthread.cc:33
      #7 0x00007f1fb0c4b09f in platform_thread_wrap (arg=0x2316bd0) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
      #8 0x00007f1faf9c8e9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
      #9 0x00007f1faead7cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
      #10 0x0000000000000000 in ?? ()

      Thread 13 (Thread 0x7f1fa6935700 (LWP 538)):
      #0 0x00007f1faf9cd0fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
      #1 0x00007f1fb0c4b18b in cb_cond_timedwait (cond=0x6c2d940, mutex=0x6c2d908, ms=<optimized out>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:156
      #2 0x00007f1fa9ee858f in SyncObject::wait (this=0x6c2d900, tv=...) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/syncobject.h:74
      #3 0x00007f1fa9ee3f80 in ExecutorPool::trySleep (this=0x6c2d8e0, t=..., now=...) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/executorpool.cc:177
      #4 0x00007f1fa9ee42c4 in ExecutorPool::nextTask (this=0x6c2d8e0, t=..., tick=8 '\b') at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/executorpool.cc:151
      #5 0x00007f1fa9ef4a87 in ExecutorThread::run (this=0x23623f0) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/executorthread.cc:77
      #6 0x00007f1fa9ef4ebd in launch_executor_thread (arg=0x6c2d944) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/executorthread.cc:33
      #7 0x00007f1fb0c4b09f in platform_thread_wrap (arg=0x2316bb0) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
      #8 0x00007f1faf9c8e9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
      #9 0x00007f1faead7cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
      #10 0x0000000000000000 in ?? ()

      Thread 12 (Thread 0x7f1fa7136700 (LWP 537)):
      #0 0x00007f1faea1a425 in raise () from /lib/x86_64-linux-gnu/libc.so.6
      #1 0x00007f1faea1db8b in abort () from /lib/x86_64-linux-gnu/libc.so.6
      #2 0x00007f1faea130ee in ?? () from /lib/x86_64-linux-gnu/libc.so.6
      #3 0x00007f1faea13192 in __assert_fail () from /lib/x86_64-linux-gnu/libc.so.6
      #4 0x00007f1fa9ee45a8 in ExecutorPool::doneWork (this=0x6c2d8e0, curTaskType=@0x23623a8: NO_TASK_TYPE) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/executorpool.cc:225
      #5 0x00007f1fa9f18385 in TaskQueue::doneTask (this=0x6bc6580, task=..., curTaskType=@0x6: <error reading variable>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/taskqueue.cc:147
      #6 0x00007f1fa9ef4cba in ExecutorThread::run (this=0x2362360) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/executorthread.cc:81
      #7 0x00007f1fa9ef4ebd in launch_executor_thread (arg=0x7f78) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/executorthread.cc:33
      #8 0x00007f1fb0c4b09f in platform_thread_wrap (arg=0x2316bc0) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
      #9 0x00007f1faf9c8e9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
      #10 0x00007f1faead7cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
      #11 0x0000000000000000 in ?? ()

      Thread 11 (Thread 0x7f1fa7937700 (LWP 536)):
      #0 0x00007f1faf9cd0fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
      #1 0x00007f1fb0c4b18b in cb_cond_timedwait (cond=0x6c2d940, mutex=0x6c2d908, ms=<optimized out>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:156
      #2 0x00007f1fa9ee858f in SyncObject::wait (this=0x6c2d900, tv=...) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/syncobject.h:74
      #3 0x00007f1fa9ee3f80 in ExecutorPool::trySleep (this=0x6c2d8e0, t=..., now=...) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/executorpool.cc:177
      #4 0x00007f1fa9ee41c8 in ExecutorPool::nextTask (this=0x6c2d8e0, t=..., tick=<optimized out>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/executorpool.cc:135
      #5 0x00007f1fa9ef4a87 in ExecutorThread::run (this=0x23622d0) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/executorthread.cc:77
      #6 0x00007f1fa9ef4ebd in launch_executor_thread (arg=0x6c2d944) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/executorthread.cc:33
      #7 0x00007f1fb0c4b09f in platform_thread_wrap (arg=0x2316ba0) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
      #8 0x00007f1faf9c8e9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
      #9 0x00007f1faead7cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
      #10 0x0000000000000000 in ?? ()

      Thread 10 (Thread 0x7f1faa9b2700 (LWP 535)):
      #0 0x00007f1faeaa383d in nanosleep () from /lib/x86_64-linux-gnu/libc.so.6
      #1 0x00007f1faead1774 in usleep () from /lib/x86_64-linux-gnu/libc.so.6
      #2 0x00007f1fa9ef3045 in updateStatsThread (arg=<optimized out>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/memory_tracker.cc:36
      #3 0x00007f1fb0c4b09f in platform_thread_wrap (arg=0x23161f0) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
      #4 0x00007f1faf9c8e9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
      #5 0x00007f1faead7cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
      #6 0x0000000000000000 in ?? ()

      Thread 8 (Thread 0x7f1fae5ca700 (LWP 32633)):
      #0 0x00007f1faeaca8bd in read () from /lib/x86_64-linux-gnu/libc.so.6
      #1 0x00007f1faea5eff8 in _IO_file_underflow () from /lib/x86_64-linux-gnu/libc.so.6
      #2 0x00007f1faea6003e in _IO_default_uflow () from /lib/x86_64-linux-gnu/libc.so.6
      #3 0x00007f1faea5418a in _IO_getline_info () from /lib/x86_64-linux-gnu/libc.so.6
      #4 0x00007f1faea5306b in fgets () from /lib/x86_64-linux-gnu/libc.so.6
      #5 0x00007f1fae5cba91 in fgets (__stream=<optimized out>, __n=<optimized out>, __s=<optimized out>) at /usr/include/bits/stdio2.h:255
      #6 check_stdin_thread (arg=<optimized out>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/memcached/extensions/daemon/stdin_check.c:38
      #7 0x00007f1fb0c4b09f in platform_thread_wrap (arg=0x2316060) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
      #8 0x00007f1faf9c8e9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
      #9 0x00007f1faead7cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
      #10 0x0000000000000000 in ?? ()

      Thread 7 (Thread 0x7f1fadbc5700 (LWP 32634)):
      #0 0x00007f1faf9cd0fe in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
      #1 0x00007f1fb0c4b18b in cb_cond_timedwait (cond=0x7f1faddc9240, mutex=0x7f1faddc9200, ms=<optimized out>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:156
      #2 0x00007f1fadbc81e8 in logger_thead_main (arg=<optimized out>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/memcached/extensions/loggers/file_logger.c:372
      #3 0x00007f1fb0c4b09f in platform_thread_wrap (arg=0x2316070) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
      #4 0x00007f1faf9c8e9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
      #5 0x00007f1faead7cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
      #6 0x0000000000000000 in ?? ()

      Thread 6 (Thread 0x7f1fad1b7700 (LWP 32635)):
      #0 0x00007f1faead8353 in epoll_wait () from /lib/x86_64-linux-gnu/libc.so.6
      #1 0x00007f1fb01e05a6 in epoll_dispatch (base=0x6bca280, tv=<optimized out>) at epoll.c:404
      #2 0x00007f1fb01cba04 in event_base_loop (base=0x6bca280, flags=<optimized out>) at event.c:1558
      #3 0x00007f1fb0c4b09f in platform_thread_wrap (arg=0x23160f0) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
      #4 0x00007f1faf9c8e9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
      #5 0x00007f1faead7cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
      #6 0x0000000000000000 in ?? ()

      Thread 5 (Thread 0x7f1fac9b6700 (LWP 32636)):
      #0 0x00007f1faead8353 in epoll_wait () from /lib/x86_64-linux-gnu/libc.so.6
      #1 0x00007f1fb01e05a6 in epoll_dispatch (base=0x6bca500, tv=<optimized out>) at epoll.c:404
      #2 0x00007f1fb01cba04 in event_base_loop (base=0x6bca500, flags=<optimized out>) at event.c:1558
      #3 0x00007f1fb0c4b09f in platform_thread_wrap (arg=0x2316100) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
      #4 0x00007f1faf9c8e9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
      #5 0x00007f1faead7cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
      #6 0x0000000000000000 in ?? ()

      Thread 4 (Thread 0x7f1fac1b5700 (LWP 32637)):
      #0 0x00007f1faead8353 in epoll_wait () from /lib/x86_64-linux-gnu/libc.so.6
      #1 0x00007f1fb01e05a6 in epoll_dispatch (base=0x6bca780, tv=<optimized out>) at epoll.c:404
      #2 0x00007f1fb01cba04 in event_base_loop (base=0x6bca780, flags=<optimized out>) at event.c:1558
      #3 0x00007f1fb0c4b09f in platform_thread_wrap (arg=0x2316110) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
      #4 0x00007f1faf9c8e9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
      #5 0x00007f1faead7cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
      #6 0x0000000000000000 in ?? ()

      Thread 3 (Thread 0x7f1fab9b4700 (LWP 32638)):
      #0 0x00007f1faead8353 in epoll_wait () from /lib/x86_64-linux-gnu/libc.so.6
      #1 0x00007f1fb01e05a6 in epoll_dispatch (base=0x6bcaa00, tv=<optimized out>) at epoll.c:404
      #2 0x00007f1fb01cba04 in event_base_loop (base=0x6bcaa00, flags=<optimized out>) at event.c:1558
      #3 0x00007f1fb0c4b09f in platform_thread_wrap (arg=0x2316120) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
      #4 0x00007f1faf9c8e9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
      #5 0x00007f1faead7cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
      #6 0x0000000000000000 in ?? ()

      Thread 2 (Thread 0x7f1fab1b3700 (LWP 32639)):
      #0 0x00007f1faead8353 in epoll_wait () from /lib/x86_64-linux-gnu/libc.so.6
      #1 0x00007f1fb01e05a6 in epoll_dispatch (base=0x6bcac80, tv=<optimized out>) at epoll.c:404
      #2 0x00007f1fb01cba04 in event_base_loop (base=0x6bcac80, flags=<optimized out>) at event.c:1558
      #3 0x00007f1fb0c4b09f in platform_thread_wrap (arg=0x2316130) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/platform/src/cb_pthreads.c:19
      #4 0x00007f1faf9c8e9a in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
      #5 0x00007f1faead7cbd in clone () from /lib/x86_64-linux-gnu/libc.so.6
      #6 0x0000000000000000 in ?? ()

      Thread 1 (Thread 0x7f1fb1467740 (LWP 32632)):
      #0 0x00007f1faead8353 in epoll_wait () from /lib/x86_64-linux-gnu/libc.so.6
      #1 0x00007f1fb01e05a6 in epoll_dispatch (base=0x6bca000, tv=<optimized out>) at epoll.c:404
      #2 0x00007f1fb01cba04 in event_base_loop (base=0x6bca000, flags=<optimized out>) at event.c:1558
      #3 0x000000000041032b in main (argc=<optimized out>, argv=<optimized out>) at /home/buildbot/ubuntu-1004-x64-300-builder/build/build/memcached/daemon/memcached.c:8816

      from ns_logs

      [ns_server:debug,2014-06-11T13:13:33.015,ns_1@127.0.0.1:replication_manager-default<0.1221.0>:replication_manager:terminate:98]Replication manager died {shutdown,
      {state,"default",upr,undefined,[],undefined}}
      [user:info,2014-06-11T13:13:33.015,ns_1@127.0.0.1:ns_memcached-default<0.1219.0>:ns_memcached:terminate:789]Shutting down bucket "default" on 'ns_1@127.0.0.1' for deletion
      [ns_server:error,2014-06-11T13:13:33.510,ns_1@127.0.0.1:ns_memcached-default<0.1219.0>:ns_memcached:terminate:806]Failed to delete bucket "default": {error,{badmatch,

      {error,closed}

      }}
      [ns_server:info,2014-06-11T13:13:33.510,ns_1@127.0.0.1:<0.1236.0>:mc_connection:run_loop:162]mccouch connection was normally closed
      [ns_server:debug,2014-06-11T13:13:33.510,ns_1@127.0.0.1:ns_memcached-default<0.1219.0>:ns_memcached:terminate:815]Proceeding into vbuckets dbs deletions
      [user:info,2014-06-11T13:13:33.511,ns_1@127.0.0.1:<0.278.0>:ns_log:crash_consumption_loop:70]Port server memcached on node 'babysitter_of_ns_1@127.0.0.1' exited with status 134. Restarting. Messages: Wed Jun 11 13:13:26.948431 PDT 3: (default) UPR (Consumer) eq_uprq:mystream4 - (vb 717) Attempting to add stream with start seqno 0, end seqno 18446744073709551615, vbucket uuid 4675300462675623936, snap start seqno 0, and snap end seqno 0
      Wed Jun 11 13:13:26.952896 PDT 3: (default) UPR (Consumer) eq_uprq:mystream4 - (vb 716) Attempting to add stream with start seqno 0, end seqno 18446744073709551615, vbucket uuid 4675300462675623936, snap start seqno 0, and snap end seqno 0
      Wed Jun 11 13:13:33.257338 PDT 3: (default) Shutting down tap connections!
      Wed Jun 11 13:13:33.257459 PDT 3: (default) Shutting down upr connections!
      memcached: /home/buildbot/ubuntu-1004-x64-300-builder/build/build/ep-engine/src/executorpool.cc:225: size_t ExecutorPool::doneWork(task_type_t&): Assertion `curTaskType != NO_TASK_TYPE' failed.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            mikew Mike Wiederhold [X] (Inactive)
            tommie Tommie McAfee (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty