Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-23413

[Thread Sanitizer]: Data race warning during ExecutorThread delete

    XMLWordPrintable

Details

    • Triaged
    • Unknown
    • KV Spock Beta

    Description

      Running [0016/0017]: Stat latency with 100 vbuckets. Also sets & DCP traffic on separate thread (couchstore)...Latency [With 100 vbuckets & background sets & DCP] - 10 items

      WARNING: ThreadSanitizer: data race (pid=21430)
        Write of size 8 at 0x7d08000689b8 by thread T11 (mutexes: write M13041):
          #0 operator delete(void*) <null> (engine_testapp+0x00000046557b)
          #1 <null> <null> (libstdc++.so.6+0x0000000c1ac7)
          #2 ExecutorThread::run() /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/executorthread.cc:130 (ep.so+0x0000000e16f6)
          #3 launch_executor_thread(void*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/executorthread.cc:33 (ep.so+0x0000000e0f15)
          #4 CouchbaseThread::run() /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/platform/src/cb_pthreads.cc:58 (libplatform_so.so.0.1.0+0x000000007ec1)
          #5 platform_thread_wrap(void*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/platform/src/cb_pthreads.cc:71 (libplatform_so.so.0.1.0+0x0000000061c2)
       
        Previous read of size 8 at 0x7d08000689b8 by main thread (mutexes: write M19221, write M19638, write M5012):
          #0 strlen <null> (engine_testapp+0x000000465b6f)
          #1 showJobLog(char const*, char const*, std::vector<TaskLogEntry, std::allocator<TaskLogEntry> > const&, void const*, void (*)(char const*, unsigned short, char const*, unsigned int, void const*)) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/statwriter.h:39 (ep.so+0x0000000dcd8b)
          #2 ExecutorPool::doWorkerStat(EventuallyPersistentEngine*, void const*, void (*)(char const*, unsigned short, char const*, unsigned int, void const*)) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/executorpool.cc:870 (ep.so+0x0000000dc61d)
          #3 EventuallyPersistentEngine::getStats(void const*, char const*, int, void (*)(char const*, unsigned short, char const*, unsigned int, void const*)) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/ep_engine.cc:4389 (ep.so+0x0000000a650e)
          #4 EvpGetStats(engine_interface*, void const*, char const*, int, void (*)(char const*, unsigned short, char const*, unsigned int, void const*)) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/ep_engine.cc:289 (ep.so+0x000000094e7e)
          #5 std::_Function_handler<ENGINE_ERROR_CODE (), std::_Bind<ENGINE_ERROR_CODE (*(engine_interface*, void const*, char const*, int, void (*)(char const*, unsigned short, char const*, unsigned int, void const*)))(engine_interface*, void const*, char const*, int, void (*)(char const*, unsigned short, char const*, unsigned int, void const*))> >::_M_invoke(std::_Any_data const&) /usr/bin/../lib/gcc/x86_64-linux-gnu/4.9/../../../../include/c++/4.9/functional:1263 (engine_testapp+0x0000004f8952)
          #6 std::function<ENGINE_ERROR_CODE ()>::operator()() const /usr/bin/../lib/gcc/x86_64-linux-gnu/4.9/../../../../include/c++/4.9/functional:2439 (engine_testapp+0x0000004d0627)
          #7 perf_stat_latency_core(engine_interface*, engine_interface_v1*, int, StatRuntime) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/tests/ep_perfsuite.cc:1252 (ep_perfsuite.so+0x0000000136d5)
          #8 perf_stat_latency(engine_interface*, engine_interface_v1*, char const*, StatRuntime, BackgroundWork, int) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/tests/ep_perfsuite.cc:1321 (ep_perfsuite.so+0x00000001015e)
          #9 perf_slow_stat_latency_100vb_sets_and_dcp(engine_interface*, engine_interface_v1*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/tests/ep_perfsuite.cc:1401 (ep_perfsuite.so+0x00000000fa36)
          #10 execute_test(test, char const*, char const*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/memcached/programs/engine_testapp/engine_testapp.cc:1023 (engine_testapp+0x0000004cd7ad)
          #11 __libc_start_main /build/buildd/eglibc-2.15/csu/libc-start.c:226 (libc.so.6+0x00000002176c)
       
        Mutex M13041 (0x7d8400003ce8) created at:
          #0 pthread_mutex_lock <null> (engine_testapp+0x0000004872c0)
          #1 std::mutex::lock() /usr/bin/../lib/gcc/x86_64-linux-gnu/4.9/../../../../include/x86_64-linux-gnu/c++/4.9/bits/gthr-default.h:748 (ep.so+0x0000000e1ea7)
          #2 ExecutorThread::run() /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/executorthread.cc:130 (ep.so+0x0000000e16f6)
          #3 launch_executor_thread(void*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/executorthread.cc:33 (ep.so+0x0000000e0f15)
          #4 CouchbaseThread::run() /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/platform/src/cb_pthreads.cc:58 (libplatform_so.so.0.1.0+0x000000007ec1)
          #5 platform_thread_wrap(void*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/platform/src/cb_pthreads.cc:71 (libplatform_so.so.0.1.0+0x0000000061c2)
       
        Mutex M19221 (0x7ffc2f22ffe8) created at:
          #0 pthread_mutex_lock <null> (engine_testapp+0x0000004872c0)
          #1 unique_lock /usr/bin/../lib/gcc/x86_64-linux-gnu/4.9/../../../../include/x86_64-linux-gnu/c++/4.9/bits/gthr-default.h:748 (ep_perfsuite.so+0x00000000fffd)
          #2 perf_slow_stat_latency_100vb_sets_and_dcp(engine_interface*, engine_interface_v1*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/tests/ep_perfsuite.cc:1401 (ep_perfsuite.so+0x00000000fa36)
          #3 execute_test(test, char const*, char const*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/memcached/programs/engine_testapp/engine_testapp.cc:1023 (engine_testapp+0x0000004cd7ad)
          #4 __libc_start_main /build/buildd/eglibc-2.15/csu/libc-start.c:226 (libc.so.6+0x00000002176c)
       
        Mutex M19638 (0x7d280000ef98) created at:
          #0 pthread_mutex_init <null> (engine_testapp+0x0000004698a0)
          #1 cb_mutex_initialize /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/platform/src/cb_pthreads.cc:183 (libplatform_so.so.0.1.0+0x000000006544)
          #2 mock_connstruct /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/memcached/programs/engine_testapp/mock_server.cc:67 (engine_testapp+0x0000004fb1e7)
          #3 perf_stat_latency_core(engine_interface*, engine_interface_v1*, int, StatRuntime) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/tests/ep_perfsuite.cc:1213 (ep_perfsuite.so+0x000000012b43)
          #4 perf_stat_latency(engine_interface*, engine_interface_v1*, char const*, StatRuntime, BackgroundWork, int) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/tests/ep_perfsuite.cc:1321 (ep_perfsuite.so+0x00000001015e)
          #5 perf_slow_stat_latency_100vb_sets_and_dcp(engine_interface*, engine_interface_v1*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/tests/ep_perfsuite.cc:1401 (ep_perfsuite.so+0x00000000fa36)
          #6 execute_test(test, char const*, char const*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/memcached/programs/engine_testapp/engine_testapp.cc:1023 (engine_testapp+0x0000004cd7ad)
          #7 __libc_start_main /build/buildd/eglibc-2.15/csu/libc-start.c:226 (libc.so.6+0x00000002176c)
       
        Mutex M5012 (0x7d4c00008608) created at:
          #0 pthread_mutex_lock <null> (engine_testapp+0x0000004872c0)
          #1 std::mutex::lock() /usr/bin/../lib/gcc/x86_64-linux-gnu/4.9/../../../../include/x86_64-linux-gnu/c++/4.9/bits/gthr-default.h:748 (ep.so+0x0000000d7742)
          #2 ExecutorPool::registerTaskable(Taskable&) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/executorpool.cc:489 (ep.so+0x0000000d7b9e)
          #3 KVBucket::KVBucket(EventuallyPersistentEngine&) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/kv_bucket.cc:369 (ep.so+0x0000000f72f7)
          #4 EphemeralBucket::EphemeralBucket(EventuallyPersistentEngine&) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/ephemeral_bucket.cc:25 (ep.so+0x0000000cedbe)
          #5 _ZSt11make_uniqueI15EphemeralBucketJR26EventuallyPersistentEngineEEN11__unique_ifIT_E15__unique_singleEDpOT0_ /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/platform/include/platform/make_unique.h:43 (ep.so+0x000000098081)
          #6 EventuallyPersistentEngine::initialize(char const*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/ep_engine.cc:2006 (ep.so+0x00000009780e)
          #7 EvpInitialize(engine_interface*, char const*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/ep_engine.cc:146 (ep.so+0x0000000942c7)
          #8 init_engine_instance /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/memcached/utilities/engine_loader.cc:187 (libmcd_util.so.1.0.0+0x00000000639e)
          #9 create_bucket(bool, char const*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/memcached/programs/engine_testapp/engine_testapp.cc:866 (engine_testapp+0x0000004ce664)
          #10 execute_test(test, char const*, char const*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/memcached/programs/engine_testapp/engine_testapp.cc:1016 (engine_testapp+0x0000004cd70d)
          #11 __libc_start_main /build/buildd/eglibc-2.15/csu/libc-start.c:226 (libc.so.6+0x00000002176c)
       
        Thread T11 'mc:nonIO_1' (tid=21443, running) created by main thread at:
          #0 pthread_create <null> (engine_testapp+0x000000468471)
          #1 cb_create_named_thread /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/platform/src/cb_pthreads.cc:109 (libplatform_so.so.0.1.0+0x000000006075)
          #2 ExecutorThread::start() /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/executorthread.cc:46 (ep.so+0x0000000e0897)
          #3 ExecutorPool::_adjustWorkers(task_type_t, unsigned long) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/executorpool.cc:530 (ep.so+0x0000000d8387)
          #4 ExecutorPool::_startWorkers() /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/executorpool.cc:603 (ep.so+0x0000000d8e56)
          #5 ExecutorPool::_registerTaskable(Taskable&) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/executorpool.cc:484 (ep.so+0x0000000d7b10)
          #6 ExecutorPool::registerTaskable(Taskable&) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/executorpool.cc:489 (ep.so+0x0000000d7b9e)
          #7 KVBucket::KVBucket(EventuallyPersistentEngine&) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/kv_bucket.cc:369 (ep.so+0x0000000f72f7)
          #8 EphemeralBucket::EphemeralBucket(EventuallyPersistentEngine&) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/ephemeral_bucket.cc:25 (ep.so+0x0000000cedbe)
          #9 _ZSt11make_uniqueI15EphemeralBucketJR26EventuallyPersistentEngineEEN11__unique_ifIT_E15__unique_singleEDpOT0_ /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/platform/include/platform/make_unique.h:43 (ep.so+0x000000098081)
          #10 EventuallyPersistentEngine::initialize(char const*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/ep_engine.cc:2006 (ep.so+0x00000009780e)
          #11 EvpInitialize(engine_interface*, char const*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/ep-engine/src/ep_engine.cc:146 (ep.so+0x0000000942c7)
          #12 init_engine_instance /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/memcached/utilities/engine_loader.cc:187 (libmcd_util.so.1.0.0+0x00000000639e)
          #13 create_bucket(bool, char const*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/memcached/programs/engine_testapp/engine_testapp.cc:866 (engine_testapp+0x0000004ce664)
          #14 execute_test(test, char const*, char const*) /home/couchbase/jenkins/workspace/ep-engine-threadsanitizer-master/memcached/programs/engine_testapp/engine_testapp.cc:1016 (engine_testapp+0x0000004cd70d)
          #15 __libc_start_main /build/buildd/eglibc-2.15/csu/libc-start.c:226 (libc.so.6+0x00000002176c)
      

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              premkumar.thangamani Premkumar Thangamani (Inactive)
              manu Manu Dhundi (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty