Details
-
Bug
-
Resolution: Fixed
-
Critical
-
7.2.0
-
7.2.0-5067
-
Untriaged
-
Centos 64-bit
-
0
-
No
Description
Script to Repro
guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/win10-bucket-ops-temp_rebalance_magma.ini rerun=False,disk_optimized_thread_settings=True,get-cbcollect-info=True,autoCompactionDefined=true -t bucket_collections.collections_rebalance.CollectionsRebalance.test_data_load_collections_with_rebalance_in_out,nodes_init=5,nodes_in=2,nodes_out=1,bucket_spec=magma_dgm.1_percent_dgm.5_node_3_replica_magma_768_single_bucket,doc_size=768,randomize_value=True,data_load_stage=during,skip_validations=False,data_load_spec=volume_test_load_1_percent_dgm,retry_get_process_num=300,GROUP=rebalance_set2'
|
Steps to Repro
1. Create a 5 node cluster
2023-01-04 09:44:51,405 | test | INFO | MainThread | [table_view:display:72] Cluster statistics
|
+----------------+----------+-----------------+-----------+-----------+----------------------+-------------------+-----------------------+
|
| Node | Services | CPU_utilization | Mem_total | Mem_free | Swap_mem_used | Active / Replica | Version |
|
+----------------+----------+-----------------+-----------+-----------+----------------------+-------------------+-----------------------+
|
| 172.23.107.217 | kv | 0.863809238005 | 23.36 GiB | 22.39 GiB | 0.0 Byte / 3.50 GiB | 0 / 0 | 7.2.0-5067-enterprise |
|
| 172.23.107.222 | kv | 1.00200804578 | 23.36 GiB | 22.28 GiB | 2.00 MiB / 3.50 GiB | 0 / 0 | 7.2.0-5067-enterprise |
|
| 172.23.107.102 | kv | 0.255528293869 | 23.36 GiB | 22.38 GiB | 0.0 Byte / 3.50 GiB | 0 / 0 | 7.2.0-5067-enterprise |
|
| 172.23.107.99 | kv | 0.359635544308 | 23.36 GiB | 22.39 GiB | 58.02 MiB / 3.50 GiB | 0 / 0 | 7.2.0-5067-enterprise |
|
| 172.23.107.223 | kv | 1.4527838408 | 23.36 GiB | 22.41 GiB | 0.0 Byte / 0.0 Byte | 0 / 0 | 7.2.0-5067-enterprise |
|
+----------------+----------+-----------------+-----------+-----------+----------------------+-------------------+-----------------------+
|
2. Create a magma bucket, create scopes/collection/data and push it to 1 percent dgm.
2023-01-04 10:25:35,763 | test | INFO | MainThread | [table_view:display:72] Bucket statistics
|
+---------+-----------+-----------------+----------+------------+-----+-----------+-----------+----------+------------+---------------+
|
| Bucket | Type | Storage Backend | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used | ARR |
|
+---------+-----------+-----------------+----------+------------+-----+-----------+-----------+----------+------------+---------------+
|
| default | couchbase | magma | 3 | none | 0 | 122100000 | 3.75 GiB | 2.77 GiB | 252.41 GiB | 1.05312448812 |
|
+---------+-----------+-----------------+----------+------------+-----+-----------+-----------+----------+------------+---------------+
|
3. Start CRUD on scopes/collections/data.
4. Add one node (172.23.107.121), remove one node (172.23.107.102) and do a swap rebalance.
2023-01-04 10:25:41,545 | test | INFO | pool-14-thread-8 | [table_view:display:72] Rebalance Overview
|
+----------------+----------+-----------------------+---------------+--------------+-----------------------+
|
| Nodes | Services | Version | CPU | Status | Membership / Recovery |
|
+----------------+----------+-----------------------+---------------+--------------+-----------------------+
|
| 172.23.107.121 | kv | 7.2.0-5067-enterprise | 0 | Cluster node | inactiveAdded / none |
|
| 172.23.107.217 | kv | 7.2.0-5067-enterprise | 17.2574831955 | Cluster node | active / none |
|
| 172.23.107.222 | kv | 7.2.0-5067-enterprise | 21.2409988371 | Cluster node | active / none |
|
| 172.23.107.102 | kv | 7.2.0-5067-enterprise | 23.2420889503 | --- OUT ---> | active / none |
|
| 172.23.107.99 | kv | 7.2.0-5067-enterprise | 18.2797195075 | Cluster node | active / none |
|
| 172.23.107.223 | kv | 7.2.0-5067-enterprise | 17.0742597192 | Cluster node | active / none |
|
+----------------+----------+-----------------------+---------------+--------------+-----------------------+
|
5. Rebalance fails as shown below.
172.23.107.222
2023-01-04 10:26:01,730 | test | ERROR | pool-14-thread-8 | [rest_client:print_UI_logs:2730] {u'code': 0, u'module': u'ns_orchestrator', u'type': u'critical', u'node': u'ns_1@172.23.107.222', u'tstamp': 1672856753131L, u'shortText': u'message', u'serverTime': u'2023-01-04T10:25:53.131Z', u'text': u'Rebalance exited with reason {mover_crashed,\n {unexpected_exit,\n {\'EXIT\',<0.28537.22>,\n {{dcp_wait_for_data_move_failed,"default",\n 809,\'ns_1@172.23.107.223\',\n [\'ns_1@172.23.107.99\',\'ns_1@172.23.107.222\',\n \'ns_1@172.23.107.121\'],\n {error,no_stats_for_this_vbucket}},\n [{ns_single_vbucket_mover,\n \'-wait_dcp_data_move/5-fun-0-\',5,\n [{file,"src/ns_single_vbucket_mover.erl"},\n {line,451}]},\n {proc_lib,init_p,3,\n [{file,"proc_lib.erl"},{line,211}]}]}}}}.\nRebalance Operation Id = c5171d43d375e53483a7991c57737156'}
|
Noticed a minidump c848f101-3dcc-48a4-4cea07b4-f9244560.dmp on 172.23.107.222.
grep ERROR memcached*
ns_server.babysitter.log:memcached<0.135.0>: 2023-01-04T10:26:28.924088-08:00 CRITICAL *** Fatal error encountered during exception handling ***
|
ns_server.babysitter.log:memcached<0.135.0>: 2023-01-04T10:26:28.924158-08:00 CRITICAL Caught unhandled std::exception-derived exception. what(): VB::Manifest:updateDataSize: failed find of scope:0xe, this:VB::Manifest: uid:19, scopeWithDataLimitExists:0, dropInProgress:1, defaultMVS:120255, scopes.size:1, map.size:1
|
ns_server.babysitter.log:[ns_server:info,2023-01-04T10:26:29.598-08:00,babysitter_of_ns_1@cb.local:<0.135.0>:ns_port_server:log:226]memcached<0.135.0>: CRITICAL Breakpad caught a crash (Couchbase version 7.2.0-5067). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/c848f101-3dcc-48a4-4cea07b4-f9244560.dmp before terminating.
|
ns_server.babysitter.log: <<"CRITICAL Breakpad caught a c"...>>],
|
ns_server.babysitter.log:[ns_server:info,2023-01-04T10:26:29.852-08:00,babysitter_of_ns_1@cb.local:<0.833.0>:ns_port_server:log:226]memcached<0.833.0>: 2023-01-04T10:26:29.650735-08:00 CRITICAL Detected previous crash
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650789-08:00 CRITICAL Breakpad caught a crash (Couchbase version 7.2.0-5067). Writing crash dump to /opt/couchbase/var/lib/couchbase/crash/c848f101-3dcc-48a4-4cea07b4-f9244560.dmp before terminating.
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650793-08:00 CRITICAL Stack backtrace of crashed thread:
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650795-08:00 CRITICAL #0 /opt/couchbase/bin/memcached() [0x400000+0x712fa8]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650796-08:00 CRITICAL #1 /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler12GenerateDumpEPNS0_12CrashContextE+0x3ea) [0x400000+0x7647ca]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650797-08:00 CRITICAL #2 /opt/couchbase/bin/memcached(_ZN15google_breakpad16ExceptionHandler13SignalHandlerEiP9siginfo_tPv+0xb8) [0x400000+0x764b08]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650799-08:00 CRITICAL #3 /lib64/libpthread.so.0() [0x7fdf1c5e5000+0xf630]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650831-08:00 CRITICAL #4 /lib64/libc.so.6(gsignal+0x37) [0x7fdf19e2f000+0x36387]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650858-08:00 CRITICAL #5 /lib64/libc.so.6(abort+0x148) [0x7fdf19e2f000+0x37a78]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650859-08:00 CRITICAL #6 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fdf1a717000+0x9963c]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650919-08:00 CRITICAL #7 /opt/couchbase/bin/memcached() [0x400000+0x71d4cb]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650921-08:00 CRITICAL #8 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fdf1a717000+0xa48f6]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650922-08:00 CRITICAL #9 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fdf1a717000+0xa4961]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650924-08:00 CRITICAL #10 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fdf1a717000+0xa4bf4]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650925-08:00 CRITICAL #11 /opt/couchbase/bin/memcached() [0x400000+0xa9bfa]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650926-08:00 CRITICAL #12 /opt/couchbase/bin/memcached() [0x400000+0xbac7e]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650927-08:00 CRITICAL #13 /opt/couchbase/bin/memcached() [0x400000+0x3a8afb]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650929-08:00 CRITICAL #14 /opt/couchbase/bin/memcached() [0x400000+0x49b06b]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650930-08:00 CRITICAL #15 /opt/couchbase/bin/memcached() [0x400000+0x47c6ae]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650931-08:00 CRITICAL #16 /opt/couchbase/bin/memcached() [0x400000+0x475276]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650932-08:00 CRITICAL #17 /opt/couchbase/bin/memcached() [0x400000+0x41d915]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650934-08:00 CRITICAL #18 /opt/couchbase/bin/memcached() [0x400000+0x425620]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650935-08:00 CRITICAL #19 /opt/couchbase/bin/memcached() [0x400000+0x42615f]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650936-08:00 CRITICAL #20 /opt/couchbase/bin/memcached() [0x400000+0x2e24c6]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650937-08:00 CRITICAL #21 /opt/couchbase/bin/memcached() [0x400000+0x2e2e80]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650938-08:00 CRITICAL #22 /opt/couchbase/bin/memcached() [0x400000+0x68c299]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650940-08:00 CRITICAL #23 /opt/couchbase/bin/memcached() [0x400000+0x68595a]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650964-08:00 CRITICAL #24 /opt/couchbase/bin/memcached() [0x400000+0x68d64e]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650966-08:00 CRITICAL #25 /opt/couchbase/bin/memcached() [0x400000+0x7ea440]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650967-08:00 CRITICAL #26 /opt/couchbase/bin/memcached() [0x400000+0x7d4eda]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650968-08:00 CRITICAL #27 /opt/couchbase/bin/memcached() [0x400000+0x7ed3f9]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650992-08:00 CRITICAL #28 /opt/couchbase/bin/memcached() [0x400000+0x685654]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650994-08:00 CRITICAL #29 /opt/couchbase/bin/../lib/libstdc++.so.6() [0x7fdf1a717000+0xcdd40]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650996-08:00 CRITICAL #30 /lib64/libpthread.so.0() [0x7fdf1c5e5000+0x7ea5]
|
ns_server.babysitter.log:memcached<0.833.0>: 2023-01-04T10:26:29.650997-08:00 CRITICAL #31 /lib64/libc.so.6(clone+0x6d) [0x7fdf19e2f000+0xfeb0d]
|
bt of c848f101-3dcc-48a4-4cea07b4-f9244560.dmp on 172.23.107.222
(gdb) bt
|
#0 0x00007fdf19e65387 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:55
|
#1 0x00007fdf19e66a78 in __GI_abort () at abort.c:90
|
#2 0x00007fdf1a7b063c in __gnu_cxx::__verbose_terminate_handler () at /tmp/deploy/objdir/../gcc-10.2.0/libstdc++-v3/libsupc++/vterminate.cc:95
|
#3 0x0000000000b1d4cb in backtrace_terminate_handler() () at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/utilities/terminate_handler.cc:88
|
#4 0x00007fdf1a7bb8f6 in __cxxabiv1::__terminate(void (*)()) () at /tmp/deploy/objdir/../gcc-10.2.0/libstdc++-v3/libsupc++/eh_terminate.cc:48
|
#5 0x00007fdf1a7bb961 in std::terminate () at /tmp/deploy/objdir/../gcc-10.2.0/libstdc++-v3/libsupc++/eh_terminate.cc:58
|
#6 0x00007fdf1a7bbbf4 in __cxxabiv1::__cxa_throw (obj=obj@entry=0x7fded0000940, tinfo=0x105aca8 <typeinfo for std::invalid_argument>, dest=0x4429d0 <_ZNSt16invalid_argumentD1Ev@plt>)
|
at /tmp/deploy/objdir/../gcc-10.2.0/libstdc++-v3/libsupc++/eh_throw.cc:95
|
#7 0x00000000004a9bfa in Collections::VB::Manifest::throwException<std::invalid_argument> (this=this@entry=0x7fdefc74d4a0, thrower=..., error=...)
|
at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/collections/vbucket_manifest.h:1093
|
#8 0x00000000004bac7e in Collections::VB::Manifest::updateDataSize (this=0x7fdefc74d4a0, sid=..., delta=<optimized out>) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/collections/vbucket_manifest.cc:1611
|
#9 0x00000000007a8227 in Collections::VB::Manifest::updateScopeDataSize(folly::f14::detail::NodeContainerIterator<std::pair<CollectionID const, Collections::VB::ManifestEntry> const*>, long) const ()
|
at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/collections/vbucket_manifest_entry.h:75
|
#10 0x00000000007a8afb in updateScopeDataSize (delta=<optimized out>, this=0x7fdee3fec7b0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/collections/vbucket_manifest_handles.h:585
|
#11 Collections::VB::Manifest::applyFlusherStats(CollectionID, Collections::VB::FlushAccounting::StatisticsUpdate const&) () at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/collections/vbucket_manifest.cc:304
|
#12 0x000000000089b06b in Collections::VB::Flush::postCommitMakeStatsVisible (this=0x7fdee3fecf00) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/collections/flush.cc:121
|
#13 0x000000000087c6ae in MagmaKVStore::saveDocs(MagmaKVStoreTransactionContext&, VB::Commit&, kvstats_ctx&) () at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/kvstore/magma-kvstore/magma-kvstore.cc:1554
|
#14 0x0000000000875276 in MagmaKVStore::commit(std::unique_ptr<TransactionContext, std::default_delete<TransactionContext> >, VB::Commit&) ()
|
at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/kvstore/magma-kvstore/magma-kvstore.cc:757
|
#15 0x000000000081d915 in EPBucket::commit(KVStoreIface&, std::unique_ptr<TransactionContext, std::default_delete<TransactionContext> >, VB::Commit&) () at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/ep_bucket.cc:952
|
#16 0x0000000000825620 in EPBucket::flushVBucket_UNLOCKED(LockedVBucketPtr) () at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/ep_bucket.cc:825
|
#17 0x000000000082615f in EPBucket::flushVBucket(Vbid) () at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/ep_bucket.cc:379
|
#18 0x00000000006e24c6 in Flusher::flushVB (this=0x7fdf0c288200) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/flusher.cc:293
|
#19 0x00000000006e2e80 in Flusher::step(GlobalTask*) () at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/flusher.cc:203
|
#20 0x0000000000a8c299 in GlobalTask::execute(std::basic_string_view<char, std::char_traits<char> >) () at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/executor/globaltask.cc:98
|
#21 0x0000000000a8595a in FollyExecutorPool::TaskProxy::scheduleViaCPUPool()::{lambda()#2}::operator()() const (__closure=0x7fdee3fed650) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/executor/folly_executorpool.cc:309
|
#22 0x0000000000a8d64e in operator() (this=0x7fdee3fed650) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/executor/cancellable_cpu_executor.cc:42
|
#23 CancellableCPUExecutor::add(GlobalTask*, folly::Function<void ()>)::{lambda()#1}::operator()() const () at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/executor/cancellable_cpu_executor.cc:42
|
#24 0x0000000000bea440 in operator() (this=0x7fdee3fed840) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:416
|
#25 folly::ThreadPoolExecutor::runTask(std::shared_ptr<folly::ThreadPoolExecutor::Thread> const&, folly::ThreadPoolExecutor::Task&&) (this=this@entry=0x7fdf1889a500, thread=...,
|
task=task@entry=<unknown type in /usr/lib/debug/opt/couchbase/bin/memcached-7.2.0-5067.x86_64.debug, CU 0xa689d58, DIE 0xa70dc8d>)
|
at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/ThreadPoolExecutor.cpp:97
|
#26 0x0000000000bd4eda in folly::CPUThreadPoolExecutor::threadRun (this=0x7fdf1889a500, thread=...)
|
at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/executors/CPUThreadPoolExecutor.cpp:265
|
#27 0x0000000000bed3f9 in __invoke_impl<void, void (folly::ThreadPoolExecutor::*&)(std::shared_ptr<folly::ThreadPoolExecutor::Thread>), folly::ThreadPoolExecutor*&, std::shared_ptr<folly::ThreadPoolExecutor::Thread>&> (__t=<optimized out>,
|
__f=<optimized out>) at /usr/local/include/c++/7.3.0/bits/invoke.h:73
|
#28 __invoke<void (folly::ThreadPoolExecutor::*&)(std::shared_ptr<folly::ThreadPoolExecutor::Thread>), folly::ThreadPoolExecutor*&, std::shared_ptr<folly::ThreadPoolExecutor::Thread>&> (__fn=<optimized out>)
|
at /usr/local/include/c++/7.3.0/bits/invoke.h:95
|
#29 __call<void, 0, 1> (__args=<optimized out>, this=<optimized out>) at /usr/local/include/c++/7.3.0/functional:467
|
#30 operator()<> (this=<optimized out>) at /usr/local/include/c++/7.3.0/functional:551
|
#31 folly::detail::function::FunctionTraits<void ()>::callBig<std::_Bind<void (folly::ThreadPoolExecutor::*(folly::ThreadPoolExecutor*, std::shared_ptr<folly::ThreadPoolExecutor::Thread>))(std::shared_ptr<folly::ThreadPoolExecutor::Thread>)> >(folly::detail::function::Data&) (p=...) at /home/couchbase/jenkins/workspace/cbdeps-platform-build-old/deps/packages/build/folly/folly-prefix/src/folly/folly/Function.h:401
|
#32 0x0000000000a85654 in operator() (this=0x7fdf18dd78c0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/executor/folly_executorpool.cc:49
|
#33 operator() (__closure=0x7fdf18dd78c0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/executor/folly_executorpool.cc:49
|
#34 folly::detail::function::FunctionTraits<void ()>::callBig<CBRegisteredThreadFactory::newThread(folly::Function<void ()>&&)::{lambda()#1}>(folly::detail::function::Data&) (p=...)
|
at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/folly.exploded/include/folly/Function.h:401
|
#35 0x00007fdf1a7e4d40 in execute_native_thread_routine () at /tmp/deploy/objdir/../gcc-10.2.0/libstdc++-v3/src/c++11/thread.cc:80
|
#36 0x00007fdf1c5ecea5 in start_thread (arg=0x7fdee3fff700) at pthread_create.c:307
|
#37 0x00007fdf19f2db0d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
|
(gdb)
|
attached cbcollect and other useful info. This is the first time we had a run on 7.2.0. Marking it as not a regression.