Details
-
Bug
-
Resolution: Unresolved
-
Major
-
Morpheus
-
None
-
Untriaged
-
0
-
Unknown
Description
Hit at https://review.couchbase.org/c/kv_engine/+/206190 for the first time.
Issue cause by the usage of "0:#x" (ie, fmt formatting for hex).
The reason of the issue is unclear. At first look the failure suggests that the usage of the extra fmt formatting introduces some mem alloc/free that misses to hit the right/same allocation arena.
Eg https://cv.jenkins.couchbase.com/job/kv_engine.linux-CE/job/master/29093/consoleFull:
18:08:02 5/469 Test #320: ep_testsuite_dcp.value_eviction.comp_passive ..................................................................Subprocess aborted***Exception: 16.37 sec
|
18:08:02 Running [0/91]: test dcp vbtakeover stat no stream...(105 ms) OK
|
18:08:02 Running [1/91]: test open consumer...(74 ms) OK
|
18:08:02 Running [2/91]: test dcp consumer flow control disabled...(80 ms) OK
|
18:08:02 Running [3/91]: test dcp consumer flow control enabled...===ERROR===: JeArenaMalloc deallocation mismatch
|
18:08:02 Memory freed by client:0 domain:Primary which is assigned arena:2, but memory was previously allocated from arena:0 (global arena).
|
18:08:02 Allocation address:0x7f0e7c609380 size:96
|
18:08:02 #0 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x3bbcaa]
|
18:08:02 #1 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0xbcf30]
|
18:08:02 #2 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0xbe71f]
|
18:08:02 #3 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x4481f]
|
18:08:02 #4 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp(_ZdlPv+0x9) [0x400000+0x44ad9]
|
18:08:02 #5 /opt/gcc-13.2.0/lib64/libstdc++.so.6(_ZNSt13runtime_errorD2Ev+0x61) [0x7f0e7d25b000+0xce1d1]
|
18:08:02 #6 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x161843]
|
18:08:02 #7 /opt/gcc-13.2.0/lib64/libstdc++.so.6() [0x7f0e7d25b000+0xb8503]
|
18:08:02 #8 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x1af9e0]
|
18:08:02 #9 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x163aed]
|
18:08:02 #10 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x165d3a]
|
18:08:02 #11 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x15ec6d]
|
18:08:02 #12 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x15eeb9]
|
18:08:02 #13 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x17fe48]
|
18:08:02 #14 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x17fed5]
|
18:08:02 #15 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x17ff59]
|
18:08:02 #16 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x17ffec]
|
18:08:02 #17 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x176f22]
|
18:08:02 #18 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x17ba0e]
|
18:08:02 #19 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x17b0f2]
|
18:08:02 #20 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x104b6d]
|
18:08:02 #21 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x106ec0]
|
18:08:02 #22 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0xdec18]
|
18:08:02 #23 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0xdf181]
|
18:08:02 #24 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0xe3272]
|
18:08:02 #25 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0xe1b58]
|
18:08:02 #26 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0xe1f26]
|
18:08:02 #27 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x5ca23]
|
18:08:02 #28 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x31181]
|
18:08:02 #29 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x33ff2]
|
18:08:02 #30 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x31666]
|
18:08:02 #31 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x32479]
|
18:08:02 #32 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x32fc0]
|
18:08:02 #33 /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f0e7cb8b000+0x22555]
|
18:08:02 #34 /home/couchbase/jenkins/workspace/kv_engine.linux-CE_master/build/kv_engine/ep_testsuite_dcp() [0x400000+0x1a15a]
|
18:08:02
|
Consistently reproducible on local macos too.