Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-41612

[Jepsen] Couchbase crash due to stoll exception when parsing vbstate json

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Major
    • None
    • Cheshire-Cat
    • couchbase-bucket
    • Ubuntu 1804
      Couchbase version 7.0.0-3184

    Description

      During kv-engine-cheshire-cat-jepsen-nightly-266

      gdb /opt/couchbase/bin/memcached -c 00864d79-8275-4f48-82f79d97-8beb5e14.dmp.core
      (gdb) bt full
      #0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
              set = {__val = {0, 139770245535491, 139769644322528, 0, 139770245540016, 139769845534400, 386183668047020927, 3428804008, 3019789208, 281470681751456, 0, 0, 0, 0, 0, 0}}
              pid = <optimized out>
              tid = <optimized out>
              ret = <optimized out>
      #1  0x00007f1ecb9b18b1 in __GI_abort () at abort.c:79
              save_stage = 1
              act = {__sigaction_handler = {sa_handler = 0x3d2ef35793c76730, sa_sigaction = 0x3d2ef35793c76730}, sa_mask = {__val = {0, 0, 0, 4613425733568182272, 0, 139770245535491, 139770241998785, 11, 139770245535360, 10, 139769644322000, 139769845537152, 139769845541360, 139769845536400, 139770241999987, 139770245535360}}, sa_flags = -866336432, 
                sa_restorer = 0x7f1eb2e74818}
              sigs = {__val = {32, 0 <repeats 15 times>}}
              __cnt = <optimized out>
              __set = <optimized out>
              __cnt = <optimized out>
              __set = <optimized out>
      #2  0x00007f1ecc5cf165 in __gnu_cxx::__verbose_terminate_handler () at /tmp/deploy/objdir/../gcc-7.3.0/libstdc++-v3/libsupc++/vterminate.cc:95
              terminating = false
              t = <optimized out>
      #3  0x00000000005a6632 in backtrace_terminate_handler () at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/utilities/terminate_handler.cc:86
      No locals.
      #4  0x00007f1ecc5ccf56 in __cxxabiv1::__terminate (handler=<optimized out>) at /tmp/deploy/objdir/../gcc-7.3.0/libstdc++-v3/libsupc++/eh_terminate.cc:47
      No locals.
      #5  0x00007f1ecc5ccfa1 in std::terminate () at /tmp/deploy/objdir/../gcc-7.3.0/libstdc++-v3/libsupc++/eh_terminate.cc:57
      No locals.
      #6  0x00007f1ecc5cd1e3 in __cxxabiv1::__cxa_throw (obj=obj@entry=0x7f1ea8000f50, tinfo=0x869438 <typeinfo for std::out_of_range>, dest=0x42a4b0 <std::out_of_range::~out_of_range()@plt>) at /tmp/deploy/objdir/../gcc-7.3.0/libstdc++-v3/libsupc++/eh_throw.cc:93
              globals = <optimized out>
              header = 0x7f1ea8000ed0
      #7  0x00007f1ecc5f57d7 in std::__throw_out_of_range (__s=__s@entry=0x7f1ecfe40204 "stoll") at /tmp/deploy/objdir/../gcc-7.3.0/libstdc++-v3/src/c++11/functexcept.cc:82
      No locals.
      #8  0x00007f1ecfcfc597 in __gnu_cxx::__stoa<long long, long long, char, int> (__idx=0x0, __str=0x7f1eb2e75340 <error: Cannot access memory at address 0x7f1eb2e75340>, __name=0x7f1ecfe40204 "stoll", __convf=<optimized out>) at /usr/local/include/c++/7.3.0/ext/string_conversions.h:86
              __ret = <optimized out>
              __endptr = 0x7f1eb2e75354 <error: Cannot access memory at address 0x7f1eb2e75354>
              __save_errno = <optimized out>
              __tmp = <optimized out>
              __ret = <optimized out>
              __endptr = <optimized out>
              __save_errno = <optimized out>
              __tmp = <optimized out>
      #9  std::__cxx11::stoll (__base=10, __idx=0x0, __str=...) at /usr/local/include/c++/7.3.0/bits/basic_string.h:6376
      No locals.
      #10 from_json (j=..., vbs=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/vbucket_state.cc:241
              version = {m_object = 0x7f1eb3fe57c0, m_it = {object_iterator = {_M_node = 0x7f1eb2f60410}, array_iterator = {_M_current = 0x0}, primitive_iterator = {static begin_value = 0, static end_value = 1, m_it = -9223372036854775808}}}
              hcs = {m_object = 0x7f1eb3fe57c0, m_it = {object_iterator = {_M_node = 0x7f1eb2f3fec0}, array_iterator = {_M_current = 0x0}, primitive_iterator = {static begin_value = 0, static end_value = 1, m_it = -9223372036854775808}}}
              pps = {m_object = 0x7f1eb3fe57c0, m_it = {object_iterator = {_M_node = 0x7f1eb2f60230}, array_iterator = {_M_current = 0x0}, primitive_iterator = {static begin_value = 0, static end_value = 1, m_it = -9223372036854775808}}}
              hps = {m_object = 0x7f1eb3fe57c0, m_it = {object_iterator = {_M_node = 0x7f1eb2f60000}, array_iterator = {_M_current = 0x0}, primitive_iterator = {static begin_value = 0, static end_value = 1, m_it = -9223372036854775808}}}
              maxVisibleSeqno = {m_object = 0x7f1eb3fe57c0, m_it = {object_iterator = {_M_node = 0x7f1eb2f600a0}, array_iterator = {_M_current = 0x0}, primitive_iterator = {static begin_value = 0, static end_value = 1, m_it = -9223372036854775808}}}
              hlcEpochSeqno = {m_object = 0x7f1eb3fe57c0, m_it = {object_iterator = {_M_node = 0x7f1eb2f60190}, array_iterator = {_M_current = 0x0}, primitive_iterator = {static begin_value = 0, static end_value = 1, m_it = -9223372036854775808}}}
              mightContainXattrs = {m_object = 0x7f1eb3fe57c0, m_it = {object_iterator = {_M_node = 0x7f1eb2f60370}, array_iterator = {_M_current = 0x0}, primitive_iterator = {static begin_value = 0, static end_value = 1, m_it = -9223372036854775808}}}
              supportsNamespaces = {m_object = 0x7f1eb3fe57c0, m_it = {object_iterator = {_M_node = 0x7f1eb2f600f0}, array_iterator = {_M_current = 0x0}, primitive_iterator = {static begin_value = 0, static end_value = 1, m_it = -9223372036854775808}}}
              checkpointType = {m_object = 0x7f1eb2e75354, m_it = {object_iterator = {_M_node = 0x1}, array_iterator = {_M_current = 0x7f1eb2ef0030}, primitive_iterator = {static begin_value = 0, static end_value = 1, m_it = 32}}}
      #11 0x00007f1ecfd41f74 in nlohmann::detail::from_json_fn::operator()<nlohmann::basic_json<std::map, std::vector, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, bool, long, unsigned long, double, std::allocator, nlohmann::adl_serializer>, vbucket_state> (this=<synthetic pointer>, val=..., j=...)
          at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/json.exploded/include/nlohmann/detail/conversions/from_json.hpp:358
      No locals.
      #12 nlohmann::adl_serializer<vbucket_state, void>::from_json<nlohmann::basic_json<std::map, std::vector, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, bool, long, unsigned long, double, std::allocator, nlohmann::adl_serializer> const&, vbucket_state> (val=..., j=...)
          at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/json.exploded/include/nlohmann/adl_serializer.hpp:28
      No locals.
      #13 nlohmann::basic_json<std::map, std::vector, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, bool, long, unsigned long, double, std::allocator, nlohmann::adl_serializer>::get<vbucket_state, vbucket_state, 0> (this=<optimized out>, this=<optimized out>)
          at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/json.exploded/include/nlohmann/json.hpp:2588
              ret = <optimized out>
              ret = <optimized out>
      #14 nlohmann::basic_json<std::map, std::vector, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, bool, long, unsigned long, double, std::allocator, nlohmann::adl_serializer>::operator vbucket_state<vbucket_state, 0> (this=0x7f1eb3fe57c0)
          at /home/couchbase/jenkins/workspace/couchbase-server-unix/server_build/tlm/deps/json.exploded/include/nlohmann/json.hpp:2868
      No locals.
      #15 CouchKVStore::readVBState (this=this@entry=0x7f1eb2e9c000, db=<optimized out>, vbId=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/couch-kvstore/couch-kvstore.cc:2787
              id = {buf = 0x7f1ecfe53403 "_local/vbstate", size = 14}
              ldoc = 0x7f1eb2f25290
              highSeqno = 116
              purgeSeqno = 0
              snapshot = {start = 0, range = {start = <optimized out>, end = <optimized out>}}
              info = {version = cb::couchstore::Header::Version::V13, timestamp = 1600816446719635619, updateSeqNum = 116, purgeSeqNum = 0, headerPosition = 4268032, filename = 0x7f1eb2f1fa80 <error: Cannot access memory at address 0x7f1eb2f1fa80>, docCount = 1, deletedCount = 1, spaceUsed = 2132222, fileSize = 4268131}
              vbState = {static CurrentVersion = 3, maxDeletedSeqno = {counter = {_M_elems = "\000\000\000\000\000"}}, highSeqno = 0, purgeSeqno = 0, lastSnapStart = 0, lastSnapEnd = 0, maxCas = 0, hlcCasEpochSeqno = -1, mightContainXattrs = false, supportsNamespaces = true, version = 3, persistedCompletedSeqno = 0, persistedPreparedSeqno = 0, 
                highPreparedSeqno = 0, maxVisibleSeqno = 0, onDiskPrepares = 0, checkpointType = CheckpointType::Memory, transition = {failovers = {static npos = 18446744073709551615, _M_dataplus = {<std::allocator<char>> = {<__gnu_cxx::new_allocator<char>> = {<No data fields>}, <No data fields>}, _M_p = 0x7f1eb3fe5950 ""}, _M_string_length = 0, {
                      _M_local_buf = "\000\000\000\000\000\000\000\000\256k\215\315\036\177\000", _M_allocated_capacity = 0}}, replicationTopology = {m_type = nlohmann::detail::value_t::null, m_value = {object = 0x0, array = 0x0, string = 0x0, boolean = false, number_integer = 0, number_unsigned = 0, number_float = 0}}, state = vbucket_state_dead}}
              couchStoreStatus = <optimized out>
              statjson = {static npos = 18446744073709551615, _M_dataplus = {<std::allocator<char>> = {<__gnu_cxx::new_allocator<char>> = {<No data fields>}, <No data fields>}, _M_p = 0x7f1eb2e12600 <error: Cannot access memory at address 0x7f1eb2e12600>}, _M_string_length = 507, {_M_local_buf = "\373\001\000\000\000\000\000\000Z\000\000\000\000\000\000", 
                  _M_allocated_capacity = 507}}
              json = {m_type = nlohmann::detail::value_t::object, m_value = {object = 0x7f1eb2efb600, array = 0x7f1eb2efb600, string = 0x7f1eb2efb600, boolean = false, number_integer = 139769827800576, number_unsigned = 139769827800576, number_float = 6.9055470241411397e-310}}
              status = <optimized out>
      #16 0x00007f1ecfd4a5b2 in CouchKVStore::readVBStateAndUpdateCache (vbid=..., db=<optimized out>, this=<optimized out>, this=<optimized out>) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/couch-kvstore/couch-kvstore.cc:2831
              res = <optimized out>
              res = <optimized out>
      #17 CouchKVStore::initialize (this=this@entry=0x7f1eb2e9c000, map=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/couch-kvstore/couch-kvstore.cc:400
              readStatus = <optimized out>
              db = {
                kvstore = {<std::_Reference_wrapper_base<CouchKVStore>> = {<std::_Weak_result_type<CouchKVStore>> = {<std::_Weak_result_type_impl<CouchKVStore>> = {<std::_Maybe_get_result_type<CouchKVStore, void>> = {<No data fields>}, <No data fields>}, <No data fields>}, <std::_Refwrap_base_arg1<CouchKVStore, void>> = {<No data fields>}, <std::_Refwrap_base_arg2<CouchKVStore, void>> = {<No data fields>}, <No data fields>}, _M_data = 0x7f1eb2e9c000}, db = 0x7f1eb2e900a0, fileRev = 10}
              abort = false
              __for_range = @0x7f1eb3fe5c30: {
                _M_h = {<std::__detail::_Hashtable_base<Vbid, std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, std::__detail::_Select1st, std::equal_to<Vbid>, std::hash<Vbid>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Hashtable_traits<true, false, true> >> = {<std::__detail::_Hash_code_base<Vbid, std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, std::__detail::_Select1st, std::hash<Vbid>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, true>> = {<std::__detail::_Hashtable_ebo_helper<0, std::__detail::_Select1st, true>> = {<std::__detail::_Select1st> = {<No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<1, std::hash<Vbid>, true>> = {<std::hash<Vbid>> = {<No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<2, std::__detail::_Mod_range_hashing, true>> = {<std::__detail::_Mod_range_hashing> = {<No data fields>}, <No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<0, std::equal_to<Vbid>, true>> = {<std::equal_to<Vbid>> = {<std::binary_function<Vbid, Vbid, bool>> = {<No data fields>}, <No data fields>}, <No data fields>}, <No data fields>}, <std::__detail::_Map_base<Vbid, std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, std::allocator<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > > >, std::__detail::_Select1st, std::equal_to<Vbid>, std::hash<Vbid>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, true>> = {<No data fields>}, <std::__detail::_Insert<Vbid, std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, std::allocator<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > > >, std::__detail::_Select1st, std::equal_to<Vbid>, std::hash<Vbid>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, false>> = {<std::__detail::_Insert_base<Vbid, std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, std::allocator<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > > >, std::__detail::_Select1st, std::equal_to<Vbid>, std::hash<Vbid>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true> >> = {<No data fields>}, <No data fields>}, <std::__detail::_Rehash_base<Vbid, std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, std::allocator<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > > >, std::__detail::_Select1st, std::equal_to<Vbid>, std::hash<Vbid>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, std::integral_constant<bool, true> >> = {<No data fields>}, <std::__detail::_Equality<Vbid, std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, std::allocator<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > > >, std::__detail::_Select1st, std::equal_to<Vbid>, std::hash<Vbid>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Ha---Type <return> to continue, or q <return> to quit---
      shtable_traits<true, false, true>, true>> = {<No data fields>}, <std::__detail::_Hashtable_alloc<std::allocator<std::__detail::_Hash_node<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, true> > >> = {<std::__detail::_Hashtable_ebo_helper<0, std::allocator<std::__detail::_Hash_node<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, true> >, true>> = {<std::allocator<std::__detail::_Hash_node<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, true> >> = {<__gnu_cxx::new_allocator<std::__detail::_Hash_node<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, true> >> = {<No data fields>}, <No data fields>}, <No data fields>}, <No data fields>}, _M_buckets = 0x7f1eb2f41000, 
                  _M_bucket_count = 1493, _M_before_begin = {_M_nxt = 0x7f1eb2f3fe20}, _M_element_count = 818, _M_rehash_policy = {static _S_growth_factor = 2, _M_max_load_factor = 1, _M_next_resize = 1493}, _M_single_bucket = 0x0}}
              __for_begin = <optimized out>
              __for_end = <optimized out>
              vbid = <optimized out>
              revisions = <optimized out>
              errorCode = COUCHSTORE_SUCCESS
      #18 0x00007f1ecfd4aaf2 in CouchKVStore::CouchKVStore (this=0x7f1eb2e9c000, config=..., ops=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/couch-kvstore/couch-kvstore.cc:362
              map = {
                _M_h = {<std::__detail::_Hashtable_base<Vbid, std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, std::__detail::_Select1st, std::equal_to<Vbid>, std::hash<Vbid>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Hashtable_traits<true, false, true> >> = {<std::__detail::_Hash_code_base<Vbid, std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, std::__detail::_Select1st, std::hash<Vbid>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, true>> = {<std::__detail::_Hashtable_ebo_helper<0, std::__detail::_Select1st, true>> = {<std::__detail::_Select1st> = {<No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<1, std::hash<Vbid>, true>> = {<std::hash<Vbid>> = {<No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<2, std::__detail::_Mod_range_hashing, true>> = {<std::__detail::_Mod_range_hashing> = {<No data fields>}, <No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<0, std::equal_to<Vbid>, true>> = {<std::equal_to<Vbid>> = {<std::binary_function<Vbid, Vbid, bool>> = {<No data fields>}, <No data fields>}, <No data fields>}, <No data fields>}, <std::__detail::_Map_base<Vbid, std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, std::allocator<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > > >, std::__detail::_Select1st, std::equal_to<Vbid>, std::hash<Vbid>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, true>> = {<No data fields>}, <std::__detail::_Insert<Vbid, std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, std::allocator<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > > >, std::__detail::_Select1st, std::equal_to<Vbid>, std::hash<Vbid>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, false>> = {<std::__detail::_Insert_base<Vbid, std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, std::allocator<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > > >, std::__detail::_Select1st, std::equal_to<Vbid>, std::hash<Vbid>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true> >> = {<No data fields>}, <No data fields>}, <std::__detail::_Rehash_base<Vbid, std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, std::allocator<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > > >, std::__detail::_Select1st, std::equal_to<Vbid>, std::hash<Vbid>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, std::integral_constant<bool, true> >> = {<No data fields>}, <std::__detail::_Equality<Vbid, std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, std::allocator<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > > >, std::__detail::_Select1st, std::equal_to<Vbid>, std::hash<Vbid>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, true>> = {<No data fields>}, <std::__detail::_Hashtable_alloc<std::allocator<std::__detail::_Hash_node<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, true> > >> = {<std::__detail::_Hashtable_ebo_helper<0, std::allocator<std::__detail::_Hash_node<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, true> >, true>> = {<std::allocator<std::__detail::_Hash_node<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, true> >> = {<__gnu_cxx::new_allocator<std::__detail::_Hash_node<std::pair<Vbid const, std::unordered_set<unsigned long, std::hash<unsigned long>, std::equal_to<unsigned long>, std::allocator<unsigned long> > >, true> >> = {<No data fields>}, <No data fields>}, <No data fields>}, <No data fields>}, _M_buckets = 0x7f1eb2f41000, 
                  _M_bucket_count = 1493, _M_before_begin = {_M_nxt = 0x7f1eb2f3fe20}, _M_element_count = 818, _M_rehash_policy = {static _S_growth_factor = 2, _M_max_load_factor = 1, _M_next_resize = 1493}, _M_single_bucket = 0x0}}
              map = <optimized out>
              id = <optimized out>
              __for_range = <optimized out>
              __for_begin = <optimized out>
              __for_end = <optimized out>
      #19 0x00007f1ecfd4ac35 in CouchKVStore::CouchKVStore (ops=..., config=..., this=0x7f1eb2e9c000) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/couch-kvstore/couch-kvstore.cc:375
      No locals.
      #20 CouchKVStore::CouchKVStore (this=0x7f1eb2e9c000, config=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/couch-kvstore/couch-kvstore.cc:303
      No locals.
      #21 0x00007f1ecfc9bd35 in std::make_unique<CouchKVStore, CouchKVStoreConfig&> () at /usr/local/include/c++/7.3.0/bits/unique_ptr.h:825
      No locals.
      #22 KVStoreFactory::create (config=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/kvstore.cc:192
              rw = <optimized out>
              ro = {_M_t = {
                  _M_t = {<std::_Tuple_impl<0, CouchKVStore*, std::default_delete<CouchKVStore> >> = {<std::_Tuple_impl<1, std::default_delete<CouchKVStore> >> = {<std::_Head_base<1, std::default_delete<CouchKVStore>, true>> = {<std::default_delete<CouchKVStore>> = {<No data fields>}, <No data fields>}, <No data fields>}, <std::_Head_base<0, CouchKVStore*, false>> = {_M_head_impl = 0x1e}, <No data fields>}, <No data fields>}}}
              backend = {static npos = 18446744073709551615, _M_dataplus = {<std::allocator<char>> = {<__gnu_cxx::new_allocator<char>> = {<No data fields>}, <No data fields>}, _M_p = 0x7f1eb3fe5ce0 "couchdb"}, _M_string_length = 7, {_M_local_buf = "couchdb\000\036\000\000\000\000\000\000", _M_allocated_capacity = 27694947225661283}}
      #23 0x00007f1ecfcb782a in KVShard::KVShard (this=0x7f1eb2e47e80, engine=..., id=<optimized out>) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/kvshard.cc:49
              stores = {rw = {_M_t = {_M_t = {<std::_Tuple_impl<0, KVStore*, std::default_delete<KVStore> >> = {<std::_Tuple_impl<1, std::default_delete<KVStore> >> = {<std::_Head_base<1, std::default_delete<KVStore>, true>> = {<std::default_delete<KVStore>> = {<No data fields>}, <No data fields>}, <No data fields>}, <std::_Head_base<0, KVStore*, false>> = {
                          _M_head_impl = 0x48}, <No data fields>}, <No data fields>}}}, ro = {_M_t = {
                    _M_t = {<std::_Tuple_impl<0, KVStore*, std::default_delete<KVStore> >> = {<std::_Tuple_impl<1, std::default_delete<KVStore> >> = {<std::_Head_base<1, std::default_delete<KVStore>, true>> = {<std::default_delete<KVStore>> = {<No data fields>}, <No data fields>}, <No data fields>}, <std::_Head_base<0, KVStore*, false>> = {
                          _M_head_impl = 0x7f1eb2dfe000}, <No data fields>}, <No data fields>}}}}
              numShards = <optimized out>
              config = <optimized out>
              backend = {static npos = 18446744073709551615, _M_dataplus = {<std::allocator<char>> = {<__gnu_cxx::new_allocator<char>> = {<No data fields>}, <No data fields>}, _M_p = 0x7f1eb3fe5d60 "couchdb"}, _M_string_length = 7, {_M_local_buf = "couchdb\000P\000\000\000\000\000\000", _M_allocated_capacity = 27694947225661283}}
              numShards = <optimized out>
              config = <optimized out>
              backend = <optimized out>
              stores = <optimized out>
              stores = <optimized out>
      #24 0x00007f1ecfd0083f in std::make_unique<KVShard, EventuallyPersistentEngine&, unsigned long&> () at /usr/local/include/c++/7.3.0/bits/unique_ptr.h:825
      No locals.
      #25 VBucketMap::VBucketMap (this=0x7f1eb2e81018, config=..., store=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/vbucketmap.cc:30
              shardId = 0
              engine = <error reading variable>
              numShards = <optimized out>
              engine = <optimized out>
              numShards = <optimized out>
              shardId = <optimized out>
      #26 0x00007f1ecfca818e in KVBucket::KVBucket (this=0x7f1eb2e81000, theEngine=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/kv_bucket.cc:302
              config = <optimized out>
              numShards = <optimized out>
              size = <optimized out>
              backfill_threshold = <optimized out>
              i = <optimized out>
              i = <optimized out>
              core = <optimized out>
              __for_range = <optimized out>
              __for_begin = <optimized out>
              __for_end = <optimized out>
      #27 0x00007f1ecfc25c36 in EPBucket::EPBucket (this=0x7f1eb2e81000, theEngine=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/ep_bucket.cc:256
              config = <optimized out>
              policy = <optimized out>
      #28 0x00007f1ecfc3fcd9 in std::make_unique<EPBucket, EventuallyPersistentEngine&> () at /usr/local/include/c++/7.3.0/bits/unique_ptr.h:825
      No locals.
      #29 EventuallyPersistentEngine::makeBucket (this=this@entry=0x7f1eb2dfe000, config=...) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/ep_engine.cc:6536
              bucketType = {static npos = 18446744073709551615, _M_dataplus = {<std::allocator<char>> = {<__gnu_cxx::new_allocator<char>> = {<No data fields>}, <No data fields>}, _M_p = 0x7f1eb3fe6040 "persistent"}, _M_string_length = 10, {_M_local_buf = "persistent\000\000\000\000\000", _M_allocated_capacity = 7310594991874794864}}
      #30 0x00007f1ecfc5504d in EventuallyPersistentEngine::initialize (this=0x7f1eb2dfe000, config=<optimized out>) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/ep_engine.cc:2247
              switchToEngine = {_M_t = {_M_t = {<std::_Tuple_impl<0, EventuallyPersistentEngine*, EPHandleReleaser>> = {<std::_Tuple_impl<1, EPHandleReleaser>> = {<std::_Head_base<1, EPHandleReleaser, true>> = {<EPHandleReleaser> = {<No data fields>}, <No data fields>}, <No data fields>}, <std::_Head_base<0, EventuallyPersistentEngine*, false>> = {
                        _M_head_impl = 0x7f1eb2dfe000}, <No data fields>}, <No data fields>}}}
              env = <optimized out>
              threads = {num_readers = ThreadPoolConfig::ThreadCount::Default, num_writers = ThreadPoolConfig::ThreadCount::Default, num_storage_threads = ThreadPoolConfig::StorageThreadCount::Default}
              pool = <optimized out>
              numShards = <optimized out>
              flowCtlPolicy = {static npos = 18446744073709551615, _M_dataplus = {<std::allocator<char>> = {<__gnu_cxx::new_allocator<char>> = {<No data fields>}, <No data fields>}, _M_p = 0x7f1eb3fe60f0 "none"}, _M_string_length = 4, {_M_local_buf = "none\000\177\000\000\006\000\000\000\006\000\000", _M_allocated_capacity = 139639678463854}}
      #31 0x00000000004462a2 in CreateBucketThread::create (this=this@entry=0x7f1ecb3da3d0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/memcached.cc:857
              ii = <optimized out>
              first_free = <optimized out>
              found = <optimized out>
              all_bucket_lock = {_M_device = 0x8dd160 <buckets_lock>, _M_owns = false}
              bucket = <optimized out>
              engine = <error reading variable>
      ---Type <return> to continue, or q <return> to quit---
      #32 0x0000000000446859 in CreateBucketThread::run (this=0x7f1ecb3da3d0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/daemon/memcached.cc:912
              guard = <optimized out>
      #33 0x00007f1ece5dd1df in Couchbase::Thread::thread_entry (this=0x7f1ecb3da3d0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/thread.cc:45
      No locals.
      #34 0x00007f1ece5d2547 in CouchbaseThread::run (this=0x7f1ec80b7ed0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:58
      No locals.
      #35 platform_thread_wrap (arg=0x7f1ec80b7ed0) at /home/couchbase/jenkins/workspace/couchbase-server-unix/platform/src/cb_pthreads.cc:71
              context = {_M_t = {
                  _M_t = {<std::_Tuple_impl<0, CouchbaseThread*, std::default_delete<CouchbaseThread> >> = {<std::_Tuple_impl<1, std::default_delete<CouchbaseThread> >> = {<std::_Head_base<1, std::default_delete<CouchbaseThread>, true>> = {<std::default_delete<CouchbaseThread>> = {<No data fields>}, <No data fields>}, <No data fields>}, <std::_Head_base<0, CouchbaseThread*, false>> = {_M_head_impl = 0x7f1ec80b7ed0}, <No data fields>}, <No data fields>}}}
      #36 0x00007f1ecbd696db in start_thread (arg=0x7f1eb3fff700) at pthread_create.c:463
              pd = 0x7f1eb3fff700
              now = <optimized out>
              unwind_buf = {cancel_jmp_buf = {{jmp_buf = {139769845643008, -1325177339777764136, 139769845539648, 0, 139770181942992, 139770139622384, 1414519268571493592, 1414571832130024664}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}}
              not_first_call = <optimized out>
      #37 0x00007f1ecba92a3f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
      

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              richard.demellow Richard deMellow
              richard.demellow Richard deMellow
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty