Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-49802

[NexusKVStore] Manifests not equal

    XMLWordPrintable

Details

    • Bug
    • Resolution: Cannot Reproduce
    • Critical
    • None
    • 7.1.0
    • couchbase-bucket
    • 7.1.0-1786

    Description

      Steps to repro:

      1. Create a 2 node cluster(172.23.121.139, 172.23.121.140(bucket_ram_quota = 2056 MB/node), replicas=0)
      2. Create 10 non default collections in default scope(collection count is 11(including default collection)
      3. Start Load 5M docs in each of 10 non default collections(total docs = 50M)
      4. After loading of 10M docs (collective count in all collections), change replica to 1
      5. Triggered Rebalance
      6. Trigger full compaction
      7. Rebalance was successfull
      8. Again reduce replica to 0 and rebalance
      9. Create two more collections and drop them
      10. Everything was fine until this point
      11. Again change replica to 1 and rebalance
      12. Observed Memcached crashed with NexusKVStore::doCollectionsMetadataChecks(Vbid, Collections::VB::Manifest const*, Collections::VB::Manifest const*)

      Below Core found on node : 172.23.121.140
      BackTrace:

      (gdb) bt full
      #0  0x00007fa37a076387 in raise () from /lib64/libc.so.6
      No symbol table info available.
      #1  0x00007fa37a077a78 in abort () from /lib64/libc.so.6
      No symbol table info available.
      #2  0x0000000000497396 in cb::handleError (logger=..., logLevel=<optimized out>, msg=..., method=cb::Abort)
          at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/error_handler.cc:41
      No locals.
      #3  0x00000000008ea2bb in NexusKVStore::doCollectionsMetadataChecks(Vbid, Collections::VB::Manifest const*, Collections::VB::Manifest const*) ()
          at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/kvstore/nexus-kvstore/nexus-kvstore.cc:187
              msg = {static npos = 18446744073709551615,
                _M_dataplus = {<std::allocator<char>> = {<__gnu_cxx::new_allocator<char>> = {<No data fields>}, <No data fields>},
                  _M_p = 0x7fa2e5f3e400 <Address 0x7fa2e5f3e400 out of bounds>}, _M_string_length = 1492, {
                  _M_local_buf = "\324\005\000\000\000\000\000\000(>\324{\243\177\000", _M_allocated_capacity = 1492}}
              primaryManifestResult = <unknown type in /usr/lib/debug/opt/couchbase/bin/memcached-7.1.0-1786.x86_64.debug, CU 0x66f0334, DIE 0x68baca2>
              primaryKVStoreManifest = <unknown type in /usr/lib/debug/opt/couchbase/bin/memcached-7.1.0-1786.x86_64.debug, CU 0x66f0334, DIE 0x68bacb4>
              secondaryManifestResult = <unknown type in /usr/lib/debug/opt/couchbase/bin/memcached-7.1.0-1786.x86_64.debug, CU 0x66f0334, DIE 0x68bacd0>
              secondaryKVStoreManifest = <unknown type in /usr/lib/debug/opt/couchbase/bin/memcached-7.1.0-1786.x86_64.debug, CU 0x66f0334, DIE 0x68bace1>
      #4  0x00000000008efa31 in NexusKVStore::commit(std::unique_ptr<TransactionContext, std::default_delete<TransactionContext> >, VB::Commit&) ()
          at /home/couchbase/jenkins/workspace/couchbase-server-unix/kv_engine/engines/ep/src/kvstore/nexus-kvstore/nexus-kvstore.cc:375
              nexusTxnCtx = <optimized out>
              vbid = {vbid = 505}
              lh = {_M_device = 0x7fa36c2981d8, _M_owns = true}
              secondaryVBManifest = {
                map = {<folly::f14::detail::F14BasicMap<folly::f14::detail::NodeContainerPolicy<CollectionID, Collections::VB::ManifestEntry, void, void, void> >> = {
                    table_ = {<folly::f14::detail::NodeContainerPolicy<CollectionID, Collections::VB::ManifestEntry, void, void, void>> = {<folly::f14::detail::BasePolicy<CollectionID, Collections::VB::ManifestEntry, void, void, void, std::pair<CollectionID const, Collections::VB::ManifestEntry>*>> = {<folly::f14::detail::ObjectHolder<(char)'H', folly::HeterogeneousAccessHash<CollectionID, void>, true>> = {<folly::HeterogeneousAccessHash<CollectionID, void>> = {<std::hash<CollectionID>> = {<No data fields>}, <No data fields>}, <No data fields>}, <folly::f14::detail::ObjectHolder<(char)'E', folly::HeterogeneousAccessEqualTo<CollectionID, void>, true>> = {<folly::HeterogeneousAccessEqualTo<CollectionID, void>> = {<std::equal_to<CollectionID>> = {<std::binary_function<CollectionID, CollectionID, bool>> = {<No data fields>}, <No data fields>}, <No data fields>}, <No data fields>}, <folly::f14::detail::ObjectHolder<(char)'A', std::allocator<std::pair<CollectionID const, Collections::VB::ManifestEntry> >, true>> = {<std::allocator<std::pair<CollectionID const, Collections::VB::ManifestEntry> >> = {<__gnu_cxx::new_allocator<std::pair<CollectionID const, Collections::VB::ManifestEntry> >> = {<No data fields>}, <No data fields>}, <No data fields>},
                          static kAllocIsAlwaysEqual = <error reading variable: No global symbol "folly::f14::detail::BasePolicy<CollectionID, Collections::VB::ManifestEntry, void, void, void, std::pair<CollectionID const, Collections::VB::ManifestEntry>*>::kAllocIsAlwaysEqual".>,
                          static kDefaultConstructIsNoexcept = <error reading variable: No global symbol "folly::f14::detail::BasePolicy<CollectionID, Collections::VB::ManifestEntry, void, void, void, std::pair<CollectionID const, Collections::VB::ManifestEntry>*>::kDefaultConstructIsNoexcept".>,
                          static kSwapIsNoexcept = <error reading variable: No global symbol "folly::f14::detail::BasePolicy<CollectionID, Collections::VB::M---Type <return> to continue, or q <return> to quit---
      anifestEntry, void, void, void, std::pair<CollectionID const, Collections::VB::ManifestEntry>*>::kSwapIsNoexcept".>,
                          static kEnableItemIteration = true, static kIsMap = true,
                          static kContinuousCapacity = <error reading variable: No global symbol "folly::f14::detail::BasePolicy<CollectionID, Collections::VB::ManifestEntry, void, void, void, std::pair<CollectionID const, Collections::VB::ManifestEntry>*>::kContinuousCapacity".>}, <No data fields>},
                      chunks_ = 0x7fa276fb0900, chunkMask_ = 0, sizeAndPackedBegin_ = {size_ = 11, packedBegin_ = {static kIndexBits = <optimized out>,
                          static kIndexMask = <optimized out>, static kAlignBits = <optimized out>, static kAlignMask = <optimized out>,
                          static kModulus = <optimized out>, static kSizeInverse = <optimized out>, raw_ = 140335757592933}}}}, <No data fields>},
                scopes = {
                  _M_h = {<std::__detail::_Hashtable_base<ScopeID, std::pair<ScopeID const, Collections::VB::ScopeEntry>, std::__detail::_Select1st, std::equal_to<ScopeID>, std::hash<ScopeID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Hashtable_traits<true, false, true> >> = {<std::__detail::_Hash_code_base<ScopeID, std::pair<ScopeID const, Collections::VB::ScopeEntry>, std::__detail::_Select1st, std::hash<ScopeID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, true>> = {<std::__detail::_Hashtable_ebo_helper<0, std::__detail::_Select1st, true>> = {<std::__detail::_Select1st> = {<No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<1, std::hash<ScopeID>, true>> = {<std::hash<ScopeID>> = {<No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<2, std::__detail::_Mod_range_hashing, true>> = {<std::__detail::_Mod_range_hashing> = {<No data fields>}, <No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<0, std::equal_to<ScopeID>, true>> = {<std::equal_to<ScopeID>> = {<std::binary_function<ScopeID, ScopeID, bool>> = {<No data fields>}, <No data fields>}, <No data fields>}, <No data fields>}, <std::__detail::_Map_base<ScopeID, std::pair<ScopeID const, Collections::VB::ScopeEntry>, std::allocator<std::pair<ScopeID const, Collections::VB::ScopeEntry> >, std::__detail::_Select1st, std::equal_to<ScopeID>, std::hash<ScopeID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, true>> = {<No data fields>}, <std::__detail::_Insert<ScopeID, std::pair<ScopeID const, Collections::VB::ScopeEntry>, std::allocator<std::pair<ScopeID const, Collections::VB::ScopeEntry> >, std::__detail::_Select1st, std::equal_to<ScopeID>, std::hash<ScopeID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, false>> = {<std::__detail::_Insert_base<ScopeID, std::pair<ScopeID const, Collections::VB::ScopeEntry>, std::allocator<std::pair<ScopeID const, Collections::VB::ScopeEntry> >, std::__detail::_Select1st, std::equal_to<ScopeID>, std::hash<ScopeID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true> >> = {<No data fields>}, <No data fields>}, <std::__detail::_Rehash_base<ScopeID, std::pair<ScopeID const, Collections::VB::ScopeEntry>, std::allocator<std::pair<ScopeID const, Collections::VB::ScopeEntry> >, std::__detail::_Select1st, std::equal_to<ScopeID>, std::hash<ScopeID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, std::integral_constant<bool, true> >> = {<No data fields>}, <std::__detail::_Equality<ScopeID, std::pair<ScopeID const, Collections::VB::ScopeEntry>, std::allocator<std::pair<ScopeID const, Collections::VB::ScopeEntry> >, std::__detail::_Select1st, std::equal_to<ScopeID>, std::hash<ScopeID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, true>> = {<No data fields>}, <std::__detail::_Hashtable_alloc<std::allocator<std::__detail::_Hash_node<std::pair<ScopeID const, Collections::VB::ScopeEntry>, true> > >> = {<std::__detail::_Hashtable_ebo_helper<0, std::allocator<std::__detail::_Hash_node<std::pair<ScopeID const, Collections::VB::ScopeEntry>, true> >, true>> = {<std::allocator<std::__detail::_Hash_node<std::pair<ScopeID const, Collections::VB::ScopeEntry>, true> >> = {<__gnu_cxx::new_allocator<std::__detail::_Hash_node<std::pair<ScopeID const, Collections::VB::ScopeEntry>, true> >> = {<No data fields>}, <No data fields>}, <No data fields>}, <No data fields>}, _M_buckets = 0x7fa2a5580b50, _M_bucket_count = 13, _M_before_begin = {
                      _M_nxt = 0x7fa2d752e570}, _M_element_count = 1, _M_rehash_policy = {static _S_growth_factor = 2, _M_max_load_factor = 1,
                      _M_next_resize = 13}, _M_single_bucket = 0x0}},
                droppedCollections = {<folly::SynchronizedBase<folly::Synchronized<Collections::VB::Manifest::DroppedCollections, folly::SharedMutexImpl<false, void, std::atomic, false, false> >, (folly::detail::MutexLevel)2>> = {<folly::SynchronizedBase<folly::Synchronized<Collections::VB::Manifest::Droppe---Type <return> to continue, or q <return> to quit---
      dCollections, folly::SharedMutexImpl<false, void, std::atomic, false, false> >, (folly::detail::MutexLevel)1>> = {<No data fields>}, <No data fields>}, static nxCopyCtor = <optimized out>, static nxMoveCtor = <optimized out>, datum_ = {droppedCollections = {
                      _M_h = {<std::__detail::_Hashtable_base<CollectionID, std::pair<CollectionID const, std::vector<Collections::VB::Manifest::DroppedCollectionInfo, std::allocator<Collections::VB::Manifest::DroppedCollectionInfo> > >, std::__detail::_Select1st, std::equal_to<CollectionID>, std::hash<CollectionID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Hashtable_traits<true, false, true> >> = {<std::__detail::_Hash_code_base<CollectionID, std::pair<CollectionID const, std::vector<Collections::VB::Manifest::DroppedCollectionInfo, std::allocator<Collections::VB::Manifest::DroppedCollectionInfo> > >, std::__detail::_Select1st, std::hash<CollectionID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, true>> = {<std::__detail::_Hashtable_ebo_helper<0, std::__detail::_Select1st, true>> = {<std::__detail::_Select1st> = {<No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<1, std::hash<CollectionID>, true>> = {<std::hash<CollectionID>> = {<No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<2, std::__detail::_Mod_range_hashing, true>> = {<std::__detail::_Mod_range_hashing> = {<No data fields>}, <No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<0, std::equal_to<CollectionID>, true>> = {<std::equal_to<CollectionID>> = {<std::binary_function<CollectionID, CollectionID, bool>> = {<No data fields>}, <No data fields>}, <No data fields>}, <No data fields>}, <std::__detail::_Map_base<CollectionID, std::pair<CollectionID const, std::vector<Collections::VB::Manifest::DroppedCollectionInfo, std::allocator<Collections::VB::Manifest::DroppedCollectionInfo> > >, std::allocator<std::pair<CollectionID const, std::vector<Collections::VB::Manifest::DroppedCollectionInfo, std::allocator<Collections::VB::Manifest::DroppedCollectionInfo> > > >, std::__detail::_Select1st, std::equal_to<CollectionID>, std::hash<CollectionID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, true>> = {<No data fields>}, <std::__detail::_Insert<CollectionID, std::pair<CollectionID const, std::vector<Collections::VB::Manifest::DroppedCollectionInfo, std::allocator<Collections::VB::Manifest::DroppedCollectionInfo> > >, std::allocator<std::pair<CollectionID const, std::vector<Collections::VB::Manifest::DroppedCollectionInfo, std::allocator<Collections::VB::Manifest::DroppedCollectionInfo> > > >, std::__detail::_Select1st, std::equal_to<CollectionID>, std::hash<CollectionID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, false>> = {<std::__detail::_Insert_base<CollectionID, std::pair<CollectionID const, std::vector<Collections::VB::Manifest::DroppedCollectionInfo, std::allocator<Collections::VB::Manifest::DroppedCollectionInfo> > >, std::allocator<std::pair<CollectionID const, std::vector<Collections::VB::Manifest::DroppedCollectionInfo, std::allocator<Collections::VB::Manifest::DroppedCollectionInfo> > > >, std::__detail::_Select1st, std::equal_to<CollectionID>, std::hash<CollectionID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true> >> = {<No data fields>}, <No data fields>}, <std::__detail::_Rehash_base<CollectionID, std::pair<CollectionID const, std::vector<Collections::VB::Manifest::DroppedCollectionInfo, std::allocator<Collections::VB::Manifest::DroppedCollectionInfo> > >, std::allocator<std::pair<CollectionID const, std::vector<Collections::VB::Manifest::DroppedCollectionInfo, std::allocator<Collections::VB::Manifest::DroppedCollectionInfo> > > >, std::__detail::_Select1st, std::equal_to<CollectionID>, std::hash<CollectionID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, std::integral_constant<bool, true> >> = {<No data fields>}, <std::__detail::_Equality<CollectionID, std::pair<CollectionID const, std::vector<Collections::VB::Manifest::DroppedCollectionInfo, std::allocator<Collections::VB::Manifest::DroppedCollectionInfo> > >, std::allocator<std::pair<CollectionID const, std::vector<Collections::VB::Manifest::DroppedCollectionInfo, std::allocator<Collections::VB::Manifest::DroppedCollectionInfo> > > >, std::__detail::_Select1st, std::equal_to<CollectionID>, std::hash<CollectionID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, true>> = {<No data fields>}, <std::__detail::_Hashtable_alloc<std::allocator<std::__detail::_Hash_node<std::pair<CollectionID const, std::vector<Collections::VB::Manifest::DroppedCollectionInfo, std::allocator<Collections::VB::Manifest::DroppedCollectionInfo> > >, true> > >> = {<std::__detail::_Hashtable_ebo_helper<0, std::allocator<std::__detail::_Hash_node<std::pair<CollectionID const, std::vector<Collections::VB::Manifest::DroppedCollectionInfo, std::allocator<Collections::VB::Manifest::DroppedCollectionInfo> > >, true> >, true>> = {<std::allocator<std::__detail::_Hash_node<std::pair<CollectionID const, std::vector<Collections::VB::Manifest::DroppedCollectionInfo, std::allocator<Collections::VB::Manifest::DroppedCollectionInfo> > >, true> >> = {<__gnu_cxx::new_allocator<std::__detail::_Hash_node<std:---Type <return> to continue, or q <return> to quit---
      :pair<CollectionID const, std::vector<Collections::VB::Manifest::DroppedCollectionInfo, std::allocator<Collections::VB::Manifest::DroppedCollectionInfo> > >, true> >> = {<No data fields>}, <No data fields>}, <No data fields>}, <No data fields>}, _M_buckets = 0x7fa2a5580bc0, _M_bucket_count = 13,
                        _M_before_begin = {_M_nxt = 0x7fa2e4b07160}, _M_element_count = 3, _M_rehash_policy = {static _S_growth_factor = 2,
                          _M_max_load_factor = 1, _M_next_resize = 13}, _M_single_bucket = 0x0}}}, mutex_ = {static kReaderPriority = false,
                    state_ = {<std::__atomic_base<unsigned int>> = {static _S_alignment = 4, _M_i = 0}, static is_always_lock_free = true},
                    static kIncrHasS = 2048, static kHasS = 4294965248, static kAnnotationCreated = 1024, static kMayDefer = 512, static kPrevDefer = 256,
                    static kHasE = 128, static kBegunE = 64, static kHasU = 32, static kHasSolo = 224, static kWaitingNotS = 16,
                    static kWaitingESingle = 4, static kWaitingEMultiple = 8, static kWaitingE = 12, static kWaitingU = 2, static kWaitingS = 1,
                    static kWaitingAny = 31, static kNumSharedToStartDeferring = 2, static kMaxSpinCount = 1000, static kMaxSoftYieldCount = 1000,
                    static kDeferredSearchDistance = 2, static kDeferredSeparationFactor = 4, static kTokenStackTLSCapacity = 2, static kTokenless = 1,
                    static tls_lastTokenlessSlot = <error reading variable: Cannot find thread-local variables on this target>,
                    static tls_lastDeferredReaderSlot = <error reading variable: Cannot find thread-local variables on this target>,
                    static deferredReaders = {{<std::__atomic_base<unsigned long>> = {static _S_alignment = 8, _M_i = 0},
                        static is_always_lock_free = true} <repeats 2048 times>}}}, rwlock = {static kReaderPriority = true,
                  state_ = {<std::__atomic_base<unsigned int>> = {static _S_alignment = 4, _M_i = 0}, static is_always_lock_free = true},
                  static kIncrHasS = 2048, static kHasS = 4294965248, static kAnnotationCreated = 1024, static kMayDefer = 512, static kPrevDefer = 256,
                  static kHasE = 128, static kBegunE = 64, static kHasU = 32, static kHasSolo = 224, static kWaitingNotS = 16, static kWaitingESingle = 4,
                  static kWaitingEMultiple = 8, static kWaitingE = 12, static kWaitingU = 2, static kWaitingS = 1, static kWaitingAny = 31,
                  static kNumSharedToStartDeferring = 2, static kMaxSpinCount = 1000, static kMaxSoftYieldCount = 1000, static kDeferredSearchDistance = 2,
                  static kDeferredSeparationFactor = 4, static kTokenStackTLSCapacity = 2, static kTokenless = 1,
                  static tls_lastTokenlessSlot = <error reading variable: Cannot find thread-local variables on this target>,
                  static tls_lastDeferredReaderSlot = <error reading variable: Cannot find thread-local variables on this target>,
                  static deferredReaders = {{<std::__atomic_base<unsigned long>> = {static _S_alignment = 8, _M_i = 0},
                      static is_always_lock_free = true} <repeats 2048 times>}}, manifestUid = {<ThrowExceptionPolicy<unsigned long>> = {label = {
                      static npos = 18446744073709551615,
                      _M_dataplus = {<std::allocator<char>> = {<__gnu_cxx::new_allocator<char>> = {<No data fields>}, <No data fields>},
                        _M_p = 0x7fa2ecfde950 "unlabelled"}, _M_string_length = 10, {_M_local_buf = "unlabelled\000{\243\177\000",
                        _M_allocated_capacity = 7812730926796664437}}}, val = 16},
       
                manager = {<std::__shared_ptr<Collections::Manager, (__gnu_cxx::_Lock_policy)2>> = {<std::__shared_ptr_access<Collections::Manager, (__gnu_cxx::_Lock_policy)2, false, false>> = {<No data fields>}, _M_ptr = 0x7fa35c53f010, _M_refcount = {_M_pi = 0x7fa35c53f000}}, <No data fields>},
                scopeWithDataLimitExists = false, dropInProgress = {_M_base = {static _S_alignment = 1, _M_i = false}, static is_always_lock_free = true}}
              secondaryCommitData = {collections = {collections = {
                    _M_h = {<std::__detail::_Hashtable_base<CollectionID, std::pair<CollectionID const, Collections::VB::Flush::CollectionSpan>, std::__detail::_Select1st, std::equal_to<CollectionID>, std::hash<CollectionID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Hashtable_traits<true, false, true> >> = {<std::__detail::_Hash_code_base<CollectionID, std::pair<CollectionID const, Collections::VB::Flush::CollectionSpan>, std::__detail::_Select1st, std::hash<CollectionID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, true>> = {<std::__detail::_Hashtable_ebo_helper<0, std::__detail::_Select1st, true>> = {<std::__detail::_Select1st> = {<No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<1, std::hash<CollectionID>, true>> = {<std::hash<CollectionID>> = {<No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<2, std::__detail::_Mod_range_hashing, true>> = {<std::__detail::_Mod_range_hashing> = {<No data fields>}, <No data fields>}, <No---Type <return> to continue, or q <return> to quit---
       data fields>}, <std::__detail::_Hashtable_ebo_helper<0, std::equal_to<CollectionID>, true>> = {<std::equal_to<CollectionID>> = {<std::binary_function<CollectionID, CollectionID, bool>> = {<No data fields>}, <No data fields>}, <No data fields>}, <No data fields>}, <std::__detail::_Map_base<CollectionID, std::pair<CollectionID const, Collections::VB::Flush::CollectionSpan>, std::allocator<std::pair<CollectionID const, Collections::VB::Flush::CollectionSpan> >, std::__detail::_Select1st, std::equal_to<CollectionID>, std::hash<CollectionID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, true>> = {<No data fields>}, <std::__detail::_Insert<CollectionID, std::pair<CollectionID const, Collections::VB::Flush::CollectionSpan>, std::allocator<std::pair<CollectionID const, Collections::VB::Flush::CollectionSpan> >, std::__detail::_Select1st, std::equal_to<CollectionID>, std::hash<CollectionID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, false>> = {<std::__detail::_Insert_base<CollectionID, std::pair<CollectionID const, Collections::VB::Flush::CollectionSpan>, std::allocator<std::pair<CollectionID const, Collections::VB::Flush::CollectionSpan> >, std::__detail::_Select1st, std::equal_to<CollectionID>, std::hash<CollectionID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true> >> = {<No data fields>}, <No data fields>}, <std::__detail::_Rehash_base<CollectionID, std::pair<CollectionID const, Collections::VB::Flush::CollectionSpan>, std::allocator<std::pair<CollectionID const, Collections::VB::Flush::CollectionSpan> >, std::__detail::_Select1st, std::equal_to<CollectionID>, std::hash<CollectionID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, std::integral_constant<bool, true> >> = {<No data fields>}, <std::__detail::_Equality<CollectionID, std::pair<CollectionID const, Collections::VB::Flush::CollectionSpan>, std::allocator<std::pair<CollectionID const, Collections::VB::Flush::CollectionSpan> >, std::__detail::_Select1st, std::equal_to<CollectionID>, std::hash<CollectionID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, true>> = {<No data fields>}, <std::__detail::_Hashtable_alloc<std::allocator<std::__detail::_Hash_node<std::pair<CollectionID const, Collections::VB::Flush::CollectionSpan>, true> > >> = {<std::__detail::_Hashtable_ebo_helper<0, std::allocator<std::__detail::_Hash_node<std::pair<CollectionID const, Collections::VB::Flush::CollectionSpan>, true> >, true>> = {<std::allocator<std::__detail::_Hash_node<std::pair<CollectionID const, Collections::VB::Flush::CollectionSpan>, true> >> = {<__gnu_cxx::new_allocator<std::__detail::_Hash_node<std::pair<CollectionID const, Collections::VB::Flush::CollectionSpan>, true> >> = {<No data fields>}, <No data fields>}, <No data fields>}, <No data fields>},
                      _M_buckets = 0x7fa2a5580d80, _M_bucket_count = 13, _M_before_begin = {_M_nxt = 0x7fa2d7fadd60}, _M_element_count = 10,
                      _M_rehash_policy = {static _S_growth_factor = 2, _M_max_load_factor = 1, _M_next_resize = 13}, _M_single_bucket = 0x0}}, scopes = {
                    _M_h = {<std::__detail::_Hashtable_base<ScopeID, std::pair<ScopeID const, Collections::KVStore::OpenScope>, std::__detail::_Select1st, std::equal_to<ScopeID>, std::hash<ScopeID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Hashtable_traits<true, false, true> >> = {<std::__detail::_Hash_code_base<ScopeID, std::pair<ScopeID const, Collections::KVStore::OpenScope>, std::__detail::_Select1st, std::hash<ScopeID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, true>> = {<std::__detail::_Hashtable_ebo_helper<0, std::__detail::_Select1st, true>> = {<std::__detail::_Select1st> = {<No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<1, std::hash<ScopeID>, true>> = {<std::hash<ScopeID>> = {<No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<2, std::__detail::_Mod_range_hashing, true>> = {<std::__detail::_Mod_range_hashing> = {<No data fields>}, <No data fields>}, <No data fields>}, <std::__detail::_Hashtable_ebo_helper<0, std::equal_to<ScopeID>, true>> = {<std::equal_to<ScopeID>> = {<std::binary_function<ScopeID, ScopeID, bool>> = {<No data fields>}, <No data fields>}, <No data fields>}, <No data fields>}, <std::__detail::_Map_base<ScopeID, std::pair<ScopeID const, Collections::KVStore::OpenScope>, std::allocator<std::pair<ScopeID const, Collections::KVStore::OpenScope> >, std::__detail::_Select1st, std::equal_to<ScopeID>, std::hash<ScopeID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, true>> = {<No data fields>}, <std::__detail::_Insert<ScopeID, std::pair<ScopeID const, Collections::KVStore::OpenScope>, std::allocator<std::pair<ScopeID const, Collections::KVStore::OpenScope> >, std::__detail::_Select1st, std::equal_to<ScopeID>, std::hash<ScopeID>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, false, true>, false>> = {<std::__detail::_Insert_base<ScopeID, std::pair<ScopeID const, Collections::KVStore::OpenScope>, std::allocator<std::pair<ScopeID const, Collections::KVStore::OpenScope> >, std::---Type <return> to continue, or q <return> 
      

      QE-TEST:

      git fetch "https://review.couchbase.org/TAF" refs/changes/88/166488/1 && git checkout FETCH_HEAD
      guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P 'args=-i /tmp/qe_r.ini -p bucket_storage=couchstore,rerun=false,bucket_eviction_policy=fullEviction,init_loading=False -t storage.magma.magma_rebalance.MagmaRebalance.test_data_load_collections_with_rebalance_in,num_items=5000000,doc_size=256,nodes_init=2,nodes_in=2,standard_buckets=1,magma_buckets=0,bucket_storage=couchstore,data_load_stage=during,sdk_timeout=60,vbuckets=1024,key_size=12,replicas=0,infra_log_level=debug,log_level=debug,skip_cleaup=True,randomize_value=True,bucket_eviction_policy=fullEviction,infra_log_level=debug,log_level=debug,init_loading=False,fragmentation=50,skip_cleanup=True,autoCompactionDefined=true,iterations=1,enable_dp=True,num_collections=11,num_scopes=1,bucket_ram_quota=2056,skip_cleanup=True,sdk_client_pool=False,ops_rate=50000,doc_ops=create,create_perc=100,delete_perc=0,update_perc=0,num_collections_to_drop=0 -m rest'
      

      Attachments

        Issue Links

          For Gerrit Dashboard: MB-49802
          # Subject Branch Project Status CR V

          Activity

            People

              ankush.sharma Ankush Sharma
              ankush.sharma Ankush Sharma
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty