Details
-
Bug
-
Resolution: Fixed
-
Major
-
7.1.0
-
7.0.0-4122
-
Triaged
-
-
1
-
Unknown
-
KV-Engine Sprint 2021 August, KV-Engine-Sept-21, KV 2021-Oct-21, KV 2021-Nov
Description
Steps:
- Create a 3 node cluster
- Create required buckets and collections(2 + 1 default).
- Create 1000000 items and Delete everything. checkout fragmentation
- Load 2000000 items, sequential keys. Total Items = 6M
- Update the first set of 10 percent (100000) items 1 times. Total Items = 6M
- Reverse Update last set of 10 percent (999999-900001) items 1 times. Total Items = 6M
- Create 1000000 random keys. Total Items = 9M
- Update all 1000000 random items 1 times
- Update all 1000000 random items 1 times
- Delete/Re-Create all 1000000 random items. Total Items = 9M
- Update 10 percent(100000) items 1 times and crash during recovery
- Update 10 percent(100000) items 1 times and crash during recovery
- Normal Rollback with creates
- Normal Rollback with updates
- Drop a collection. Total Items = 6M
- Normal Rollback with deletes. Stop persistence on active and delete items belongs to active vB(deleted items aren't persisted on active) so that they will get deleted from replica. Kill memcached on active so that delete items info is lost from memcached and active will trigger rollback on replica.
In the last step, the number of Active and replica items expected are 6M.
ssh root@172.23.97.38
vb_replica_curr_items: 2002898
vb_active_curr_items: 2006036
ssh root@172.23.97.38
vb_replica_curr_items: 2084164
vb_active_curr_items: 1997158
ssh root@172.23.97.39
vb_replica_curr_items: 1998162
vb_active_curr_items: 1996806
Total Active = 6M
Total Replica = 60,85,224 ====> Which is way more than expected items.
QE Test:
guides/gradlew --refresh-dependencies testrunner -P jython=/opt/jython/bin/jython -P "args=-i /tmp/dp_magma_job.ini -p bucket_storage=${storage},bucket_eviction_policy=fullEviction,rerun=False -t volumetests.Magma.volume.SteadyStateVolume,nodes_init=3,replicas=1,skip_cleanup=True,num_items=1000000,num_buckets=1,bucket_names=GleamBook,doc_size=256,bucket_type=membase,compression_mode=off,iterations=1,batch_size=1000,sdk_timeout=60,log_level=debug,infra_log_level=info,rerun=False,skip_cleanup=True,key_size=18,randomize_doc_size=False,randomize_value=True,assert_crashes_on_load=True,step_iterations=1,rollback=True,durability=None,fragmentation=50,rollbacks=10,num_collections=2,pc=1,ramQuota=10240 -m rest"
|
Attachments
Issue Links
- depends on
-
MB-42652 [Magma]: After dropping 10 collections out of 21 collections items count are more than expected.
- Closed
-
MB-42272 Collections/Magma: Keeping collection stats docs until erasure does not account for collection resurrection
- Closed
- relates to
-
MB-42652 [Magma]: After dropping 10 collections out of 21 collections items count are more than expected.
- Closed