Details
-
Bug
-
Resolution: Fixed
-
Critical
-
Cheshire-Cat
-
Untriaged
-
-
1
-
No
Description
Build : 7.0.0-3875
Test : -test tests/2i/cheshirecat/test_idx_steady_state_cheshire_cat_coll_crud.yml -scope tests/2i/cheshirecat/scope_idx_cheshire_cat.yml
Scale : 2
Day 1 Iteration 1
This is the steady state version of the GSI collections system test. There are 2 buckets in this test - bucket4 and bucket5 on which there is a thread that continuously creates and drops scopes and collections. There is another thread that would, in a loop, get the list of scopes and collections on these buckets, and create an index randomly on some collection. So when the scope/collection on bucket4/5 gets dropped, the indexes for that scope/collections will get cascade deleted.
As part of this step, seeing the following Fatal error logged in the indexer logs on 172.23.97.77-
2020-12-01T20:53:15.984-08:00 [Info] Timekeeper::removeIndexFromStream IndexCount map[MAINT_STREAM:map[bucket1:57 bucket2:57 bucket3:50 bucket4:5 bucket5:1] INIT_STREAM:map[]]
|
2020-12-01T20:53:15.984-08:00 [Info] Timekeeper::removeIndexFromStream IndexCount map[MAINT_STREAM:map[bucket1:57 bucket2:57 bucket3:50 bucket4:5 bucket5:0] INIT_STREAM:map[]]
|
2020-12-01T20:53:15.984-08:00 [Fatal] Timekeeper::removeIndexFromStream Invalid Internal State Detected. Index Count Underflow. Stream MAINT_STREAM. KeyspaceId bucket5.
|
2020-12-01T20:53:15.984-08:00 [Info] TK SystemEvent MAINT_STREAM bucket5 61 178530533750552 939 1 10 322
|
2020-12-01T20:53:15.984-08:00 [Warn] Timekeeper::handleDcpSystemEvent Ignore SystemEvent for StreamId MAINT_STREAM KeyspaceId bucket5. IndexCount 0.
|
2020-12-01T20:53:15.984-08:00 [Info] Indexer::processCollectionDrop MAINT_STREAM bucket5 0 41
|
2020-12-01T20:53:15.984-08:00 [Info] Indexer::processCollectionDrop No Index Found for Stream MAINT_STREAM Collection Id 41.
|
2020-12-01T20:53:15.984-08:00 [Info] TK SystemEvent MAINT_STREAM bucket5 24 276711450048922 939 1 10 322
|
2020-12-01T20:53:15.984-08:00 [Warn] Timekeeper::handleDcpSystemEvent Ignore SystemEvent for StreamId MAINT_STREAM KeyspaceId bucket5. IndexCount 0.
|
Around the same time, similar message was also logged in the indexer logs of 172.23.97.83.
2020-12-01T20:53:15.977-08:00 [Fatal] Timekeeper::removeIndexFromStream Invalid Internal State Detected. Index Count Underflow. Stream MAINT_STREAM. KeyspaceId bucket5.
|