Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Fixed
-
7.0.2
-
1
Description
Killing an indexer or indexer crash resets all the rollback stats. We need to persists these stats for QE validation as in certain scenario we do comparisons between stats value before and after indexer kill/crash for recovery.
hemantrajput@LFC testrunner % curl -s -v -u Administrator:password http://10.112.205.101:9102/stats 2>/dev/null | jq | grep num_rollbacks
|
"MAINT_STREAM:default:num_rollbacks": 2,
|
"MAINT_STREAM:default:num_rollbacks_to_zero": 1,
|
hemantrajput@LFC testrunner % ssh root@10.112.205.101
|
Last login: Fri Sep 3 07:29:24 2021 from 10.112.205.1
|
[root@node1-cb660-centos7 ~]# pgrep indexer
|
25923
|
[root@node1-cb660-centos7 ~]# kill -9 25923
|
[root@node1-cb660-centos7 ~]# exit
|
logout
|
Connection to 10.112.205.101 closed.
|
hemantrajput@LFC testrunner % curl -s -v -u Administrator:password http://10.112.205.101:9102/stats 2>/dev/null | jq | grep num_rollbacks
|
"MAINT_STREAM:default:num_rollbacks": 0,
|
"MAINT_STREAM:default:num_rollbacks_to_zero": 0,
|
hemantrajput@LFC testrunner %
|
Attachments
Issue Links
- is cloned by
-
MB-48336 [BP 7.0.2 MB-48314] - Persist rollbacks stats in case of indexer crash - needed for verification
-
- Closed
-
Hemant Rajput, Can you please elaborate your requirements around the persistence? Currently, we have two types of persistences (a) Flat file (b) Snapshot. Flat file persistence happens every 15 min. This interval is configurable. Snapshotting happens every 10 minutes and it is per index. I don't think it is a good idea to change snapshotting interval in recovery tests.
So, I am thinking to persist the stat in a file on disk and read it back when recovering. If you need more fine grained interval, change the "indexer.statsPersistenceInterval" to a less value (currently at 900). I believe this will give you enough control over the stat. Please let me know if you have any other requirement.