Details
-
Bug
-
Resolution: Fixed
-
Major
-
6.6.2, 7.0.1, 7.1.0
-
None
-
Untriaged
-
1
-
Unknown
Description
Projector logs numDocsPending stats every 1min. To that extent, is spawns the go-routines to fetch seqnos from KV node. One go-routine queries ns_server every 10sec to validate the presence of a bucket in the cluster and clear the book-keeping if the bucket wa to be deleted.
In cases where there are large number of buckets, periodically querying all the bucket endpoints is adding significant load on ns_server i.e. in a 30 bucket setup, it would be 30*6 = 180 requests per min. These requests would be to "pools/default/buckets/<bucket_name>?uuid=<>" endpoint which is a relatively costly call.
Attachments
Issue Links
For Gerrit Dashboard: MB-47666 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
158493,4 | MB-47666 Provide configurable option to disable numDocsPending stat | unstable | indexing | Status: ABANDONED | +2 | 0 |
159575,1 | MB-47878 : [BP of MB-47666 to 7.0.2] Increase polling interval in pollForDeletedBuckets | cheshire-cat | indexing | Status: MERGED | +2 | +1 |
159604,2 | MB-47666 : Increase polling interval in pollForDeletedBuckets | unstable | indexing | Status: MERGED | +2 | +1 |
167161,2 | MB-47674 : Increase polling interval in pollForDeletedBuckets | mad-hatter | indexing | Status: MERGED | +2 | +1 |