We need to investigate this and decide on whether we need to revert the changes.
Ronnie, please attached your reports from performance runs.
Assigning this to Jin right now because he's been driving the capacity planning stuff of late, please re-assign as required.
Ronnie, when data is available please attach your reports from the performance runs here. Also, for better understanding, let's be specific in what rate of performance degradation we are talking about here. Please assign it back to me after you have attached the requested reports.
With higher water mark settings:
per bug scrub - assigning back to Jin
From the latest round of performance test (Ronnie), high/low water mark changes seem to be OK. However, we would like to still wait for high cache miss ratio test and confirmation from QE (Ketaki).
Ketaki, please assign it back to Jin or mark it as resolved once your test (high cache miss) completed with concrete result. Thanks!
Not seeing any system-regression on build 2.0.1-140 so far.
No higher swap w/ higher cache-miss ( 5-20 %)
can you please post the graph which shows that there is not much swap usage int he cluster after X days
also it helps if you print out the tcmalloc fragmentation output here priori to resolving the issue
Refer page-10 for swap stats. Swap on the current cluster did not grow w/ the change in High/Low Watermarks.