Details
-
Bug
-
Resolution: Duplicate
-
Major
-
4.5.0
-
Triaged
-
Yes
Description
Hi, ForestDB team,
Can you please look into this issue? Here's what we see in show fast:
4.1 GA 4.5 (build 2016)
Initial index build time for 5 indexes(min) 19.9 70.4
Indexer RSS for initial index build of 5 indexes 40G 70G
Note, we don't observe any regressions/issues when build 1 indexes for initial index build.
Here are some analysis from John:
For initial index build on 5 indexes, I think the issue is correlated with long commit time. I have attached a file in MB-18456 which has commit over 4s. I can see the long commits happening more frequently when forestdb reported memory usage go over 50G (~ at 06:25:00). Drain rate essentially slow down to 2-5.5K/s.
Attachments
Issue Links
- duplicates
-
MB-21542 Initial and incremental indexing in Watson is slower than in Sherlock (FDB)
- Closed
- relates to
-
MB-17236 Long commit time for forestdb - build 858, 1613
- Closed
-
MB-18456 Incremental build times for building multiple indexes have increased in latest builds for forestDB storage.
- Closed
-
MB-19056 Incremental build in 2i with FDB has increased by 50% as compared to sherlock GA.
- Closed
-
MB-19600 Improve the index build time with append-only writes during initial index build even when circular-writes is the write mode for the index
- Closed
-
MB-19320 300M initial build time is slower in watson than in sherlock/4.1.0
- Closed
-
MB-19629 50M Incremental Index build time is (much) slower in Watson than sherlock
- Closed
-
MB-19600 Improve the index build time with append-only writes during initial index build even when circular-writes is the write mode for the index
- Closed
- mentioned in
-
Page Loading...
-
Page Loading...
-
Page Loading...
-
Page Loading...
-
Page Loading...
-
Page Loading...
-
Page Loading...
-
Page Loading...
-
Page Loading...
-
Page Loading...
-
Page Loading...
-
Page Loading...
-
Page Loading...
-
Page Loading...