Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-19173

Initial and incremental build time regression for 5 indexes (fdb)

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Major
    • 5.0.0
    • 4.5.0
    • forestdb
    • Triaged
    • Yes

    Description

      Hi, ForestDB team,

      Can you please look into this issue? Here's what we see in show fast:

      4.1 GA 4.5 (build 2016)
      Initial index build time for 5 indexes(min) 19.9 70.4
      Indexer RSS for initial index build of 5 indexes 40G 70G

      Note, we don't observe any regressions/issues when build 1 indexes for initial index build.

      Here are some analysis from John:
      For initial index build on 5 indexes, I think the issue is correlated with long commit time. I have attached a file in MB-18456 which has commit over 4s. I can see the long commits happening more frequently when forestdb reported memory usage go over 50G (~ at 06:25:00). Drain rate essentially slow down to 2-5.5K/s.

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. MB-21542 Initial and incremental indexing in Watson is slower than in Sherlock (FDB)

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-17236 Long commit time for forestdb - build 858, 1613

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-18456 Incremental build times for building multiple indexes have increased in latest builds for forestDB storage.

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-19056 Incremental build in 2i with FDB has increased by 50% as compared to sherlock GA.

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. MB-19600 Improve the index build time with append-only writes during initial index build even when circular-writes is the write mode for the index

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-19320 300M initial build time is slower in watson than in sherlock/4.1.0

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-19629 50M Incremental Index build time is (much) slower in Watson than sherlock

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. MB-19600 Improve the index build time with append-only writes during initial index build even when circular-writes is the write mode for the index

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          mentioned in

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              chiyoung Chiyoung Seo (Inactive)
              qi Qi Zhu (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty