Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-50582

[CBM] Improve the performance of staging directory population

    XMLWordPrintable

Details

    • Task
    • Resolution: Done
    • Major
    • Morpheus
    • Morpheus
    • tools
    • None
    • 1

    Description

      What's the issue?
      Once our archive gets quite large, the staging directory population process becomes quite time consuming.

      I think there's a couple of things we can do to help improve this:

      1) We should inflate archive metadata using a worker pool (if possible)
      2) We should avoid compressing metadata that might already be compressed (e.g. collect the existing range files vs re-compressing them)

      Attachments

        Issue Links

          relates to

          Task - A task that needs to be done. MB-53764 [CBM] Investigate how to further improve staging directory population performance

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. MB-50558 [CBM] collect-logs on GCP may take much longer than expected

          • Major - Major loss of function.
          • Closed
          For Gerrit Dashboard: MB-50582
          # Subject Branch Project Status CR V
          176097,3 MB-50582 Use a worker pool to inflate metadata master backup Status: MERGED +2 +1

          Activity

            People

              james.lee James Lee
              james.lee James Lee
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty