Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-45591

[CX] Optimize number of non-OSO DCP streams

    XMLWordPrintable

Details

    • 1
    • CX Sprint 283, CX Sprint 284, CX Sprint 285, Analytics Sprint 24, Analytics Sprint 25, Analytics Sprint 26, Analytics Sprint 27, Analytics Sprint 28, Analytics Sprint 29, Analytics Sprint 30

    Description

      Currently Analytics uses a DCP stream per KV collection which results in optimal performance for OSO streams. However, when streams cannot utilize OSO and the number of collections increases, there will be a performance degradation as shown in MB-44363. We should try to optimize the number of non-OSO streams with regard to the number of collections.

      QE/Perf/Doc Impact: this is an internal improvement which has no user model changes. Existing Perf team & QE functional tests should be sufficient to ensure proper function and confirm benefit.

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. MB-43425 [CX] employ heuristics to divide collections into streams

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. MB-51950 [Magma] Magma bucket not honouring RAM quota allocated when analytics is ingesting data from it.

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. MB-52008 Analytics average ingestion rate with magma is 90% lower compared to Couchstore

          • Major - Major loss of function.
          • Closed
          For Gerrit Dashboard: MB-45591
          # Subject Branch Project Status CR V
          172162,18 MB-45591: decouple streams from collections trinity cbas-core Status: NEW 0 -1
          172163,5 MB-45591: fixes for multiple collections-per-stream trinity analytics-dcp-client Status: NEW 0 -1
          172819,14 MB-45591: reworked stream allocation trinity cbas-core Status: NEW 0 -1
          172861,5 MB-45591: logging improvements trinity analytics-dcp-client Status: NEW 0 -1

          Activity

            People

              michael.blow Michael Blow
              murtadha.hubail Murtadha Hubail
              Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There are 4 open Gerrit changes

                  PagerDuty