Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-30081

Rebalance should use DCP stream priority to set backfill as lower than replication traffic

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Unresolved
    • Major
    • backlog
    • 5.1.0
    • ns_server

    Description

      Currently replicateTo latency degrades significantly when Rebalance is going on (especially p99 and p99.9).

      There is a new feature to set DCP stream priorities: MB-11640. Rebalance backfill phase should use it so as to lower its priority compared to replication traffic. Here is a suggestion from Dave Rigby:

      • The rebalance stream (backfill in particular?) could be initially set at medium priority; increased to high later. Medium would put the backfill phase alongside GSI etc - which in fact is probably fair as they are also classed as front-end operations. When it later changes to in-memory state the priority could be restored to high.
        • Variant - we could even set backfill phaser to low priority; given it is a bulk operation which isn't latency sensitive.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              dfinlay Dave Finlay
              shivani.gupta Shivani Gupta
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty