Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-55852

XDCR - rebalancing progress visibility

    XMLWordPrintable

Details

    • 0

    Description

      Speaking with support team, one of the asks that support would like to see is to enhance the visibility of XDCR rebalancing.
      Currently, when a cluster is being rebalanced, it provides a percentage of the rebalancing progress.

      Current issue
      Once rebalances happen either on the source or target, XDCR has a "count down" mechanism to wait for VB movement to stabilize. Once it stablizes, XDCR pipeline is restarted and data movement will continue.
      In the meantime, before pipeline is restated, there could be fewer data movements as the VBs that are rebalanced are no longer streaming. From customer's pov, without feedback, it looks like as if XDCR stalled and no indication is given for the reason why it stalled.

      Source side rebalance
      However, once the source cluster has finished rebalancing, XDCR itself will undergo its own rebalancing mechanism.
      Internally, it has a few counters. And, depending on the situation, will restart the pipeline after a certain amount of time.

      Target side rebalance
      Moreover, when a target cluster is rebalanced, source XDCR currently does not show any status either, even if it is aware of target topology changes.
      Adding this knowledge to XDCR status could also help the visibility into why docs aren't replicated, and when the pipeline restart will happen next.

      It would be considered an improvement for supportability if XDCR can showcase each node’s rebalance progress.

      One way to do it is to provide this as a “status” in the pipeline warning/status if any VBs are not being replicated, and is pending pipeline restart. In the meantime, which wouldn’t require any UI changes, and can come later.

      Attachments

        Issue Links

          For Gerrit Dashboard: MB-55852
          # Subject Branch Project Status CR V

          Activity

            People

              ayush.nayyar Ayush Nayyar
              neil.huang Neil Huang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty