Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-59546

[BP to 7.1.6-MP1 & 7.2.3-MP1]Topology change: PrepareTopologyChange exceeding call time limit

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 7.1.7
    • 7.6.0, 7.1.4, 7.1.0, 7.1.1, 7.1.2, 7.1.3, 7.1.5
    • query
    • 0
    • Yes

    Description

      If PrepareTopologyChange takes more than 60 seconds the rebalance fails.

      Currently host name resolution (strictly mapping of UUID to host with IP lookup) takes place during the call, in a serial fashion.  If resolution is slow the call may exceed the time limit.

      Workarounds:

      • Add/remove one Query node at a time (to avoid compounding any delay)
      • Ensure host name resolution is fast
        • Perhaps even temporarily listing the names in local hosts files and ensuring they're checked first (before DNS or LDAP)

      Fixes:

      • Perform the host name resolution in parallel.
      • Perform the host name resolution only for and when ejecting nodes.

       

      Attachments

        Issue Links

          For Gerrit Dashboard: MB-59546
          # Subject Branch Project Status CR V

          Activity

            People

              Donald.haggart Donald Haggart
              Donald.haggart Donald Haggart
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty