Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-53164

[BP 7.0.5] User database upgrade might render cluster unusable under the constant flow of auth attempts

    XMLWordPrintable

Details

    • Triaged
    • 1
    • Unknown

    Description

      backport of MB-53848

      Happened during the online upgrade from 6.6.3 to 7.1.1.
       
      1. user database was upgraded to 7.1
      2. at this point the cluster compat version is still 6.6.3
      3. any auth request for the user that is configured with roles that were upgraded faces the following problem: the upgraded roles are compiled with the old role definitions, which causes crash in rbac
      4. few subsequent crashes cause max_restart_intensity and crash of users_sup, which causes node to be down
      5. which causes the upgrade to be infinitely unfinished and crashes happening over and over again
       
      The proposed solution:
      Catch the crashes in compile_roles and in case of unfinished upgrade try the compilation again but with latest roles definitions.
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            pulkit.matta Pulkit Matta
            Abhijeeth.Nuthan Abhijeeth Nuthan
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty