Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-17341

When applying new config, janitor agent sets up new replication streams against vbuckets while they are still DEAD (before they have been activated)

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 4.1.1, 4.5.0
    • 3.1.3
    • ns_server
    • Security Level: Public
    • None
    • Untriaged
    • Unknown

    Description

      The janitor exists to correct the state of the world and it runs periodically to check that the state is consistent with its understanding of what the state should be.

      When the janitor detects that there's a difference between what is and what should be it does the following:

      1. Removes undesired replications and adds desired replications
      2. Adjusts the state of vbuckets to be correct.

      In a failed rebalance, it can be the case that a vbucket state needs to be changed from DEAD -> ACTIVE. Because janitor makes changes in the order stated, new replications from the about-to-be-activated vbucket are created while it is still officially dead. This works right now but there's a companion issue filed against KV engine which would prevent this from happening (MB-17230). It seems that it would be safer and more correct to change janitor into a 3 step process:

      1. Remove undesired replications
      2. Adjust vbucket state
      3. Add desired replications

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              poonam Poonam Dhavale
              dfinlay Dave Finlay
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty