Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-54366

[BP-7.0.5] - XDCR Metakv callbacks racing when remote cluster ref is added/changed

    XMLWordPrintable

Details

    • Untriaged
    • 1
    • Unknown

    Description

      Multiple callbacks are allowed to run for metakv listener. These normally run fine as these do not take much time. But in-case the callbacks take time (e.g due to long DNS look-up time) then the order in which changes happen in metakv are applied out-of-order.

      This is because the a spawned callback gets stalled and in the meantime, the metakv gets modified. This stalled callback overrides with values.

      All this gets manifested with error: 

      Error writing to metakv: revision number does not match

      Attachments

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. MB-54424 XDCR - Unexpected server error (500)

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is a backport of

          Bug - A problem which impairs or prevents the functions of the product. MB-52156 XDCR - Metakv callbacks racing when remote cluster ref is added/changed

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. MB-54424 XDCR - Unexpected server error (500)

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            Ascending order - Click to sort in descending order
            build-team Couchbase Build Team added a comment -

            Build couchbase-server-7.0.5-7637 contains goxdcr commit 6c89420 with commit message:
            MB-54366: Fix racing of metakv callbacks for remote clusters

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.5-7637 contains goxdcr commit 6c89420 with commit message: MB-54366 : Fix racing of metakv callbacks for remote clusters
            ritam.sharma Ritam Sharma added a comment - - edited

            Neil Huang - Can you please help with steps to validate the issue.

            Spoke with Neil - full regression will be good. Dev is working towards unit test, and QE will try to simulate a DNS Srv slowness.

            ritam.sharma Ritam Sharma added a comment - - edited Neil Huang - Can you please help with steps to validate the issue. Spoke with Neil - full regression will be good. Dev is working towards unit test, and QE will try to simulate a DNS Srv slowness.
            build-team Couchbase Build Team added a comment -

            Build couchbase-server-7.0.5-7641 contains goxdcr commit 7d32d9e with commit message:
            MB-54366: fix to add missing unlock in error path

            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.5-7641 contains goxdcr commit 7d32d9e with commit message: MB-54366 : fix to add missing unlock in error path
            ritam.sharma Ritam Sharma added a comment -

            Actual defect for last fix is - https://issues.couchbase.com/browse/MB-54424.

            ritam.sharma Ritam Sharma added a comment - Actual defect for last fix is - https://issues.couchbase.com/browse/MB-54424 .

            People

              sudeep.jathar Sudeep Jathar
              neil.huang Neil Huang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty