Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-50088

Rejected mutation is not properly recorded in the stats UI

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 7.1.0
    • 7.0.2
    • XDCR
    • None
    • Triaged
    • 1
    • Unknown

    Description

      What is the issue?
      When working on MB-50012 we noticed that a document that is backed up, deleted and then restored with the --force-updates flag is rejected by XDCR and does not appear on the replication cluster (as expected since its CAS value is lower than that of the tombstone because of how restore with the --force-updates flag works) but that rejection is not recorded in the XDCR stats UI (the 'XDCR Mutations Skipped' stat still shows 0).

      Steps to reproduce:

      1. Setup two one node clusters, one with the backup service (Cluster A)
      2. Setup XDCR between the two clusters - single directional (Cluster A -> Cluster B)
      3. Add a bucket to the cluster A (the one with the backup service)
      4. Create a doc on cluster A, ensure it appears on cluster B
      5. Take a backup of cluster A
      6. Delete the document, again ensure it's also deleted on cluster B
      7. Do a restore using --force-update against cluster A, example command:

        cbbackupmgr restore -a /home/janu/backups -r 6a833b37-a185-45c4-9f2a-eda7c4677fa7 -c http://127.0.0.1:9000 -u Administrator -p asdasd --force-updates
        

      8. Observe that the Cluster A will have the document and the Cluster B will not (this is the issue described in MB-50012)
      9. Navigate to the XDCR stats UI and see that the 'XDCR Mutations Skipped' stat still shows 0, even though one mutation should had been clearly rejected

      The screenshot of the stats UI after following the above steps on my end:

      The screenshot of the Documents page on the replication target cluster after the above steps:

      Logs from both clusters are attached.

      Attachments

        1. 2021-12-14_17-50.png
          2021-12-14_17-50.png
          27 kB
        2. cluster_A.zip
          644 kB
        3. cluster_B.zip
          339 kB
        4. image.png
          image.png
          55 kB
        5. image-2021-12-15-13-08-05-317.png
          image-2021-12-15-13-08-05-317.png
          130 kB
        6. image-2021-12-15-13-09-18-773.png
          image-2021-12-15-13-09-18-773.png
          71 kB

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              lilei.chen Lilei Chen (Inactive)
              maks.januska Maksimiljans Januska
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty