Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-14092

GoXDCR: Dataloss in CAPI replication

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 4.0.0
    • 4.0.0
    • XDCR
    • Security Level: Public
    • centOS 6.x
    • Triaged
    • No

    Description

      Build


      4.0.0-1655

      Consistently reproducible.

      Ran locally from my laptop

      Testcase and test log : https://friendpaste.com/20tzZfOiFoupw6oy4w40lg

      ./testrunner -i bixdcr.ini demand_encryption=1 -t xdcr.xdcrMiscTests.XdcrMiscTests.test_diff_version_xdcr,items=10000,doc-ops=create-delete,doc-ops-dest=create-delete,upd=80,del=20,rdirection=bidirection

      This testcase tests both capi and xmem.
      C1 [.186,.187] --> C2 [.188,.189] , capi replication
      C1 [.186,.187] <-- C2 [.188,.189] , xmem replication
      does updates and deletes and C1 and C2.

      Looks like updates/deletes from C1 do not reach C2.

      C1 contains 16000 keys while C2 contains only 8000.

      Seeing errors like -
      map[capi_807c067ec87db734df0cb26b66d63286/default/default_10.3.4.189:18092_0:batch update docs failed for vb 683 after 3 retries]
      map[capi_807c067ec87db734df0cb26b66d63286/default/default_10.3.4.189:18092_0:batch update docs failed for vb 557 after 3 retries]
      map[capi_807c067ec87db734df0cb26b66d63286/default/default_10.3.4.188:18092_1:batch update docs failed for vb 480 after 3 retries]
      map[capi_807c067ec87db734df0cb26b66d63286/default/default_10.3.4.188:18092_0:batch update docs failed for vb 72 after 3 retries]
      map[capi_807c067ec87db734df0cb26b66d63286/default/default_10.3.4.188:18092_0:batch update docs failed for vb 70 after 3 retries]
      map[capi_807c067ec87db734df0cb26b66d63286/default/default_10.3.4.188:18092_0:batch update docs failed for vb 70 after 3 retries]

      Attaching logs. Attaching screenshot of regular metaops spikes on .188.
      Do not see any keys stuck on dcp queue on .186. However the outbound mutations value doesn't go down. Screen shot attached.

      Note: I'm removing this test from xdcr suite.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            apiravi Aruna Piravi (Inactive)
            apiravi Aruna Piravi (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              PagerDuty