Uploaded image for project: 'Couchbase Documentation'
  1. Couchbase Documentation
  2. DOC-10331

Kafka Connector 3.1: incorrect and dangerous information on delivery guarantees

    XMLWordPrintable

Details

    Description

      Problem
      The 3.1 Kafka Connector documentation states:

      Data is loaded efficiently and reliably using Couchbase’s internal replication protocol, DCP. Every change to or deletion of the document generates a replication event, which is then sent to the configured Kafka topic. When copying data from a bucket, the connector loads only new or modified documents.

      This is incorrect and not true. The 4.1 has a excellent statement on this topic, which should be copied to 3.4 and 4.0 documentations:

      The source connector does not guarantee every version of a document will be reflected in the Kafka topic. For example, if a Couchbase document value changes rapidly from V1 → V2 → V3, or if the connector is not running when the change occurs, the connector is only guaranteed to publish the latest value (V3).

      Expectation

      Back port the 4.1 page to 4.0 and 3.1

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            richard.smedley Richard Smedley
            pvarley Patrick Varley (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty