Details
-
Bug
-
Resolution: Fixed
-
Critical
-
None
-
None
-
DOC-2022-S16, DOC-2022-S17, DOC-2022-S18, DOC-2023-S24
Description
Problem
The 3.1 Kafka Connector documentation states:
Data is loaded efficiently and reliably using Couchbase’s internal replication protocol, DCP. Every change to or deletion of the document generates a replication event, which is then sent to the configured Kafka topic. When copying data from a bucket, the connector loads only new or modified documents.
This is incorrect and not true. The 4.1 has a excellent statement on this topic, which should be copied to 3.4 and 4.0 documentations:
The source connector does not guarantee every version of a document will be reflected in the Kafka topic. For example, if a Couchbase document value changes rapidly from V1 → V2 → V3, or if the connector is not running when the change occurs, the connector is only guaranteed to publish the latest value (V3).
Expectation
Back port the 4.1 page to 4.0 and 3.1