SINK: Support writing to a different bucket depending on the topic

Description

Enhance the `couchbase.topic.to.collection` feature to support specifying the target bucket as well as scope and collection.

For example, allow something like this:

In this example, records from topic `topic-a` would be written to scope `myScope` collection `myCollection` in the default bucket (specified by the existing `couchbase.bucket` config property).

Records from `topic-b` would be written to scope `otherScope` collection `otherCollection` in bucket `otherBucket`.

In other words, the collection specifier should allow an optional bucket prefix, delimited with a colon.

 

https://docs.couchbase.com/kafka-connector/current/sink-configuration-options.html#couchbase.topic.to.collection

Environment

None

Gerrit Reviews

None

Release Notes Description

None

Activity

Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Story Points

Priority

Instabug

Open Instabug

PagerDuty

Sentry

Zendesk Support

Created November 8, 2022 at 9:48 PM
Updated November 9, 2022 at 10:43 PM
Instabug