Uploaded image for project: 'Couchbase Kafka Connector'
  1. Couchbase Kafka Connector
  2. KAFKAC-132

Connector runs out of memory if snapshot is too large

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 3.4.6
    • None
    • None
    • 1

    Description

      When the `use_snapshots` config property is `true`, the connector buffers an entire snapshot in memory before propagating to Kafka. This can be a problem if the first snapshot is huge, as it often is when streaming from the beginning of history.

      The temporary workaround is to set `use_snapshots` to `false`.

      A possible fix would be to treat the first snapshot as a special case, and never buffer it.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            david.nault David Nault
            david.nault David Nault
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty