Uploaded image for project: 'Couchbase Kafka Connector'
  1. Couchbase Kafka Connector
  2. KAFKAC-66

Out of memory on backfill from huge bucket

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 3.1.2
    • 3.1.1
    • None

    Description

      We acknowledge each buffer just before writing to Kafka, but also the records collected into batches. And when the poller cannot empty the queue of incoming DCP messages, it ends acknowledging without actually finishing batch for Kafka topic, which leads to OOM.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            avsej Sergey Avseyev
            avsej Sergey Avseyev
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty