Uploaded image for project: 'Couchbase Kafka Connector'
  1. Couchbase Kafka Connector
  2. KAFKAC-66

Out of memory on backfill from huge bucket

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.1.1
    • Fix Version/s: 3.1.2
    • Labels:
      None

      Description

      We acknowledge each buffer just before writing to Kafka, but also the records collected into batches. And when the poller cannot empty the queue of incoming DCP messages, it ends acknowledging without actually finishing batch for Kafka topic, which leads to OOM.

        Attachments

        For Gerrit Dashboard: KAFKAC-66
        # Subject Branch Project Status CR V

          Activity

            People

            Assignee:
            avsej Sergey Avseyev
            Reporter:
            avsej Sergey Avseyev
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Gerrit Reviews

                There are no open Gerrit changes

                  PagerDuty