Uploaded image for project: 'Couchbase Kafka Connector'
  1. Couchbase Kafka Connector
  2. KAFKAC-66

Out of memory on backfill from huge bucket

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.1.1
    • Fix Version/s: 3.1.2
    • Labels:
      None

      Description

      We acknowledge each buffer just before writing to Kafka, but also the records collected into batches. And when the poller cannot empty the queue of incoming DCP messages, it ends acknowledging without actually finishing batch for Kafka topic, which leads to OOM.

        Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

          avsej Sergey Avseyev created issue -
          avsej Sergey Avseyev made changes -
          Field Original Value New Value
          Status New [ 10003 ] Open [ 1 ]
          avsej Sergey Avseyev made changes -
          Fix Version/s 3.1.2 [ 14202 ]
          avsej Sergey Avseyev made changes -
          Resolution Fixed [ 1 ]
          Status Open [ 1 ] Resolved [ 5 ]

            People

            Assignee:
            avsej Sergey Avseyev
            Reporter:
            avsej Sergey Avseyev
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Gerrit Reviews

                There are no open Gerrit changes

                  PagerDuty