Uploaded image for project: 'Couchbase Kafka Connector'
  1. Couchbase Kafka Connector
  2. KAFKAC-217

Sink connector fails if any of the couhbase node is unreachable for some time

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Major
    • None
    • 3.4.7
    • Couchbase version: 6.0.3
      OS: Red Hat Enterprise Linux 7 (7.8)
      Kafka binary: confluent Kafka 5.4.1-ce, Apache kafka 2.5.0
      Sink Connector executable: connect-standalone
    • 1
    • High

    Description

      The sink connector throws an unrecoverable exception if any of the couchbase node is not reachable for some time. A manual restart is required to resume the operation. The sink connector was unable to resume the operation once the node is back. Rather it is throwing the below exception.

      [2020-07-21 09:19:17,930] ERROR WorkerSinkTask{id=xxxxxxxxxx} Task threw an uncaught and unrecoverable exception. Task is being killed and will not recover until manually restarted. (org.apache.kafka.connect.runtime.WorkerSinkTask:559)
      com.couchbase.client.java.error.CannotRetryException: maximum number of attempts reached after 5 retries
      at com.couchbase.client.java.util.retry.RetryWithDelayHandler.call(RetryWithDelayHandler.java:103)
      at com.couchbase.client.java.util.retry.RetryWithDelayHandler.call(RetryWithDelayHandler.java:42)
      at rx.internal.operators.OnSubscribeMap$MapSubscriber.onNext(OnSubscribeMap.java:69)
      at rx.internal.operators.OperatorZip$Zip.tick(OperatorZip.java:252)
      at rx.internal.operators.OperatorZip$Zip$InnerSubscriber.onNext(OperatorZip.java:323)

       

      The issue is easy to reproduce: Just stop the couchbase service in one of the node and start it after 5-10 minutes. The above exception will be logged in the sink connector logs and it stops processing any further kafka messages.

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              david.nault David Nault
              mijicherian Miji Cherian (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty