Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-62860

Connect link query is failing with internal error after altering properties of Kafka link

    XMLWordPrintable

Details

    • Untriaged
    • Linux x86_64
    • 0
    • Yes

    Description

      Test Steps

      1. Create a Confluent Kafka link and a single collection linked against it.
      2. Connect the link.
      3. Alter the properties of the link by adding schema registry properties.
      4. Try to reconnect the link.

      Observation

      Connect link statement is failing with internal error.

      [{"code":22001,"msg":"Connect link failed {\"kafka_link\":\"Internal error\"}"}]
      

      From analytics_info.log on node-004

      2024-07-23T09:48:05.184+00:00 WARN CBAS.server.QueryServiceServlet [HttpExecutor(port:18095)-15] handleException: unexpected exception: uuid=null, clientContextID=ad140df1-9f1e-4557-b2d0-9b3f28c2f4de
      com.couchbase.analytics.common.exceptions.AnalyticsHyracksException: CBAS0029: Connect link failed {"kafka_link":"Internal error"}
      	at com.couchbase.analytics.lang.ConnectLinkStatement.doHandle(ConnectLinkStatement.java:762) ~[columnar-connector.jar:1.0.0-2230]
      	at com.couchbase.analytics.lang.ConnectionStatement.handle(ConnectionStatement.java:111) ~[columnar-connector.jar:1.0.0-2230]
      	at org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:553) ~[asterix-app.jar:1.0.0-2230]
      	at org.apache.asterix.app.message.ExecuteStatementRequestMessage.handle(ExecuteStatementRequestMessage.java:181) ~[asterix-app.jar:1.0.0-2230]
      	at org.apache.asterix.messaging.CCMessageBroker.receivedMessage(CCMessageBroker.java:64) ~[asterix-app.jar:1.0.0-2230]
      	at org.apache.hyracks.control.cc.work.ApplicationMessageWork.lambda$notifyMessageBroker$0(ApplicationMessageWork.java:74) ~[hyracks-control-cc.jar:1.0.0-2230]
      	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
      	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
      	at java.base/java.lang.Thread.run(Thread.java:840) [?:?]
      	Suppressed: org.apache.hyracks.api.exceptions.HyracksDataException: java.lang.IllegalStateException: Irregular partition distribution detected for link [kafka_link]
      		at org.apache.hyracks.api.exceptions.HyracksDataException.create(HyracksDataException.java:49) ~[hyracks-api.jar:1.0.0-2230]
      		at com.couchbase.analytics.lang.ConnectLinkStatement.doConnect(ConnectLinkStatement.java:1207) ~[columnar-connector.jar:1.0.0-2230]
      		at com.couchbase.analytics.metadata.KafkaEventsListener.doKafkaConnect(KafkaEventsListener.java:106) ~[columnar-connector.jar:1.0.0-2230]
      		at com.couchbase.analytics.metadata.KafkaEventsListener.compileAndStartJob(KafkaEventsListener.java:84) ~[columnar-connector.jar:1.0.0-2230]
      		at org.apache.asterix.app.active.ActiveEntityEventsListener.doStart(ActiveEntityEventsListener.java:403) ~[asterix-app.jar:1.0.0-2230]
      		at org.apache.asterix.app.active.ActiveEntityEventsListener.start(ActiveEntityEventsListener.java:390) ~[asterix-app.jar:1.0.0-2230]
      		at com.couchbase.analytics.metadata.KafkaEventsListener.start(KafkaEventsListener.java:102) ~[columnar-connector.jar:1.0.0-2230]
      		at com.couchbase.analytics.lang.ConnectLinkStatement.connect(ConnectLinkStatement.java:1048) ~[columnar-connector.jar:1.0.0-2230]
      		at com.couchbase.analytics.lang.ConnectLinkStatement.handleKafkaLinkConnection(ConnectLinkStatement.java:834) ~[columnar-connector.jar:1.0.0-2230]
      		at com.couchbase.analytics.lang.ConnectLinkStatement.connectLink(ConnectLinkStatement.java:806) ~[columnar-connector.jar:1.0.0-2230]
      		at com.couchbase.analytics.lang.ConnectLinkStatement.doHandle(ConnectLinkStatement.java:736) ~[columnar-connector.jar:1.0.0-2230]
      		at com.couchbase.analytics.lang.ConnectionStatement.handle(ConnectionStatement.java:111) ~[columnar-connector.jar:1.0.0-2230]
      		at org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:553) ~[asterix-app.jar:1.0.0-2230]
      		at org.apache.asterix.app.message.ExecuteStatementRequestMessage.handle(ExecuteStatementRequestMessage.java:181) ~[asterix-app.jar:1.0.0-2230]
      		at org.apache.asterix.messaging.CCMessageBroker.receivedMessage(CCMessageBroker.java:64) ~[asterix-app.jar:1.0.0-2230]
      		at org.apache.hyracks.control.cc.work.ApplicationMessageWork.lambda$notifyMessageBroker$0(ApplicationMessageWork.java:74) ~[hyracks-control-cc.jar:1.0.0-2230]
      		at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
      		at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
      		at java.base/java.lang.Thread.run(Thread.java:840) [?:?]
      	Caused by: java.lang.IllegalStateException: Irregular partition distribution detected for link [kafka_link]
      		at com.couchbase.analytics.adapter.TopicConnectorFactory.distributePartitions(TopicConnectorFactory.java:195) ~[columnar-connector.jar:1.0.0-2230]
      		at com.couchbase.analytics.adapter.TopicConnectorFactory.configure(TopicConnectorFactory.java:136) ~[columnar-connector.jar:1.0.0-2230]
      		at org.apache.asterix.external.adapter.factory.GenericAdapterFactory.configure(GenericAdapterFactory.java:144) ~[asterix-external-data.jar:1.0.0-2230]
      		at com.couchbase.analytics.adapter.AnalyticsAdapterFactory.configure(AnalyticsAdapterFactory.java:66) ~[columnar-connector.jar:1.0.0-2230]
      		at org.apache.asterix.external.provider.AdapterFactoryProvider.getAdapterFactory(AdapterFactoryProvider.java:53) ~[asterix-external-data.jar:1.0.0-2230]
      		at com.couchbase.analytics.adapter.TopicConnectorFactory.createAdapterFactory(TopicConnectorFactory.java:178) ~[columnar-connector.jar:1.0.0-2230]
      		at com.couchbase.analytics.lang.ConnectLinkStatement.combine(ConnectLinkStatement.java:639) ~[columnar-connector.jar:1.0.0-2230]
      		at com.couchbase.analytics.lang.ConnectLinkStatement.doConnect(ConnectLinkStatement.java:1200) ~[columnar-connector.jar:1.0.0-2230]
      

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            sujay.gad Sujay Gad
            sujay.gad Sujay Gad
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty