Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-31409

Intermittent Connect link Local: Fails on IPv6 machines

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Critical
    • 6.0.0
    • 6.0.0
    • cbauth
    • Enterprise Edition 6.0.0 build 1665 ‧ IPv6

    Description

      Setup: 2 Node cluster 1KV and 1 CBAS

      1. load travel-sample bucket
      2. create dataset on cbas
      3. connect link Local;

      #3 fails with error below - analytics_info.log

      2018-09-26T10:07:04.696Z WARN CBAS.conductor.DcpChannel [QueryTranslator] Connection failed2018-09-26T10:07:04.696Z WARN CBAS.conductor.DcpChannel [QueryTranslator] Connection failedjava.nio.channels.ClosedChannelException: null at com.couchbase.client.deps.io.netty.channel.AbstractChannel$AbstractUnsafe.ensureOpen(...)(Unknown Source) ~[core-io-1.6.1.jar:?]2018-09-26T10:07:04.900Z WARN CBAS.conductor.DcpChannel [QueryTranslator] Connection failedjava.nio.channels.ClosedChannelException: null
      

      org.apache.hyracks.api.exceptions.HyracksDataException: java.nio.channels.ClosedChannelExceptionorg.apache.hyracks.api.exceptions.HyracksDataException: java.nio.channels.ClosedChannelException at org.apache.hyracks.api.exceptions.HyracksDataException.create(HyracksDataException.java:51) ~[hyracks-api.jar:6.0.0-1665] at org.apache.hyracks.api.util.InvokeUtil.retryUntilSuccessOrExhausted(InvokeUtil.java:282) ~[hyracks-api.jar:6.0.0-1665] at com.couchbase.analytics.util.DcpUtil.fetchCurrentState(DcpUtil.java:96) ~[cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.adapter.CouchbaseConnectorFactory.calculateStartingPoint(CouchbaseConnectorFactory.java:267) ~[cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.runtime.BucketOperatorDescriptor.calculateStartingPoint(BucketOperatorDescriptor.java:75) ~[cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.lang.ConnectLinkStatement.combine(ConnectLinkStatement.java:154) ~[cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.lang.ConnectLinkStatement.doConnect(ConnectLinkStatement.java:514) [cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.metadata.BucketEventsListener.doConnect(BucketEventsListener.java:199) [cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.metadata.BucketEventsListener.compileAndStartJob(BucketEventsListener.java:177) [cbas-connector.jar:6.0.0-1665] at org.apache.asterix.app.active.ActiveEntityEventsListener.doStart(ActiveEntityEventsListener.java:396) [asterix-app.jar:6.0.0-1665] at org.apache.asterix.app.active.ActiveEntityEventsListener.start(ActiveEntityEventsListener.java:383) [asterix-app.jar:6.0.0-1665] at com.couchbase.analytics.lang.ConnectLinkStatement.connect(ConnectLinkStatement.java:428) [cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.lang.ConnectLinkStatement.connectLink(ConnectLinkStatement.java:371) [cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.lang.ConnectLinkStatement.doHandle(ConnectLinkStatement.java:347) [cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.lang.ConnectionStatement.handle(ConnectionStatement.java:56) [cbas-connector.jar:6.0.0-1665] at org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:411) [asterix-app.jar:6.0.0-1665] at org.apache.asterix.app.message.ExecuteStatementRequestMessage.handle(ExecuteStatementRequestMessage.java:136) [asterix-app.jar:6.0.0-1665] at org.apache.asterix.messaging.CCMessageBroker.receivedMessage(CCMessageBroker.java:66) [asterix-app.jar:6.0.0-1665] at org.apache.hyracks.control.cc.work.ApplicationMessageWork$1.run(ApplicationMessageWork.java:55) [hyracks-control-cc.jar:6.0.0-1665] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_181] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_181] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]Caused by: java.nio.channels.ClosedChannelException at com.couchbase.client.deps.io.netty.channel.AbstractChannel$AbstractUnsafe.ensureOpen(...)(Unknown Source) ~[core-io-1.6.1.jar:?]2018-09-26T09:34:10.435Z ERRO CBAS.active.ActiveEntityEventsListener [QueryTranslator] Failed to start the entity Default.Local.travel-sample(CouchbaseMetadataExtension)org.apache.hyracks.api.exceptions.HyracksDataException: java.nio.channels.ClosedChannelException at org.apache.hyracks.api.exceptions.HyracksDataException.create(HyracksDataException.java:51) ~[hyracks-api.jar:6.0.0-1665] at org.apache.hyracks.api.util.InvokeUtil.retryUntilSuccessOrExhausted(InvokeUtil.java:282) ~[hyracks-api.jar:6.0.0-1665] at com.couchbase.analytics.util.DcpUtil.fetchCurrentState(DcpUtil.java:96) ~[cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.adapter.CouchbaseConnectorFactory.calculateStartingPoint(CouchbaseConnectorFactory.java:267) ~[cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.runtime.BucketOperatorDescriptor.calculateStartingPoint(BucketOperatorDescriptor.java:75) ~[cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.lang.ConnectLinkStatement.combine(ConnectLinkStatement.java:154) ~[cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.lang.ConnectLinkStatement.doConnect(ConnectLinkStatement.java:514) ~[cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.metadata.BucketEventsListener.doConnect(BucketEventsListener.java:199) ~[cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.metadata.BucketEventsListener.compileAndStartJob(BucketEventsListener.java:177) ~[cbas-connector.jar:6.0.0-1665] at org.apache.asterix.app.active.ActiveEntityEventsListener.doStart(ActiveEntityEventsListener.java:396) ~[asterix-app.jar:6.0.0-1665] at org.apache.asterix.app.active.ActiveEntityEventsListener.start(ActiveEntityEventsListener.java:383) [asterix-app.jar:6.0.0-1665] at com.couchbase.analytics.lang.ConnectLinkStatement.connect(ConnectLinkStatement.java:428) [cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.lang.ConnectLinkStatement.connectLink(ConnectLinkStatement.java:371) [cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.lang.ConnectLinkStatement.doHandle(ConnectLinkStatement.java:347) [cbas-connector.jar:6.0.0-1665] at com.couchbase.analytics.lang.ConnectionStatement.handle(ConnectionStatement.java:56) [cbas-connector.jar:6.0.0-1665] at org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:411) [asterix-app.jar:6.0.0-1665] at org.apache.asterix.app.message.ExecuteStatementRequestMessage.handle(ExecuteStatementRequestMessage.java:136) [asterix-app.jar:6.0.0-1665] at org.apache.asterix.messaging.CCMessageBroker.receivedMessage(CCMessageBroker.java:66) [asterix-app.jar:6.0.0-1665] at org.apache.hyracks.control.cc.work.ApplicationMessageWork$1.run(ApplicationMessageWork.java:55) [hyracks-control-cc.jar:6.0.0-1665] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_181] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_181] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
      

      Note: We do have test where connect link worked on this same build.

      Attachments

        1. cbas.zip
          3.18 MB
        2. kv.zip
          5.20 MB

        Issue Links

          For Gerrit Dashboard: MB-31409
          # Subject Branch Project Status CR V

          Activity

            People

              tanzeem.ahmed Tanzeem Ahmed (Inactive)
              tanzeem.ahmed Tanzeem Ahmed (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty