Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-42037

Internal error is raised while reconnecting remote link if remote server is shutdown

    XMLWordPrintable

    Details

    • Triage:
      Untriaged
    • Operating System:
      Centos 64-bit
    • Story Points:
      1
    • Is this a Regression?:
      No
    • Sprint:
      CX Sprint 221, CX Sprint 222, CX Sprint 223

      Description

      Steps to reproduce-

      1) Load travel-sample bucket in remote cluster.

      2) Create remote link from webUI.

      3) Create dataset on `travel-sample` bucket in remote cluster.

      4) Connect remote link.

      5) Bring down the remote server.

      6) Disconnect remote link.

      7) Try reconnecting remote link.

      Following error is raised - 

      [
        {
          "code": 22001,
          "msg": "Connect link failed {\"Default.abc.travel-sample\" : \"Internal error\"}",
          "query_from_user": "connect link abc;"
        }
      ]
      

      2020-10-17T12:33:28.479+00:00 WARN CBAS.apache.asterix [Executor-6:ClusterController] CBAS0029: Connect link failed {"Default.abc.travel-sample" : "Internal error"}
      com.couchbase.analytics.common.exceptions.AnalyticsHyracksException: CBAS0029: Connect link failed {"Default.abc.travel-sample" : "Internal error"}
              at com.couchbase.analytics.lang.ConnectLinkStatement.doHandle(ConnectLinkStatement.java:371) ~[cbas-connector.jar:6.6.1-9124]
              at com.couchbase.analytics.lang.ConnectionStatement.handle(ConnectionStatement.java:65) ~[cbas-connector.jar:6.6.1-9124]
              at org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:430) ~[asterix-app.jar:6.6.1-9124]
              at org.apache.asterix.app.message.ExecuteStatementRequestMessage.handle(ExecuteStatementRequestMessage.java:155) ~[asterix-app.jar:6.6.1-9124]
              at org.apache.asterix.messaging.CCMessageBroker.receivedMessage(CCMessageBroker.java:64) ~[asterix-app.jar:6.6.1-9124]
              at org.apache.hyracks.control.cc.work.ApplicationMessageWork.lambda$notifyMessageBroker$0(ApplicationMessageWork.java:68) ~[hyracks-control-cc.jar:6.6.1-9124]
              at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [?:?]
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [?:?]
              at java.lang.Thread.run(Unknown Source) [?:?]
      2020-10-17T12:33:28.482+00:00 INFO CBAS.messaging.NCMessageBroker [Worker:c69e9d555004ff3faec46e4bb11b1d44] Received message: ExecuteStatementResponseMessage(id=134): 0 characters
      2020-10-17T12:33:28.482+00:00 WARN CBAS.server.QueryServiceServlet [HttpExecutor(port:8095)-0] handleException: unexpected exception CBAS0029: Connect link failed {"Default.abc.travel-sample" : "Internal error"}: <ud>{"host":"10.112.205.102:8091","path":"/query/service","statement":"connect link abc;","pretty":false,"mode":"immediate","clientContextID":"54df2870-30c9-4665-9aae-e55895f64376","format":"CLEAN_JSON","timeout":9223372036854775807,"maxResultReads":1,"planFormat":"JSON","expressionTree":false,"rewrittenExpressionTree":false,"logicalPlan":false,"optimizedLogicalPlan":true,"job":false,"profile":"counts","signature":true,"multiStatement":false,"parseOnly":false,"readOnly":false,"maxWarnings":10,"scanConsistency":"not_bounded","scanWait":null}</ud>
      com.couchbase.analytics.common.exceptions.AnalyticsHyracksException: CBAS0029: Connect link failed {"Default.abc.travel-sample" : "Internal error"}
              at com.couchbase.analytics.lang.ConnectLinkStatement.doHandle(ConnectLinkStatement.java:371) ~[cbas-connector.jar:6.6.1-9124]
              at com.couchbase.analytics.lang.ConnectionStatement.handle(ConnectionStatement.java:65) ~[cbas-connector.jar:6.6.1-9124]
              at org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:430) ~[asterix-app.jar:6.6.1-9124]
              at org.apache.asterix.app.message.ExecuteStatementRequestMessage.handle(ExecuteStatementRequestMessage.java:155) ~[asterix-app.jar:6.6.1-9124]
              at org.apache.asterix.messaging.CCMessageBroker.receivedMessage(CCMessageBroker.java:64) ~[asterix-app.jar:6.6.1-9124]
              at org.apache.hyracks.control.cc.work.ApplicationMessageWork.lambda$notifyMessageBroker$0(ApplicationMessageWork.java:68) ~[hyracks-control-cc.jar:6.6.1-9124]
              at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [?:?]
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [?:?]
              at java.lang.Thread.run(Unknown Source) [?:?]
      

        Attachments

          Issue Links

          For Gerrit Dashboard: MB-42037
          # Subject Branch Project Status CR V

            Activity

            Hide
            build-team Couchbase Build Team added a comment -

            Build couchbase-server-7.0.0-3636 contains cbas-core commit de25d8f with commit message:
            MB-42037: Properly handle failure when remote server is down

            Show
            build-team Couchbase Build Team added a comment - Build couchbase-server-7.0.0-3636 contains cbas-core commit de25d8f with commit message: MB-42037 : Properly handle failure when remote server is down
            Hide
            build-team Couchbase Build Team added a comment -

            Build couchbase-server-6.6.2-9599 contains cbas-core commit 8c33722 with commit message:
            MB-42037: don't encapsulate product exceptions

            Show
            build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.2-9599 contains cbas-core commit 8c33722 with commit message: MB-42037 : don't encapsulate product exceptions
            Hide
            build-team Couchbase Build Team added a comment -

            Build couchbase-server-6.6.2-9599 contains cbas-core commit ad5211b with commit message:
            MB-42037: Rethrow error if it is already handled properly

            Show
            build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.2-9599 contains cbas-core commit ad5211b with commit message: MB-42037 : Rethrow error if it is already handled properly
            Hide
            build-team Couchbase Build Team added a comment -

            Build couchbase-server-6.6.2-9599 contains cbas-core commit 99142ff with commit message:
            MB-42037: Properly display error messages from remote clusters

            Show
            build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.2-9599 contains cbas-core commit 99142ff with commit message: MB-42037 : Properly display error messages from remote clusters
            Hide
            build-team Couchbase Build Team added a comment -

            Build couchbase-server-6.6.2-9599 contains cbas-core commit de25d8f with commit message:
            MB-42037: Properly handle failure when remote server is down

            Show
            build-team Couchbase Build Team added a comment - Build couchbase-server-6.6.2-9599 contains cbas-core commit de25d8f with commit message: MB-42037 : Properly handle failure when remote server is down

              People

              Assignee:
              umang.agrawal Umang
              Reporter:
              umang.agrawal Umang
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Gerrit Reviews

                  There are no open Gerrit changes

                    PagerDuty