Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-61604

Query on External Dataset didn't work on parquet

Details

    • Bug
    • Resolution: Unresolved
    • Major
    • Goldfish GA
    • Goldfish GA
    • analytics
    • Untriaged
    • 0
    • Unknown
    • Analytics Sprint 42

    Description

      1. Created an external dataset with the attached parquet files.

      CREATE EXTERNAL DATASET dataset1 ON container AT s3link USING "perftest1/parquet/" WITH {{ "format": "parquet", "include": "*.parquet" }} ;

       

      2. Ran this query.

      select field0h0[0].field0h2[0][0],field0h0[1].field3h2[1],field0h0[1].field0h2[1][1] from dataset1 order by id limit 10;
      

      Throws this error

      2024-04-22T18:05:59.105+05:30 ERRO CBAS.apache.asterix [Executor-25:ClusterController] Unexpected exception
      java.lang.IllegalStateException: Node ANY is not a child
      	at org.apache.asterix.optimizer.rules.pushdown.schema.ArrayExpectedSchemaNode.replaceChild(ArrayExpectedSchemaNode.java:53) ~[asterix-algebra.jar:1.0.0-0000]
      	at org.apache.asterix.optimizer.rules.pushdown.schema.AnyExpectedSchemaNode.replaceIfNeeded(AnyExpectedSchemaNode.java:62) ~[asterix-algebra.jar:1.0.0-0000]
      	at org.apache.asterix.optimizer.rules.pushdown.schema.ExpectedSchemaBuilder.changeNodeForVariable(ExpectedSchemaBuilder.java:162) ~[asterix-algebra.jar:1.0.0-0000]
      	at org.apache.asterix.optimizer.rules.pushdown.schema.ExpectedSchemaBuilder.buildNestedNode(ExpectedSchemaBuilder.java:120) ~[asterix-algebra.jar:1.0.0-0000]
      	at org.apache.asterix.optimizer.rules.pushdown.schema.ExpectedSchemaBuilder.setSchemaFromExpression(ExpectedSchemaBuilder.java:60) ~[asterix-algebra.jar:1.0.0-0000]
      	at org.apache.asterix.optimizer.rules.pushdown.visitor.ExpressionValueAccessPushdownVisitor.isSuccessfullyPushedDown(ExpressionValueAccessPushdownVisitor.java:122) ~[asterix-algebra.jar:1.0.0-0000]
      	at org.apache.asterix.optimizer.rules.pushdown.visitor.ExpressionValueAccessPushdownVisitor.transform(ExpressionValueAccessPushdownVisitor.java:52) ~[asterix-algebra.jar:1.0.0-0000]
      	at org.apache.asterix.optimizer.rules.pushdown.processor.ColumnValueAccessPushdownProcessor.pushdownFieldAccess(ColumnValueAccessPushdownProcessor.java:97) ~[asterix-algebra.jar:1.0.0-0000]
      	at org.apache.asterix.optimizer.rules.pushdown.processor.ColumnValueAccessPushdownProcessor.pushdownFieldAccess(ColumnValueAccessPushdownProcessor.java:109) ~[asterix-algebra.jar:1.0.0-0000]
      	at org.apache.asterix.optimizer.rules.pushdown.processor.ColumnValueAccessPushdownProcessor.pushdownFieldAccess(ColumnValueAccessPushdownProcessor.java:109) ~[asterix-algebra.jar:1.0.0-0000]
      	at org.apache.asterix.optimizer.rules.pushdown.processor.ColumnValueAccessPushdownProcessor.pushdownFieldAccessForDataset(ColumnValueAccessPushdownProcessor.java:81) ~[asterix-algebra.jar:1.0.0-0000]
      	at org.apache.asterix.optimizer.rules.pushdown.processor.ColumnValueAccessPushdownProcessor.process(ColumnValueAccessPushdownProcessor.java:62) ~[asterix-algebra.jar:1.0.0-0000]
      	at org.apache.asterix.optimizer.rules.pushdown.PushdownProcessorsExecutor.execute(PushdownProcessorsExecutor.java:63) ~[asterix-algebra.jar:1.0.0-0000]
      	at org.apache.asterix.optimizer.rules.PushValueAccessAndFilterDownRule.rewritePre(PushValueAccessAndFilterDownRule.java:102) ~[asterix-algebra.jar:1.0.0-0000]
      	at org.apache.hyracks.algebricks.core.rewriter.base.AbstractRuleController.rewriteOperatorRef(AbstractRuleController.java:79) ~[algebricks-core.jar:1.0.0-0000]
      	at org.apache.hyracks.algebricks.compiler.rewriter.rulecontrollers.SequentialOnceRuleController.rewriteWithRuleCollection(SequentialOnceRuleController.java:43) ~[algebricks-compiler.jar:1.0.0-0000]
      	at org.apache.hyracks.algebricks.core.rewriter.base.HeuristicOptimizer.runOptimizationSets(HeuristicOptimizer.java:92) ~[algebricks-core.jar:1.0.0-0000]
      	at org.apache.hyracks.algebricks.core.rewriter.base.HeuristicOptimizer.runPhysicalOptimizationSets(HeuristicOptimizer.java:122) ~[algebricks-core.jar:1.0.0-0000]
      	at org.apache.hyracks.algebricks.core.rewriter.base.HeuristicOptimizer.optimize(HeuristicOptimizer.java:66) ~[algebricks-core.jar:1.0.0-0000]
      	at org.apache.hyracks.algebricks.compiler.api.HeuristicCompilerFactoryBuilder$CompilerImpl.optimize(HeuristicCompilerFactoryBuilder.java:165) ~[algebricks-compiler.jar:1.0.0-0000]
      	at org.apache.asterix.api.common.APIFramework.compileQuery(APIFramework.java:289) ~[asterix-app.jar:1.0.0-0000]
      	at org.apache.asterix.app.translator.QueryTranslator.rewriteCompileQuery(QueryTranslator.java:4290) ~[asterix-app.jar:1.0.0-0000]
      	at org.apache.asterix.app.translator.QueryTranslator.lambda$handleQuery$3(QueryTranslator.java:5248) ~[asterix-app.jar:1.0.0-0000]
      	at org.apache.asterix.app.translator.QueryTranslator.createAndRunJob(QueryTranslator.java:5396) ~[asterix-app.jar:1.0.0-0000]
      	at org.apache.asterix.app.translator.QueryTranslator.deliverResult(QueryTranslator.java:5294) ~[asterix-app.jar:1.0.0-0000]
      	at org.apache.asterix.app.translator.QueryTranslator.handleQuery(QueryTranslator.java:5264) ~[asterix-app.jar:1.0.0-0000]
      	at org.apache.asterix.app.translator.QueryTranslator.compileAndExecute(QueryTranslator.java:533) ~[asterix-app.jar:1.0.0-0000]
      	at org.apache.asterix.app.message.ExecuteStatementRequestMessage.handle(ExecuteStatementRequestMessage.java:181) ~[asterix-app.jar:1.0.0-0000]
      	at org.apache.asterix.messaging.CCMessageBroker.receivedMessage(CCMessageBroker.java:64) ~[asterix-app.jar:1.0.0-0000]
      	at org.apache.hyracks.control.cc.work.ApplicationMessageWork.lambda$notifyMessageBroker$0(ApplicationMessageWork.java:74) ~[hyracks-control-cc.jar:1.0.0-0000]
      	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
      	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
      	at java.base/java.lang.Thread.run(Thread.java:840) [?:?]

       

       

      Attachments

        Issue Links

          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              wail.alkowaileet Wail Alkowaileet
              preetham.poluparthi Preetham Poluparthi
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty