Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-58511

Internal error and java.lang.NullPointerException seen after rebalancing-in cbas node

    XMLWordPrintable

Details

    Description

      Steps to reproduce -

      1. Create a 4 node cluster with 2 cbas and 2 KV node.
      2. create a magma bucket and load some data.
      3. create a few datasets on randomly selected collections.
      4. once ingestion in complete, rebalance-in a cbas node.
      5. Internal error and java.lang.NullPointerException is seen.

      2023-09-05T21:46:22.586+05:30 WARN CBAS.server.QueryServiceServlet [HighPriorityHttpExecutor(port:18095)-15] handleException: unexpected exception: <ud>{"host":"172.23.123.16:18091","path":"/query/service","statement":"select meta.* from (SELECT   ds.DataverseName,   ds.DataverseName || '.' || ds.DatasetName AS datasetFullyQualifiedName,   ds.DatasetName AS id,   TRUE AS isDataset,   ds.BucketName AS bucketName,   ds.ScopeName AS scopeName,   ds.CollectionName AS collectionName,   ds.BucketDataverseName as linkDataverseName,   ds.`Filter` AS `filter`,   ds.LinkName,    ds.DatasetType,    ds.ViewDetails,    concat2(', ', (select value FieldName || ' ' || (          CASE WHEN lower(FieldType) = 'int64' THEN 'BIGINT'               ELSE upper(FieldType) END) || (          CASE WHEN NOT IsNullable AND NOT IsMissable THEN ' NOT UNKNOWN'               ELSE '' END)        from t.Derived.Record.Fields)) AS TypeString,  ( SELECT       idx.IndexName,       idx.SearchKey,       idx.SearchKeyType     FROM       Metadata.`Index` AS idx     WHERE idx.IsPrimary = false       AND idx.DatasetName = ds.DatasetName      AND idx.DataverseName = ds.DataverseName) AS indexes,    ds.ExternalDetails.Properties AS externalDetails FROM   Metadata.`Dataset` AS ds left join Metadata.Datatype t on  ds.DataverseName = t.DataverseName and t.DatatypeName = ds.DatatypeName WHERE   (ds.BucketName IS NOT missing OR  ds.DatasetType = 'EXTERNAL' OR ds.DatasetType = 'VIEW')UNION ALL SELECT   dv.DataverseName,   TRUE AS isDataverse,   ( SELECT       l.Name     FROM       Metadata.`Link` AS l     WHERE       l.DataverseName = dv.DataverseName) AS links FROM   Metadata.`Dataverse` AS dv WHERE   dv.DataverseName != 'Metadata' UNION ALL SELECT   DataverseName,   Name,   IsActive,   `Type` as LinkType,   TRUE as isLink FROM   Metadata.`Link`) meta order by     meta.isDataverse desc, meta.isLink desc, meta.DataverseName, meta.LinkName, meta.id;","pretty":false,"mode":"immediate","clientContextID":null,"clientType":"ASTERIX","dataverse":null,"format":"CLEAN_JSON","timeout":9223372036854775807,"maxResultReads":1,"planFormat":"JSON","expressionTree":false,"rewrittenExpressionTree":false,"logicalPlan":false,"optimizedLogicalPlan":false,"job":false,"profile":"counts","signature":true,"multiStatement":false,"parseOnly":false,"readOnly":false,"maxWarnings":0,"sqlCompat":false,"scanConsistency":null,"scanWait":null}</ud>
      java.lang.NullPointerException: null
      2023-09-05T21:46:22.589+05:30 WARN CBAS.servlet.LinkServlet [HttpExecutor(port:9111)-6] unexpected exception processing link request
      java.lang.NullPointerException: null
      2023-09-05T21:46:22.589+05:30 INFO CBAS.server.AbstractServlet [HttpExecutor(port:9111)-6] sendError: status=500 Internal Server Error, message={"errors":[{"code":25000,"msg":"Internal error"}],"status":"errors"}
       
       
       
       
       
       
       
       
      2023-09-05T21:46:54.015+05:30 WARN CBAS.lang.ConnectLinkStatement [Executor-21:ClusterController] Failed to connect bucket { "class" : "Bucket", "dataverse" : "`^Local`", "link" : "Local", "bucket" : "default", "uuid" : "1712d4f09955b006872a4f2fc7a682c3", "running" : true }
      java.lang.NullPointerException: null
      2023-09-05T21:46:54.015+05:30 INFO CBAS.active.RecoveryTask [Executor-21:ClusterController] Attempt to revive Default/Local/default failed
      org.apache.hyracks.api.exceptions.HyracksDataException: java.lang.NullPointerException
      	at org.apache.hyracks.api.exceptions.HyracksDataException.create(HyracksDataException.java:49) ~[hyracks-api-8.0.0-1395.jar:8.0.0-1395]
      	at com.couchbase.analytics.lang.ConnectLinkStatement.doConnect(ConnectLinkStatement.java:799) ~[cbas-connector-8.0.0-1395.jar:8.0.0-1395]
      	at com.couchbase.analytics.metadata.BucketEventsListener.doConnect(BucketEventsListener.java:457) ~[cbas-connector-8.0.0-1395.jar:8.0.0-1395]
      	at com.couchbase.analytics.metadata.BucketEventsListener.compileAndStartJob(BucketEventsListener.java:443) ~[cbas-connector-8.0.0-1395.jar:8.0.0-1395]
      	at org.apache.asterix.app.active.ActiveEntityEventsListener.doStart(ActiveEntityEventsListener.java:411) ~[asterix-app-8.0.0-1395.jar:8.0.0-1395]
      	at org.apache.asterix.app.active.ActiveEntityEventsListener.doRecover(ActiveEntityEventsListener.java:438) ~[asterix-app-8.0.0-1395.jar:8.0.0-1395]
      	at com.couchbase.analytics.metadata.BucketEventsListener.doRecover(BucketEventsListener.java:497) ~[cbas-connector-8.0.0-1395.jar:8.0.0-1395]
      	at org.apache.asterix.app.active.RecoveryTask.doRecover(RecoveryTask.java:142) ~[asterix-app-8.0.0-1395.jar:8.0.0-1395]
      	at org.apache.asterix.app.active.RecoveryTask.lambda$resumeOrRecover$2(RecoveryTask.java:115) ~[asterix-app-8.0.0-1395.jar:8.0.0-1395]
      	at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]
      	at java.lang.Thread.run(Thread.java:833) ~[?:?]
      Caused by: java.lang.NullPointerException 

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            abhay.aggrawal Abhay Aggrawal
            umang.agrawal Umang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty