Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-61851

Internal error due to parquet parsing while copying external dataset on parquet format to KV

    XMLWordPrintable

Details

    Description

      Steps to reproduce -

      1. Create a 2 node cluster with compute storage separation.
      2. Create an external link to S3 bucket.
      3. Create 5 external collections, one for each file format.
      4. Verify query on external collections are working. (Ran count, which gave expected result)
      5. Now run copy to KV as below -
        1. COPY Default.Default.Z567bNZ6HLgYud2HD5IXwKfh5kcB94 as c TO copy_to_kv._default._default AT Default.Default.yjwYpuHwqeZhi5ty0B3zt9Dh7WSrHQZ KEY AUTOGENERATED
      2. Internal error is seen.
      3. Also now running count query on Default.Default.Z567bNZ6HLgYud2HD5IXwKfh5kcB94 gives wrong result. Expected - 7800000 Actual -3960000

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. MB-62208 Internal error while querying external collection created on parquet format

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. MB-61860 Internal Error while copy from s3 and file format is parquet

          • Major - Major loss of function.
          • Closed
          links to

          Web Link *DB review

          Activity

            People

              abhay.aggrawal Abhay Aggrawal
              umang.agrawal Umang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                PagerDuty