Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-47858

Parallel read of Parquet files from S3 does not match the number parititons

    XMLWordPrintable

Details

    • Bug
    • Resolution: Fixed
    • Major
    • 7.1.0
    • 7.1.0
    • analytics
    • Untriaged
    • 1
    • Unknown
    • CX Sprint 259

    Description

      Currently, the number of parallel scan matches the number of iodevides (i.e., partitions) even for external datasets. When a cluster is configured with a high number of partitions, the parallel scan when reading Parquet files from S3 is stagnated to a smaller number of threads.

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            umang.agrawal Umang
            wail.alkowaileet Wail Alkowaileet
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty