Uploaded image for project: 'Couchbase Spark Connector'
  1. Couchbase Spark Connector
  2. SPARKC-96

Provide more fault-tolerant batch mutations

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Fixed
    • Major
    • 2.3.0
    • None
    • None
    • None
    • 1

    Description

      Currently the Spark connector tries to do all mutations concurrently, which doesn't scale excellently.  It should be possible to batch operations.  (Update: actually it does do batches of 128 operations, per executor.)

      The specifics of this ticket are being left vague until I can talk with Raymundo Flores and make sure we nail the customer's requirements.

      Attachments

        Activity

          People

            graham.pople Graham Pople
            graham.pople Graham Pople
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              PagerDuty