Details
-
Improvement
-
Resolution: Fixed
-
Major
-
None
-
None
-
None
-
1
Description
Currently the Spark connector tries to do all mutations concurrently, which doesn't scale excellently. It should be possible to batch operations. (Update: actually it does do batches of 128 operations, per executor.)
The specifics of this ticket are being left vague until I can talk with Raymundo Flores and make sure we nail the customer's requirements.
Attachments
For Gerrit Dashboard: SPARKC-96 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
109572,7 | SPARKC-96: Provide more fault-tolerant batch mutations | master | couchbase-spark-connector | Status: MERGED | +2 | +1 |
110130,1 | SPARKC-96: Provide more fault-tolerant batch mutations | release/2.2 | couchbase-spark-connector | Status: ABANDONED | 0 | 0 |