Details
-
Improvement
-
Resolution: Fixed
-
Major
-
None
-
None
-
None
-
1
Description
Currently the Spark connector tries to do all mutations concurrently, which doesn't scale excellently. It should be possible to batch operations. (Update: actually it does do batches of 128 operations, per executor.)
The specifics of this ticket are being left vague until I can talk with Raymundo Flores and make sure we nail the customer's requirements.