Details
-
Task
-
Resolution: Won't Do
-
Major
-
Cheshire-Cat
-
None
Description
Currently, the creation of the bucket is expected to be done manually before running the loader. The following 2 items need to be implemented for full automation:
- Allow specifying the bucket creation information in the loader, and let the loader create the bucket.
- Enable the option to delete and re-create the bucket on start up (boolean flag).
This will require concurrency control, for when multiple partitions are generated, only the leading partition needs to be in charge of creating the bucket, and the other partitions should halt and resume only after the bucket is created.