Details
-
Bug
-
Resolution: Fixed
-
Test Blocker
-
Columnar 1.0.0
-
Columnar Edition 1.0.0 build 2190
-
Untriaged
-
-
0
-
Unknown
Description
- Create a mongo db and 5 collections
- Create kafka topics with 32 partitions on 5 mongo collections
- Load 10M items in each mongo collection
- Deploy a 4 node 16C, 64G colunar cluster.
- Create 20 cbas kafka collections. Ingestion took 7 hours
- Create another 20 cbas kafka collections. Ingestion is super slow and finally hung
Attachments
For Gerrit Dashboard: MB-62568 | ||||||
---|---|---|---|---|---|---|
# | Subject | Branch | Project | Status | CR | V |
212696,6 | MB-62568, MB-61350: Minimize number of threads for kafka ingestion job | master | cbas-core | Status: MERGED | +2 | +1 |