Details
-
Task
-
Resolution: Done
-
Major
-
Columnar 1.0.0
-
0
Description
CASE A
- Load 50 million documents in Mongo collection.
- Create Confluent Kafka topic against the Mongo collection created in previous step.
- Deploy a 4 node Columnar instance with 8vCPUs and 64GB memory quota.
- Create pair of Kafka links and 5 collections on each of the 2 links.
- Connect both links.
- While data ingestion is happening perform multiple scaling operations in a loop.
Logs - https://supportal.couchbase.com/snapshot/0bd616af280a305a6bac473e47024bd3::0
CASE B
- Load 50 million documents in Mongo collection.
- Create Confluent Kafka topic against the Mongo collection created in previous step.
- Deploy a 4 node Columnar instance with 8vCPUs and 64GB memory quota.
- Create 4 Kafka links and 10 collections on each of the 4 links.
- Connect all 4 links.
- While data ingestion is happening perform multiple scaling operations in a loop.
Logs - https://supportal.couchbase.com/snapshot/1d7b4c4370cbb58bd180968aeab5cb04::0
Observation
Data ingestion completed faster in second case which is weird. Raising this ticket to analyse this descrepancy.