Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-62568

Ingestion from kafka links is extremely slow and finally hung at a point.

    XMLWordPrintable

Details

    Description

      1. Create a mongo db and 5 collections
      2. Create kafka topics with 32 partitions on 5 mongo collections
      3. Load 10M items in each mongo collection
      4. Deploy a 4 node 16C, 64G colunar cluster.
      5. Create 20 cbas kafka collections. Ingestion took 7 hours
      6. Create another 20 cbas kafka collections. Ingestion is super slow and finally hung

      Attachments

        For Gerrit Dashboard: MB-62568
        # Subject Branch Project Status CR V
        212696,6 MB-62568, MB-61350: Minimize number of threads for kafka ingestion job master cbas-core Status: MERGED +2 +1

        Activity

          People

            sujay.gad Sujay Gad
            ritesh.agarwal Ritesh Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty