Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-47800

Analytics dataset creation is taking almost 13-15 mins

    XMLWordPrintable

Details

    • Bug
    • Resolution: Cannot Reproduce
    • Major
    • 7.1.0
    • 7.1.0
    • analytics
    • Enterprise Edition 7.1.0 build 1117

    Description

      Approach is under discussion

      I am testing ingesting 50TB of data (TPCH workload) into CBAS. I have around 520 datasets as of now out of which ingestion on 500 datasets (almost 14TB data) have already been completed. Now when I am trying to create more dataset, each dataset creation is taking almost 13-15 mins.

      KV cluster - 

      No. of nodes - 11

      Memory Per Node - 19.5 GB

      Disk Space per node - 125 GB

      Total data in KV bucket - 260 GB (only 1 bucket is created)

      http://172.23.107.107:8091/ui/index.html#/buckets?commonBucket=bench&scenarioZoom=minute&scenario=vjpqrvx0q&openedBucket=bench

       

      CBAS cluster - 

      No. of nodes - 6

      Memory per node - 200 GB

      Disk Space per node - 10 TB

      Total data ingested till now - 16.2 TB

      Total number of datasets created till now - 540

      http://172.23.110.69:8091/ui/index.html#/cbas/workbench?commonBucket=beer-sample&scenarioZoom=minute&scenario=dktpgxlbb

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            umang.agrawal Umang
            umang.agrawal Umang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty