Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-47058

Ingestion restarted while ingesting 15TB data from remote cluster

    XMLWordPrintable

Details

    Description

      Test Scenario –
      Ingest approximately 15TB (approx) of data from Remote KV cluster to Local CBAS cluster. 

      Infra –

      Remote KV cluster:
      Number of nodes – 20
      RAM allocated to KV per Node – 22.2 GB
      Disk allocated per node – 25 GB
      Number of buckets – 1
      Number of scopes/bucket – 1
      Number of collections/scope – 1
      Number of items – 130,259,631
      Total size of the data – 77 GB
      Local CBAS cluster:
      Number of nodes – 4
      RAM allocated to CBAS per Node – 223 GB
      Disk allocated per node – 10 TB

      Test Setup-
       

      Number of dataverses – 10
      Number of Remote links – 25
      Number of datasets – 200 (8 dataset per link)

      Observations –

      Ingestion progress was at 20% approx across all datasets , but then it dropped to 11% approx across all datasets.

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. MB-47057 Slow ingestion rate when ingesting data from remote cluster

          • Major - Major loss of function.
          • Closed
          No reviews matched the request. Check your Options in the drop-down menu of this sections header.

          Activity

            People

              umang.agrawal Umang
              umang.agrawal Umang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Gerrit Reviews

                  There are no open Gerrit changes

                  PagerDuty