Uploaded image for project: 'Couchbase Server'
  1. Couchbase Server
  2. MB-7463

Not possible to insert data much larger than memory

    XMLWordPrintable

Details

    • Bug
    • Resolution: Duplicate
    • Major
    • 2.1.0
    • 2.0
    • couchbase-bucket
    • Security Level: Public
    • None
    • Four node cluster. Each node: 32 GB of RAM, 8 Xeon cores, RAID0 of 4 SSD as a disk storage.
      RAM Quota 25720 MB, one bucket with 1 replica.

    Description

      Using YCSB we tried to load into this cluster the 500M of 120 byte records.

      The inserts came on a high rate (more than 200k per sec) while there is enough RAM. Then the insert rate dramatically decreased, the client got Temporary failure errors. This lasted for some hours and then, after inserting about 200M of objects the ejections, creation of new objects and disk writes stopped.

      We tried to limit the insert rate with 10k per second. This value is lower than the drain rate observed on the initial phase of the experiment (when there is enough RAM). But the issue is repeated after inserting of 400M of objects. The drain rate came to zero, ejections and creations stopped.

      Attachments

        1. mamory_usage.png
          235 kB
        2. failure.png
          549 kB
        3. drain_rate_with_unlimited_inserts.png
          390 kB
        4. drain_rate_with_10k_inserts.png
          556 kB
        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            abhinav Abhi Dangeti
            dnelubin Denis Nelubin
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Gerrit Reviews

                There are no open Gerrit changes

                PagerDuty