Details
-
Bug
-
Resolution: Duplicate
-
Major
-
2.0
-
Security Level: Public
-
None
-
Four node cluster. Each node: 32 GB of RAM, 8 Xeon cores, RAID0 of 4 SSD as a disk storage.
RAM Quota 25720 MB, one bucket with 1 replica.
Description
Using YCSB we tried to load into this cluster the 500M of 120 byte records.
The inserts came on a high rate (more than 200k per sec) while there is enough RAM. Then the insert rate dramatically decreased, the client got Temporary failure errors. This lasted for some hours and then, after inserting about 200M of objects the ejections, creation of new objects and disk writes stopped.
We tried to limit the insert rate with 10k per second. This value is lower than the drain rate observed on the initial phase of the experiment (when there is enough RAM). But the issue is repeated after inserting of 400M of objects. The drain rate came to zero, ejections and creations stopped.