Improve single node performance tests

The following e-mail discussion describes the desired spec for the tests.

-------
For these tests, lets set the kernel memory to 25GB

We can also avoid the need for fs cache flush loop for couchstore.

–
Thanks,
Sarath

>>
>> Hi Sarath,
>>
>> I should be able to modify the existing single node tests with the new requirements.
>>
>> For this requirement, I have to think about how to make it work. Usually, in our tests, we don't restart couchbase server after loading data.
>>>> Before starting the test phase after overwrite phase, the couchbase server needs to be restart (This allows us to reset stats and capture the aggregate stats for the duration fo the test).
>
> If it makes it easier, you can do a warmup test phase in between.
>
> This is not an immediate need, you can add the node restart later as well.
>
> –
> Thanks,
> Sarath
>
>
>>
>> Thanks,
>> Bo-Chun
>>
>> On 6/24/20, 11:47 PM, "Sarath Lakshman" <sarath@couchbase.com> wrote:
>>
>> Hi Bo-Chun,
>>
>> We would like to add/modify the existing single node tests specs as follows.
>>
>> These tests should be run with 100% cache miss by setting high, low watermarks very low.
>>
>> Except insert only test, other tests should be run after the overwrite phase using random workload.
>>
>> Before starting the test phase after overwrite phase, the couchbase server needs to be restart (This allows us to reset stats and capture the aggregate stats for the duration fo the test).
>>
>> All tests have to be run with direct I/O.
>>
>> If it is easier to generate non-inform workload with ycsb, we could just use ycsb client for generating the workload.
>>
>> All tests with 100M docs, 64 readers, writer threads, 1KB doc, 20GB memory quota
>>
>> 1. Insert only
>>
>> 2. Update only (random)
>>
>> 3. Read only (random)
>>
>> 4. Read, Write 50:50 (random)
>>
>> 5. Update only (zipfian)
>>
>> 6. Read only (zipfian)
>>
>> 7. Read, Write 50:50 (zipfian)
>>
>>
>> We have to do one baseline run for Couchstore with Couchbase 6.5 and loop to avoid filesystem caching as follows:
>>
>> while true;
>> do
>> echo 3 > /proc/sys/vm/drop_caches
>> done
>>
>> –
>> Happy Hacking,
>> Sarath Lakshman
>>
>