Description
Provisioned - AWS - couchbase-cloud-server-7.2.1-5819-v1.0.20, m5.2xlarge |
Steps to reproduce:
Scenario 1.
- Create 3 magma buckets
- Create 4 scopes in each bucket and 5 collections in each scope
- Load 7M data in each bucket
On doing this the cluster goes into an infinite rebalancing mode.
Logs:
- https://cb-engineering.s3.amazonaws.com/logs/reblancelogs/log1.zip
- https://cb-engineering.s3.amazonaws.com/logs/reblancelogs/logs2.zip
- https://cb-engineering.s3.amazonaws.com/logs/reblancelogs/log3.zip
oid=6f10f821-fbb5-4954-a697-98ec18c71dd9 |
pid=b65d6399-b2cf-4ec3-b979-cbc5c1bad4a0
|
dbid=baf3bdbb-1686-4b11-a00b-fe344a3ea997 |
Scenario 2.
- Create 3 magma buckets
- Create 4 scopes in each bucket and 5 collections in each scope
- Load 3M data in each bucket
- Create FTS Indexes and run fts queries
- Kill and terminate process and nodes
- Scale out from 3 node cluster to 5 node cluster
- During this process there was another idle cluster which went into rebalance mode for no reason and hasn't recovered since.
Logs:
- https://cb-engineering.s3.amazonaws.com/logs/MB-NODE1/newlogs.zip
- https://cb-engineering.s3.amazonaws.com/logs/MB-NODE1/newlogs2.zip
- https://cb-engineering.s3.amazonaws.com/logs/MB-NODE1/newlogs3.zip
oid=6f10f821-fbb5-4954-a697-98ec18c71dd9 |
pid=b65d6399-b2cf-4ec3-b979-cbc5c1bad4a0
|
dbid=764440a9-405b-432d-9545-b2e5790deb04 |