Details
-
Bug
-
Resolution: Not a Bug
-
Major
-
None
-
Cheshire-Cat
-
Couchbase EE 7.0.0-4003
-
Triaged
-
Centos 64-bit
-
-
1
-
No
Description
Steps to Repro
1. Create a 3 node cluster
2020-12-14 02:00:10,112 | test | INFO | pool-1-thread-7 | [table_view:display:72] Rebalance Overview
------------------------------------
| Nodes | Services | Status |
------------------------------------
| 172.23.105.215 | kv | Cluster node |
| 172.23.105.217 | None | <--- IN — |
| 172.23.105.219 | None | <--- IN — |
------------------------------------
2. Create bucket with bucket ttl and some collections at collection TTL
2020-12-14 02:04:34,638 | test | INFO | MainThread | [table_view:display:72] Bucket statistics
------------------------------------------------------------------------
| Bucket | Type | Replicas | Durability | TTL | Items | RAM Quota | RAM Used | Disk Used |
------------------------------------------------------------------------
| default | couchbase | 1 | none | 350 | 110000 | 943718400 | 147827104 | 223181074 |
------------------------------------------------------------------------
3. Load items into default collection of default scope with doc_ttl = 300
2020-12-14 02:06:38,207 | test | INFO | pool-1-thread-20 | [task:_load_bucket_into_dgm:1981] Active DGM 100% Replica DGM 51.8550021144% achieved for 'default'. Loaded docs: 2080000 |
4. Rebalance-out a node
2020-12-14 02:08:59,407 | test | INFO | pool-1-thread-17 | [table_view:display:72] Rebalance Overview
------------------------------------
| Nodes | Services | Status |
------------------------------------
| 172.23.105.215 | kv | Cluster node |
| 172.23.105.217 | kv | Cluster node |
| 172.23.105.219 | [u'kv'] | — OUT ---> |
------------------------------------
Expected: Wait for maxTTL time and expect items to goto 0
Actual : 336,177 items remain and resident ratio drops to 0
observations
Appears similar to MB-40862 ?
Taking node .217 for reference
[root@localhost logs]# /opt/couchbase/bin/cbstats localhost:11210 -u Administrator -p password collections -a | grep items |
0x0:0x0:items: 69608 |
0x0:0x8:items: 0 |
0x0:0x9:items: 0 |
0x0:0x10:items: 0 |
0x0:0xa:items: 0 |
0x0:0xb:items: 0 |
0x0:0xc:items: 0 |
0x0:0xd:items: 0 |
0x0:0xe:items: 0 |
0x0:0xf:items: 0 |
0x8:0x1a:items: 0 |
0x8:0x11:items: 0 |
0x8:0x12:items: 0 |
0x8:0x13:items: 0 |
0x8:0x14:items: 0 |
0x8:0x15:items: 0 |
0x8:0x16:items: 0 |
0x8:0x17:items: 0 |
0x8:0x18:items: 0 |
0x8:0x19:items: 0 |
0x9:0x1b:items: 0 |
0x9:0x1c:items: 0 |
0x9:0x1d:items: 0 |
0x9:0x1e:items: 0 |
0x9:0x1f:items: 2063 |
0x9:0x20:items: 0 |
0x9:0x21:items: 2070 |
0x9:0x22:items: 0 |
0x9:0x23:items: 0 |
0x9:0x24:items: 0 |
0xa:0x2a:items: 0 |
0xa:0x2b:items: 0 |
0xa:0x2c:items: 0 |
0xa:0x2d:items: 0 |
0xa:0x2e:items: 0 |
0xa:0x25:items: 0 |
0xa:0x26:items: 0 |
0xa:0x27:items: 0 |
0xa:0x28:items: 0 |
0xa:0x29:items: 0 |
0xb:0x2f:items: 0 |
0xb:0x30:items: 0 |
0xb:0x31:items: 0 |
0xb:0x32:items: 0 |
0xb:0x33:items: 0 |
0xb:0x34:items: 0 |
0xb:0x35:items: 0 |
0xb:0x36:items: 0 |
0xb:0x37:items: 0 |
0xb:0x38:items: 0 |
[root@localhost logs]# |
grep ep_exp_pager_stime 10
(on both .215 and .217)
