Details
-
Improvement
-
Resolution: Unresolved
-
Major
-
Cheshire-Cat
Description
While troubleshooting a separate issue with magma, I noticed that cbcollect_info was taking up a very large amount of disk space, seemingly in part due to the directory listings for deleted files.
This alone takes up at least 700mb:
7606034 lr-x------. 1 couchbase couchbase 64 Jan 27 10:52 49529 -> /couchbase/data/magma/magma.9/kvstore-857/rev-000000001/keyIndex/sstable.915.data (deleted)
|
7561458 lr-x------. 1 couchbase couchbase 64 Jan 27 10:52 4953 -> /couchbase/data/magma/magma.14/kvstore-414/rev-000000001/localIndex/sstable.12.data (deleted)
|
7606035 lr-x------. 1 couchbase couchbase 64 Jan 27 10:52 49530 -> /couchbase/data/magma/magma.9/kvstore-857/rev-000000001/localIndex/sstable.915.data (deleted)
|
7606036 lr-x------. 1 couchbase couchbase 64 Jan 27 10:52 49531 -> /couchbase/data/magma/magma.9/kvstore-857/rev-000000001/seqIndex/sstable.1826.data (deleted)
|
7606037 lr-x------. 1 couchbase couchbase 64 Jan 27 10:52 49532 -> /couchbase/data/magma/magma.6/kvstore-374/rev-000000001/keyIndex/sstable.944.data (deleted)
|
7606038 lr-x------. 1 couchbase couchbase 64 Jan 27 10:52 49533 -> /couchbase/data/magma/magma.5/kvstore-373/rev-000000001/localIndex/sstable.974.data (deleted)
|
7606039 lr-x------. 1 couchbase couchbase 64 Jan 27 10:52 49534 -> /couchbase/data/magma/magma.12/kvstore-348/rev-000000001/seqIndex/sstable.1656.data (deleted)
|
7606040 lr-x------. 1 couchbase couchbase 64 Jan 27 10:52 49535 -> /couchbase/data/magma/magma.15/kvstore-79/rev-000000001/keyIndex/sstable.798.data (deleted)
|
7606041 lr-x------. 1 couchbase couchbase 64 Jan 27 10:52 49536 -> /couchbase/data/magma/magma.15/kvstore-79/rev-000000001/localIndex/sstable.798.data (deleted)
|
7606042 lr-x------. 1 couchbase couchbase 64 Jan 27 10:52 49537 -> /couchbase/data/magma/magma.15/kvstore-79/rev-000000001/seqIndex/sstable.1594.data (deleted)
|
7606043 lr-x------. 1 couchbase couchbase 64 Jan 27 10:52 49538 -> /couchbase/data/magma/magma.12/kvstore-348/rev-000000001/localIndex/sstable.830.data (deleted)
|
7606044 lr-x------. 1 couchbase couchbase 64 Jan 27 10:52 49539 -> /couchbase/data/magma/magma.12/kvstore-348/rev-000000001/keyIndex/sstable.830.data (deleted)
|
From this cbcollect_info: https://s3.amazonaws.com/cb-engineering/perry/magma-rebalance/collectinfo-2020-01-27T135139-ns_1%40ec2-35-164-112-80.us-west-2.compute.amazonaws.com.zip
I had ~4GB of space free in my /tmp directory and generating this collect_info ended up consuming nearly all of it. Customers are going to regularly have small amounts of space on the default partitions so anything we can do to shrink the usage is helpful.