Details
-
Task
-
Resolution: Fixed
-
Major
-
Morpheus
-
AWS 3 node (a1.2xlarge - 8 vcpus; 16 GiB each)
-
1
-
Magma May 2022, Magma May 16 2023, Magma May 23 2024, Magma May 30 2025
Description
As part of evaluating configurations for Elixir I have a 3 node AWS cluster with 20 magma buckets (256MB) each with 20,000 docs and running cbc-pillowfight against each bucket with 10 ops/sec.
Obtaining a cbcollect is taking 2.5 hours and the majority (2 hours, 12 minutes) of the time is spent in magma_dump.
[2022-04-15T15:32:32.727481+00:00] mdocs for b1 (/opt/couchbase/var/lib/couchbase/data/b1) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b1', '--cbcollect']) - OK
|
[2022-04-15T15:38:59.490782+00:00] mdocs for b2 (/opt/couchbase/var/lib/couchbase/data/b2) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b2', '--cbcollect']) - OK
|
[2022-04-15T15:45:20.821945+00:00] mdocs for b3 (/opt/couchbase/var/lib/couchbase/data/b3) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b3', '--cbcollect']) - OK
|
[2022-04-15T15:51:41.995772+00:00] mdocs for b4 (/opt/couchbase/var/lib/couchbase/data/b4) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b4', '--cbcollect']) - OK
|
[2022-04-15T15:58:07.928589+00:00] mdocs for b5 (/opt/couchbase/var/lib/couchbase/data/b5) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b5', '--cbcollect']) - OK
|
[2022-04-15T16:04:45.213287+00:00] mdocs for b6 (/opt/couchbase/var/lib/couchbase/data/b6) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b6', '--cbcollect']) - OK
|
[2022-04-15T16:11:08.817602+00:00] mdocs for b7 (/opt/couchbase/var/lib/couchbase/data/b7) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b7', '--cbcollect']) - OK
|
[2022-04-15T16:17:41.919275+00:00] mdocs for b8 (/opt/couchbase/var/lib/couchbase/data/b8) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b8', '--cbcollect']) - OK
|
[2022-04-15T16:24:17.560473+00:00] mdocs for b9 (/opt/couchbase/var/lib/couchbase/data/b9) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b9', '--cbcollect']) - OK
|
[2022-04-15T16:30:52.844423+00:00] mdocs for b10 (/opt/couchbase/var/lib/couchbase/data/b10) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b10', '--cbcollect']) - OK
|
[2022-04-15T16:37:31.046947+00:00] mdocs for b11 (/opt/couchbase/var/lib/couchbase/data/b11) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b11', '--cbcollect']) - OK
|
[2022-04-15T16:44:16.702744+00:00] mdocs for b12 (/opt/couchbase/var/lib/couchbase/data/b12) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b12', '--cbcollect']) - OK
|
[2022-04-15T16:50:50.575655+00:00] mdocs for b13 (/opt/couchbase/var/lib/couchbase/data/b13) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b13', '--cbcollect']) - OK
|
[2022-04-15T16:57:32.980461+00:00] mdocs for b14 (/opt/couchbase/var/lib/couchbase/data/b14) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b14', '--cbcollect']) - OK
|
[2022-04-15T17:04:21.581576+00:00] mdocs for b15 (/opt/couchbase/var/lib/couchbase/data/b15) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b15', '--cbcollect']) - OK
|
[2022-04-15T17:10:44.672292+00:00] mdocs for b16 (/opt/couchbase/var/lib/couchbase/data/b16) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b16', '--cbcollect']) - OK
|
[2022-04-15T17:17:34.756564+00:00] mdocs for b17 (/opt/couchbase/var/lib/couchbase/data/b17) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b17', '--cbcollect']) - OK
|
[2022-04-15T17:24:14.708256+00:00] mdocs for b18 (/opt/couchbase/var/lib/couchbase/data/b18) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b18', '--cbcollect']) - OK
|
[2022-04-15T17:30:45.268141+00:00] mdocs for b19 (/opt/couchbase/var/lib/couchbase/data/b19) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b19', '--cbcollect']) - OK
|
[2022-04-15T17:37:19.102875+00:00] mdocs for b20 (/opt/couchbase/var/lib/couchbase/data/b20) (['magma_dump', '/opt/couchbase/var/lib/couchbase/data/b20', '--cbcollect']) - OK
|
[2022-04-15T17:44:02.664676+00:00] mctimings [] (['mctimings', '-u', '@ns_server', '-h', '127.0.0.1:11209', '-a', '-v']) - OK
|
Please look into what can be done to speed up magma_dump.
Here's the cbcollect for the above run
https://cb-engineering.s3.amazonaws.com/stevewatanabe/awsElixir15April2022/collectinfo-2022-04-15T151557-ns_1@172.31.14.107.zip
