Details
-
Bug
-
Resolution: Fixed
-
Critical
-
Elixir
-
Untriaged
-
0
-
Unknown
Description
Magma's RangeScan logging into the memcached.log is overly-verbose, resulting in very short log retention times. For example, the following 7 log lines are printed every time a key RangeScan is started - I assume at the request of Query or other client issuing a KV Range Scan:
2023-01-26T07:01:10.921167+00:00 INFO [(volumetestbucket-18-ftu7xm) magma_6/kvstore-46/rev-000000001]0xfffdb0b8bdc0 Starting key iterator.
|
2023-01-26T07:01:10.921182+00:00 INFO [(volumetestbucket-18-ftu7xm) magma_6/kvstore-46/rev-000000001]0xfffdb0b8bdc0 Ending key iterator. restarted:0
|
2023-01-26T07:01:10.921201+00:00 INFO (volumetestbucket-18-ftu7xm) 9811: vb:46 RangeScan 0b453b4f-4e99-4942-8171-927ba10ebc0d created. cid:0xc, mode:keys
|
2023-01-26T07:01:10.922193+00:00 INFO [(volumetestbucket-18-ftu7xm) magma_6/kvstore-46/rev-000000001]0xfffdbb611dc0 Starting key iterator.
|
...
|
2023-01-26T07:01:10.928094+00:00 INFO [(volumetestbucket-18-ftu7xm) magma_6/kvstore-46/rev-000000001]0xfffdbb611dc0 Ending key iterator. restarted:5
|
This has resulted in less than 12 hours of log history:
$ head -n6 memcached.log
|
==============================================================================
|
Memcached logs
|
sh -c cd "$1"; for file in $(ls -tr memcached.log.*); do cat "$file"; done -- /opt/couchbase/var/lib/couchbase/logs
|
==============================================================================
|
2023-01-26T05:59:42.936186+00:00 INFO ---------- Opening logfile:
|
2023-01-26T05:59:42.936358+00:00 INFO (volumetestbucket-14-0b2bok) vb:48 RangeScan e2c9e079-9ce4-475c-a676-d71261907970 cancelled by request
|
1z [:~/Documents … B-55294-rebalance-hang/cbcollect_info_ns_1@svc-d-node-003.nomghki5newnypa.sandbox.nonprod-project-avengers.com_20230126-170229] ...
|
5d19h29m58s $ tail -n2 memcached.log
|
2023-01-26T17:04:58.914187+00:00 INFO 400: HELO [{"a":"mctimings d2efe77ec1375d622d886b543bf110365c482a01"}] XERROR [ {"ip":"127.0.0.1","port":40614} - {"ip":"127.0.0.1","port":11209} (not authenticated) ]
|
2023-01-26T17:04:58.951081+00:00 INFO 400: Client {"ip":"127.0.0.1","port":40614} authenticated as <ud>@ns_server</ud>
|
Indeed, around 40% of all log messages in the file are these:
$ wc -l memcached.log
|
1253493 memcached.log
|
$ cat memcached.log | rg -c 'magma_\d+'
|
472466
|
In general, KV-Engine log file (at INFO level) should not include per-request / opcode information as that's far too detailed.
See MB-55294 for log files (cbcollect_info_ns_1@svc-d-node-003.nomghki5newnypa.sandbox.nonprod-project-avengers.com_20230126-170229 used here).
(See also: MB-47256)
Attachments
Issue Links
- is cloned by
-
-
- Open
-