Skip to content

Commit 72be0e0

Browse files
authored
Merge pull request ceph#65021 from zdover23/wip-doc-2025-08-14-cephfs-troubleshooting
doc/cephfs: edit troubleshooting.rst Reviewed-by: Anthony D'Atri <[email protected]>
2 parents 6c00155 + 3d8a675 commit 72be0e0

File tree

1 file changed

+36
-19
lines changed

1 file changed

+36
-19
lines changed

doc/cephfs/troubleshooting.rst

Lines changed: 36 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -460,36 +460,53 @@ To disable debug logging, run a command of the following form:
460460
In-memory Log Dump
461461
==================
462462

463-
In-memory logs can be dumped by setting ``mds_extraordinary_events_dump_interval``
464-
during a lower level debugging (log level < 10). ``mds_extraordinary_events_dump_interval``
465-
is the interval in seconds for dumping the recent in-memory logs when there is an Extra-Ordinary event.
463+
In-memory logs can be dumped by setting
464+
``mds_extraordinary_events_dump_interval`` when
465+
the log level is set to less than ``10``.
466+
``mds_extraordinary_events_dump_interval`` is the interval in seconds for
467+
dumping the recent in-memory logs when there is an extraordinary event.
466468

467-
The Extra-Ordinary events are classified as:
469+
Extraordinary events include the following:
468470

469471
* Client Eviction
470472
* Missed Beacon ACK from the monitors
471473
* Missed Internal Heartbeats
472474

473-
In-memory Log Dump is disabled by default to prevent log file bloat in a production environment.
474-
The below commands consecutively enables it::
475+
In-memory log dump is disabled by default. This prevents production
476+
environments from experiencing log file bloat by default.
475477

476-
$ ceph config set mds debug_mds <log_level>/<gather_level>
477-
$ ceph config set mds mds_extraordinary_events_dump_interval <seconds>
478+
Run the following two commands in order to enable in-memory log dumping:
478479

479-
The ``log_level`` should be < 10 and ``gather_level`` should be >= 10 to enable in-memory log dump.
480-
When it is enabled, the MDS checks for the extra-ordinary events every
481-
``mds_extraordinary_events_dump_interval`` seconds and if any of them occurs, MDS dumps the
482-
in-memory logs containing the relevant event details in ceph-mds log.
480+
#.
481+
.. prompt:: bash $
483482

484-
.. note:: For higher log levels (log_level >= 10) there is no reason to dump the In-memory Logs and a
485-
lower gather level (gather_level < 10) is insufficient to gather In-memory Logs. Thus a
486-
log level >=10 or a gather level < 10 in debug_mds would prevent enabling the In-memory Log Dump.
487-
In such cases, when there is a failure it's required to reset the value of
488-
mds_extraordinary_events_dump_interval to 0 before enabling using the above commands.
483+
ceph config set mds debug_mds <log_level>/<gather_level>
484+
Set ``log_level`` to a value of less than ``10``. Set ``gather_level`` to a
485+
value greater than ``10``. When those two values have been set, in-memory
486+
log dump is enabled.
487+
#.
488+
.. prompt:: bash #
489+
490+
ceph config set mds mds_extraordinary_events_dump_interval <seconds>
491+
When in-memory log dumping is enabled, the MDS checks for
492+
extraordinary events every ``mds_extraordinary_events_dump_interval``
493+
seconds. If any extraordinary event occurs, the MDS dumps the in-memory logs
494+
that contain relevant event details to the Ceph MDS log.
495+
496+
.. note:: When higher log levels are set (``log_level`` greater than or equal
497+
to ``10``) there is no reason to dump the in-memory logs. A lower gather
498+
level (``gather_level`` less than ``10``) is insufficient to gather in-
499+
memory logs. This means that a log level of greater than or equal to ``10``
500+
or a gather level of less than ``10`` in ``debug_mds`` prevents enabling
501+
in-memory-log dumping. In such cases, if there is a failure, you must reset
502+
the value of ``mds_extraordinary_events_dump_interval`` to ``0`` before
503+
enabling the use of the above commands.
489504

490-
The In-memory Log Dump can be disabled using::
505+
Disable in-memory log dumping by running the following command:
506+
507+
.. prompt:: bash #
491508

492-
$ ceph config set mds mds_extraordinary_events_dump_interval 0
509+
ceph config set mds mds_extraordinary_events_dump_interval 0
493510

494511
Filesystems Become Inaccessible After an Upgrade
495512
================================================

0 commit comments

Comments
 (0)