Plugin's log saturation

[matthieumarrast]

We temporary set the log level to "DEBUG" in our mfdata module, in production environment, in order to help us solving a critical issue.
But one plugin stopped functionning because the log files reached the limit (100M/5 files)

-rw-r--r-- 1 mfdata metwork 100000000 19 nov.  21:53 step_<plugin>_main.log
-rw-r--r-- 1 mfdata metwork  94079566 19 nov.  20:38 step_<plugin>_main.log.20241119203825
-rw-r--r-- 1 mfdata metwork  94129569 19 nov.  20:58 step_<plugin>_main.log.20241119205820
-rw-r--r-- 1 mfdata metwork  94177526 19 nov.  21:18 step_<plugin>_main.log.20241119211815
-rw-r--r-- 1 mfdata metwork  95796003 19 nov.  21:33 step_<plugin>_main.log.20241119213342

[thebaptiste]

Is it a log_proxy issue ?
Normally, in this case, a new log file is created and the oldest one is removed (see log_proxy.c and (I think) the plugin should not stop, unless there is another problem (FS full ?).
We should try to reproduce your problem with lower limits.

Recently we had an issue about log_proxy using large memory in some cases, with this fix that I have taken in log_proxy release 0.7.4 which is not the release used in Metwork 2.2 (0.5.2). But I'm not sure at all this fix is related to your problem and would have change anything to it.

[matthieumarrast]

I just noticed the log stopped to be written in the log file (the one with size) "100000000", the rotation doesn't take effect and the plugin stopped functionning.
I have removed the log files, restarted the plugin and everything was back to normal.

To reproduce I think we should try to fill log files quickly ! 500M in less than one hour.

[matthieumarrast]

Same behaviour today on another application with log level DEBUG:

[mfdata@***************:~/log/backups] $ ll
total 200464
-rw-r--r-- 1 mfdata metwork 100000000  2 juil. 10:37 step_wfsingestion_main.log
-rw-r--r-- 1 mfdata metwork   4719038 29 juin  16:22 step_wfsingestion_main.log.20250629162458
-rw-r--r-- 1 mfdata metwork   4974396 30 juin  16:22 step_wfsingestion_main.log.20250630162459
-rw-r--r-- 1 mfdata metwork   5003267  1 juil. 16:22 step_wfsingestion_main.log.20250701162500
-rw-r--r-- 1 mfdata metwork  90548730  2 juil. 10:27 step_wfsingestion_main.log.20250702102733

The plugin stopped functionning.