commitlog file不能被自动清理，不管是被timeup/spacefull or manualDelete哪种方式触发

[hashkey-ops-admin]

由timeup触发的清理日志：

2023-12-26 04:00:02 INFO StoreScheduledThread1 - it's time to reclaim disk space, 04
2023-12-26 04:00:02 INFO StoreScheduledThread1 - begin to delete before 72 hours file. timeup: true spacefull: false manualDeleteFileSeveralTimes: 0 cleanAtOnce: false
2023-12-26 04:00:02 WARN StoreScheduledThread1 - destroy mapped file[REF:0] /data/rocketmq/store/commitlog/00000000000000000000 Failed. cleanupOver: false
2023-12-26 04:00:02 WARN StoreScheduledThread1 - the mappedFile was destroyed once, but still alive, /data/rocketmq/store/commitlog/00000000000000000000
2023-12-26 04:00:02 WARN StoreScheduledThread1 - destroy mapped file[REF:0] /data/rocketmq/store/commitlog/00000000000000000000 Failed. cleanupOver: false
2023-12-26 04:00:02 WARN StoreScheduledThread1 - the mappedFile re delete failed, /data/rocketmq/store/commitlog/00000000000000000000

由 storescheuled触发的 retryDeleteFirstFile 函数的日志:

2023-12-26 09:53:12 WARN StoreScheduledThread1 - the mappedFile was destroyed once, but still alive, /data/rocketmq/store/commitlog/00000000000000000000
2023-12-26 09:53:12 WARN StoreScheduledThread1 - destroy mapped file[REF:0] /data/rocketmq/store/commitlog/00000000000000000000 Failed. cleanupOver: false
2023-12-26 09:53:12 WARN StoreScheduledThread1 - the mappedFile re delete failed, /data/rocketmq/store/commitlog/00000000000000000000

store目录下当前的commitlog文件：

ls -ltr /data/rocketmq/store/commitlog/ 
total 30366260
-rw-r--r-- 1 root root 1073741824 Oct 24 17:02 00000000000000000000
-rw-r--r-- 1 root root 1073741824 Oct 27 13:55 00000000001073741824
-rw-r--r-- 1 root root 1073741824 Oct 30 15:14 00000000002147483648
-rw-r--r-- 1 root root 1073741824 Nov  2 11:03 00000000003221225472
-rw-r--r-- 1 root root 1073741824 Nov  5 06:30 00000000004294967296
-rw-r--r-- 1 root root 1073741824 Nov  8 03:38 00000000005368709120
-rw-r--r-- 1 root root 1073741824 Nov 11 02:44 00000000006442450944
-rw-r--r-- 1 root root 1073741824 Nov 14 07:15 00000000007516192768
-rw-r--r-- 1 root root 1073741824 Nov 15 09:38 00000000008589934592
-rw-r--r-- 1 root root 1073741824 Nov 17 22:26 00000000009663676416
-rw-r--r-- 1 root root 1073741824 Nov 20 12:21 00000000010737418240
-rw-r--r-- 1 root root 1073741824 Nov 22 21:26 00000000011811160064
-rw-r--r-- 1 root root 1073741824 Nov 26 04:06 00000000012884901888
-rw-r--r-- 1 root root 1073741824 Nov 30 00:08 00000000013958643712
-rw-r--r-- 1 root root 1073741824 Dec  3 12:33 00000000015032385536
-rw-r--r-- 1 root root 1073741824 Dec  7 04:43 00000000016106127360
-rw-r--r-- 1 root root 1073741824 Dec 10 17:32 00000000017179869184
-rw-r--r-- 1 root root 1073741824 Dec 13 17:09 00000000018253611008
-rw-r--r-- 1 root root 1073741824 Dec 15 00:37 00000000019327352832
-rw-r--r-- 1 root root 1073741824 Dec 16 12:13 00000000020401094656
-rw-r--r-- 1 root root 1073741824 Dec 18 01:29 00000000021474836480
-rw-r--r-- 1 root root 1073741824 Dec 18 22:54 00000000022548578304
-rw-r--r-- 1 root root 1073741824 Dec 19 05:21 00000000023622320128
-rw-r--r-- 1 root root 1073741824 Dec 19 12:30 00000000024696061952
-rw-r--r-- 1 root root 1073741824 Dec 19 15:44 00000000025769803776
-rw-r--r-- 1 root root 1073741824 Dec 19 22:16 00000000026843545600
-rw-r--r-- 1 root root 1073741824 Dec 21 13:58 00000000027917287424
-rw-r--r-- 1 root root 1073741824 Dec 24 17:31 00000000028991029248
-rw-r--r-- 1 root root 1073741824 Dec 24 17:31 00000000031138512896
-rw-r--r-- 1 root root 1073741824 Dec 26 14:17 00000000030064771072

RocketMQ java进程的内存使用情况(内存主要使用在mmap上)

注意到日志中 /data/rocketmq/store/commitlog/00000000000000000000 文件的reference是0。但是该文件当前还是被rocketmq java进程打开着：

lsof /data/rocketmq/store/commitlog/00000000000000000000
COMMAND  PID USER   FD   TYPE DEVICE   SIZE/OFF      NODE NAME
java    3474 root  mem    REG  259,1 1073741824 134320258 /data/rocketmq/store/commitlog/00000000000000000000
java    3474 root  138u   REG  259,1 1073741824 134320258 /data/rocketmq/store/commitlog/00000000000000000000

Java及RocketMQ版本(rocketmq-4.9.4)如下：

java -version
java version "11.0.17" 2022-10-18 LTS
Java(TM) SE Runtime Environment 18.9 (build 11.0.17+10-LTS-269)
Java HotSpot(TM) 64-Bit Server VM 18.9 (build 11.0.17+10-LTS-269, mixed mode)

请教下，当前是否可以在不重启RocketMQ服务的前提下，恢复commitlog的自动清理？

[RongtongJin]

现在broker磁盘水位如何（可以查看clusterList）？是一直删除不掉吗？多次调用MappedFile shutdown方法后应该是可以删掉的。

[RongtongJin]

#5097
#5098
JDK11下删除文件可能有问题，后期版本已经修复，早期版本需要打patch