How Do I Start RabbitMQ Faster

[dormanze]

Hello, everyone.
My rabbitmq version is 3.11.9
My erlang version is 25.22
My environment is running 40,000+ durable queues.

When I stopped and restarted two instances, I found that the boot time was long, and I wanted to know what configuration would speed up my boot. In addition, when I checked the startup logs, some Mnesia overloaded errors were reported. I was not sure whether these errors would affect my functions.

2023-12-20 15:14:36.640027+08:00 [info] <0.536.0> Making sure data directory '/usr/local/rabbitmq_server-3.11.9/var/lib/rabbitmq/mnesia/rabbit@rabbitmqservice-0/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists
2023-12-20 15:14:37.428197+08:00 [info] <0.536.0> Starting message stores for vhost '/'
2023-12-20 15:14:37.428587+08:00 [info] <0.552.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index
2023-12-20 15:14:37.430413+08:00 [info] <0.536.0> Started message store of type transient for vhost '/'
2023-12-20 15:14:37.447985+08:00 [info] <0.556.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index
2023-12-20 15:14:38.744577+08:00 [warning] <0.556.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent" : recovery terms differ from present
2023-12-20 15:14:38.744577+08:00 [warning] <0.556.0> rebuilding indices from scratch
2023-12-20 15:14:39.203696+08:00 [info] <0.536.0> Started message store of type persistent for vhost '/'
2023-12-20 15:14:40.825792+08:00 [warning] <0.253.0> Mnesia('rabbit@rabbitmqservice-0'): ** WARNING ** Mnesia is overloaded: {dump_log,write_threshold}
2023-12-20 15:14:40.825792+08:00 [warning] <0.253.0>
2023-12-20 15:14:40.929334+08:00 [warning] <0.253.0> Mnesia('rabbit@rabbitmqservice-0'): ** WARNING ** Mnesia is overloaded: {dump_log,write_threshold}
2023-12-20 15:14:40.929334+08:00 [warning] <0.253.0>
2023-12-20 15:14:41.000039+08:00 [warning] <0.253.0> Mnesia('rabbit@rabbitmqservice-0'): ** WARNING ** Mnesia is overloaded: {dump_log,write_threshold}
2023-12-20 15:14:41.000039+08:00 [warning] <0.253.0>
2023-12-20 15:14:41.082282+08:00 [warning] <0.253.0> Mnesia('rabbit@rabbitmqservice-0'): ** WARNING ** Mnesia is overloaded: {dump_log,write_threshold}
2023-12-20 15:14:41.082282+08:00 [warning] <0.253.0>
2023-12-20 15:14:41.192465+08:00 [warning] <0.253.0> Mnesia('rabbit@rabbitmqservice-0'): ** WARNING ** Mnesia is overloaded: {dump_log,write_threshold}
2023-12-20 15:14:41.192465+08:00 [warning] <0.253.0>
2023-12-20 15:14:41.268482+08:00 [warning] <0.253.0> Mnesia('rabbit@rabbitmqservice-0'): ** WARNING ** Mnesia is overloaded: {dump_log,write_threshold}
2023-12-20 15:14:41.268482+08:00 [warning] <0.253.0>
2023-12-20 15:14:41.334642+08:00 [warning] <0.253.0> Mnesia('rabbit@rabbitmqservice-0'): ** WARNING ** Mnesia is overloaded: {dump_log,write_threshold}
2023-12-20 15:14:41.334642+08:00 [warning] <0.253.0>
2023-12-20 15:14:41.404220+08:00 [warning] <0.253.0> Mnesia('rabbit@rabbitmqservice-0'): ** WARNING ** Mnesia is overloaded: {dump_log,write_threshold}
2023-12-20 15:14:41.404220+08:00 [warning] <0.253.0>
2023-12-20 15:14:41.468962+08:00 [warning] <0.253.0> Mnesia('rabbit@rabbitmqservice-0'): ** WARNING ** Mnesia is overloaded: {dump_log,write_threshold}
2023-12-20 15:14:41.468962+08:00 [warning] <0.253.0>
2023-12-20 15:14:41.551066+08:00 [warning] <0.253.0> Mnesia('rabbit@rabbitmqservice-0'): ** WARNING ** Mnesia is overloaded: {dump_log,write_threshold}
2023-12-20 15:14:41.551066+08:00 [warning] <0.253.0>
2023-12-20 15:14:41.627104+08:00 [warning] <0.253.0> Mnesia('rabbit@rabbitmqservice-0'): ** WARNING ** Mnesia is overloaded: {dump_log,write_threshold}
2023-12-20 15:14:41.627104+08:00 [warning] <0.253.0>
2023-12-20 15:14:41.700673+08:00 [warning] <0.253.0> Mnesia('rabbit@rabbitmqservice-0'): ** WARNING ** Mnesia is overloaded: {dump_log,write_threshold}
2023-12-20 15:14:41.700673+08:00 [warning] <0.253.0>
2023-12-20 15:14:41.787822+08:00 [warning] <0.253.0> Mnesia('rabbit@rabbitmqservice-0'): ** WARNING ** Mnesia is overloaded: {dump_log,write_threshold}
2023-12-20 15:14:41.787822+08:00 [warning] <0.253.0>
2023-12-20 15:14:41.868244+08:00 [warning] <0.253.0> Mnesia('rabbit@rabbitmqservice-0'): ** WARNING ** Mnesia is overloaded: {dump_log,write_threshold}
2023-12-20 15:14:41.868244+08:00 [warning] <0.253.0>
2023-12-20 15:14:41.940525+08:00 [warning] <0.253.0> Mnesia('rabbit@rabbitmqservice-0'): ** WARNING ** Mnesia is overloaded: {dump_log,write_threshold}

[michaelklishin]

Upgrade #7676 #7745, use CQv2 and use fewer queues in general, e.g. by using a stream for mass fanouts.