RabbitMQ shutdown on noproc reason

[lxle1231]

Hello,

I am facing this issue with rabbitmq and the log is below. Before the start of the log, there is no log at all for 2 days. This is a DR env and hasn't seen any activity since May 6th. I've seen discussions where below error will be shown when rabbitmq connection is closed but that's not the case this time. The rabbitmq connections were not closed.

Is it possible to find out what caused the shutdown using the log below?

Rabbitmq ver: 3.11.7
Erlang 25.2.1

-- Logs begin at Thu 2023-04-13 18:56:39 PDT, end at Mon 2023-05-08 12:33:05 PDT. --
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> supervisor: {<0.3273.0>,rabbit_channel_sup}
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> errorContext: shutdown_error
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> reason: noproc
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> offender: [{pid,<0.3276.0>},
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> {id,channel},
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> {mfargs,
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> {rabbit_channel,start_link,
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> [1,<0.3162.0>,<0.3274.0>,<0.3162.0>,
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> <<"10.139.77.26:50938 -> 10.139.78.42:5671">>,
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> rabbit_framing_amqp_0_9_1,
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> {user,<<"pronghorn">>,
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> [administrator],
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> [{rabbit_auth_backend_internal,
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> #Fun<rabbit_auth_backend_internal.2.31211176>}]},
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> <<"/ph22">>,
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> [{<<"publisher_confirms">>,bool,true},
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> {<<"exchange_exchange_bindings">>,bool,true},
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> {<<"basic.nack">>,bool,true},
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> {<<"consumer_cancel_notify">>,bool,true},
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> {<<"connection.blocked">>,bool,true},
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> {<<"authentication_failure_close">>,bool,true}],
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> <0.3185.0>,<0.3275.0>]}},
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> {restart_type,intrinsic},
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> {shutdown,70000},
May 08 10:12:47  rabbitmq-server[3201265]: 2023-05-08 10:12:47.536747-07:00 [error] <0.3273.0> {child_type,worker}]
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> supervisor: {<0.2878.0>,rabbit_channel_sup}
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> errorContext: shutdown_error
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> reason: noproc
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> offender: [{pid,<0.2881.0>},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> {id,channel},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> {mfargs,
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> {rabbit_channel,start_link,
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> [1,<0.2830.0>,<0.2879.0>,<0.2830.0>,
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> <<"10.139.79.20:34534 -> 10.139.78.42:5671">>,
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> rabbit_framing_amqp_0_9_1,
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> {user,<<"pronghorn">>,
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> [administrator],
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> [{rabbit_auth_backend_internal,
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> #Fun<rabbit_auth_backend_internal.2.31211176>}]},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> <<"/ph22">>,
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> [{<<"publisher_confirms">>,bool,true},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> {<<"exchange_exchange_bindings">>,bool,true},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> {<<"basic.nack">>,bool,true},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> {<<"consumer_cancel_notify">>,bool,true},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> {<<"connection.blocked">>,bool,true},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> {<<"authentication_failure_close">>,bool,true}],
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> <0.2846.0>,<0.2880.0>]}},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> {restart_type,intrinsic},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> {shutdown,70000},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681246-07:00 [error] <0.2878.0> {child_type,worker}]
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> supervisor: {<0.2910.0>,rabbit_channel_sup}
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> errorContext: shutdown_error
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> reason: noproc
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> offender: [{pid,<0.2914.0>},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> {id,channel},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> {mfargs,
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> {rabbit_channel,start_link,
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> [1,<0.2839.0>,<0.2911.0>,<0.2839.0>,
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> <<"10.139.79.20:34564 -> 10.139.78.42:5671">>,
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> rabbit_framing_amqp_0_9_1,
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> {user,<<"pronghorn">>,
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> [administrator],
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> [{rabbit_auth_backend_internal,
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> #Fun<rabbit_auth_backend_internal.2.31211176>}]},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> <<"/ph22">>,
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> [{<<"publisher_confirms">>,bool,true},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> {<<"exchange_exchange_bindings">>,bool,true},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> {<<"basic.nack">>,bool,true},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> {<<"consumer_cancel_notify">>,bool,true},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> {<<"connection.blocked">>,bool,true},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> {<<"authentication_failure_close">>,bool,true}],
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> <0.2851.0>,<0.2912.0>]}},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> {restart_type,intrinsic},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> {shutdown,70000},
May 08 10:12:49  rabbitmq-server[3201265]: 2023-05-08 10:12:49.681195-07:00 [error] <0.2910.0> {child_type,worker}]
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> supervisor: {<0.26405.1>,rabbit_channel_sup}
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> errorContext: shutdown_error
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> reason: noproc
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> offender: [{pid,<0.26408.1>},
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> {id,channel},
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> {mfargs,
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> {rabbit_channel,start_link,
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> [1,<0.26352.1>,<0.26406.1>,<0.26352.1>,
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> <<"10.139.77.26:50328 -> 10.139.78.42:5671">>,
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> rabbit_framing_amqp_0_9_1,
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> {user,<<"pronghorn">>,
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> [administrator],
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> [{rabbit_auth_backend_internal,
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> #Fun<rabbit_auth_backend_internal.2.31211176>}]},
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> <<"/ph22">>,
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> [{<<"publisher_confirms">>,bool,true},
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> {<<"exchange_exchange_bindings">>,bool,true},
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> {<<"basic.nack">>,bool,true},
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> {<<"consumer_cancel_notify">>,bool,true},
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> {<<"connection.blocked">>,bool,true},
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> {<<"authentication_failure_close">>,bool,true}],
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> <0.26370.1>,<0.26407.1>]}},
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> {restart_type,intrinsic},
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> {shutdown,70000},
May 08 10:12:50  rabbitmq-server[3201265]: 2023-05-08 10:12:50.542359-07:00 [error] <0.26405.1> {child_type,worker}]
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> supervisor: {<0.26703.1>,rabbit_channel_sup}
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> errorContext: shutdown_error
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> reason: noproc
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> offender: [{pid,<0.26706.1>},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> {id,channel},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> {mfargs,
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> {rabbit_channel,start_link,
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> [1,<0.26677.1>,<0.26704.1>,<0.26677.1>,
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> <<"10.139.79.20:49934 -> 10.139.78.42:5671">>,
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> rabbit_framing_amqp_0_9_1,
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> {user,<<"pronghorn">>,
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> [administrator],
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> [{rabbit_auth_backend_internal,
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> #Fun<rabbit_auth_backend_internal.2.31211176>}]},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> <<"/ph22">>,
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> [{<<"publisher_confirms">>,bool,true},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> {<<"exchange_exchange_bindings">>,bool,true},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> {<<"basic.nack">>,bool,true},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> {<<"consumer_cancel_notify">>,bool,true},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> {<<"connection.blocked">>,bool,true},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> {<<"authentication_failure_close">>,bool,true}],
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> <0.26681.1>,<0.26705.1>]}},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> {restart_type,intrinsic},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> {shutdown,70000},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.690997-07:00 [error] <0.26703.1> {child_type,worker}]
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> supervisor: {<0.26841.1>,rabbit_channel_sup}
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> errorContext: shutdown_error
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> reason: noproc
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> offender: [{pid,<0.26844.1>},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> {id,channel},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> {mfargs,
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> {rabbit_channel,start_link,
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> [1,<0.26835.1>,<0.26842.1>,<0.26835.1>,
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> <<"10.139.79.20:50014 -> 10.139.78.42:5671">>,
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> rabbit_framing_amqp_0_9_1,
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> {user,<<"pronghorn">>,
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> [administrator],
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> [{rabbit_auth_backend_internal,
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> #Fun<rabbit_auth_backend_internal.2.31211176>}]},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> <<"/ph22">>,
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> [{<<"publisher_confirms">>,bool,true},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> {<<"exchange_exchange_bindings">>,bool,true},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> {<<"basic.nack">>,bool,true},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> {<<"consumer_cancel_notify">>,bool,true},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> {<<"connection.blocked">>,bool,true},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> {<<"authentication_failure_close">>,bool,true}],
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> <0.26836.1>,<0.26843.1>]}},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> {restart_type,intrinsic},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> {shutdown,70000},
May 08 10:12:52  rabbitmq-server[3201265]: 2023-05-08 10:12:52.976662-07:00 [error] <0.26841.1> {child_type,worker}]
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> supervisor: {<0.27160.1>,rabbit_channel_sup}
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> errorContext: shutdown_error
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> reason: noproc
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> offender: [{pid,<0.27163.1>},
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> {id,channel},
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> {mfargs,
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> {rabbit_channel,start_link,
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> [1,<0.27113.1>,<0.27161.1>,<0.27113.1>,
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> <<"10.139.79.21:39418 -> 10.139.78.42:5671">>,
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> rabbit_framing_amqp_0_9_1,
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> {user,<<"pronghorn">>,
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> [administrator],
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> [{rabbit_auth_backend_internal,
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> #Fun<rabbit_auth_backend_internal.2.31211176>}]},
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> <<"/ph22">>,
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> [{<<"publisher_confirms">>,bool,true},
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> {<<"exchange_exchange_bindings">>,bool,true},
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> {<<"basic.nack">>,bool,true},
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> {<<"consumer_cancel_notify">>,bool,true},
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> {<<"connection.blocked">>,bool,true},
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> {<<"authentication_failure_close">>,bool,true}],
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> <0.27117.1>,<0.27162.1>]}},
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> {restart_type,intrinsic},
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> {shutdown,70000},
May 08 10:12:55  rabbitmq-server[3201265]: 2023-05-08 10:12:55.942869-07:00 [error] <0.27160.1> {child_type,worker}]
May 08 10:42:59  rabbitmq-server[3201265]: 2023-05-08 10:42:59.964795-07:00 [error] <0.27428.1> Channel error on connection <0.27414.1> (10.139.79.20:55868 -> 10.139.78.42:5671, vhost: '/ph22', user: 'pronghorn'), channel 2:
May 08 10:42:59  rabbitmq-server[3201265]: 2023-05-08 10:42:59.964795-07:00 [error] <0.27428.1> operation none caused a channel exception precondition_failed: delivery acknowledgement on channel 2 timed out. Timeout value used: 1800000 ms. This timeout value can be configured, see consumers doc guide to learn more
May 08 10:43:54  rabbitmq-server[3201265]: 2023-05-08 10:43:54.689480-07:00 [error] <0.27239.1> Channel error on connection <0.27218.1> (10.139.77.26:38560 -> 10.139.78.42:5671, vhost: '/ph22', user: 'pronghorn'), channel 2:
May 08 10:43:54  rabbitmq-server[3201265]: 2023-05-08 10:43:54.689480-07:00 [error] <0.27239.1> operation none caused a channel exception precondition_failed: delivery acknowledgement on channel 2 timed out. Timeout value used: 1800000 ms. This timeout value can be configured, see consumers doc guide to learn more
May 08 11:13:54  rabbitmq-server[3201265]: 2023-05-08 11:13:54.727390-07:00 [error] <0.27491.1> Channel error on connection <0.27477.1> (10.139.79.21:46424 -> 10.139.78.42:5671, vhost: '/ph22', user: 'pronghorn'), channel 2:
May 08 11:13:54  rabbitmq-server[3201265]: 2023-05-08 11:13:54.727390-07:00 [error] <0.27491.1> operation none caused a channel exception precondition_failed: delivery acknowledgement on channel 2 timed out. Timeout value used: 1800000 ms. This timeout value can be configured, see consumers doc guide to learn more

[michaelklishin]

This is just log noise. A channel does not get a delivery ack (possibly because the queue processes were already stopped) and that makes it time out on its own shutdown, which one of the closing connections logs.

Shutdown order in environments with a lot of parallelism can result in scenarios like this: queues shut down before things that depend on them. It should not cause any harm as long as clients use publisher confirms and consumer acknowledgments.

[lxle1231]

I see! Is there a way to check whether or not clients use publisher confirms and consumer acknowledgements through config or some sort of generic testing?