Help, RabbitMQ 3.7.9 Mirror Cluster High CPU usage and node crash problem #7785

zhouguoqing · 2023-03-31T06:29:56Z

zhouguoqing
Mar 31, 2023

We used RabbitMQ 3.7.9 Mirror cluster in our production environment.
The RabbitMQ host experienced a surge in CPU usage and memory usage.
All clients cannot connect to RabbitMQ Broker.
Here is environment info:
Application environment of node rabbit@T-BJCA2-3RD-01 ... [{amqp_client,[{prefer_ipv6,false},{ssl_options,[]}]}, {asn1,[]}, {compiler,[]}, {cowboy,[]}, {cowlib,[]}, {crypto,[{fips_mode,false},{rand_cache_size,896}]}, {goldrush,[]}, {inets,[]}, {jsx,[]}, {kernel, [{inet_default_connect_options,[{nodelay,true}]}, {inet_dist_listen_max,25672}, {inet_dist_listen_min,25672}, {logger, [{handler,default,logger_std_h, #{config => #{type => standard_io}, formatter => {logger_formatter, #{legacy_header => true,single_line => false}}}}]}, {logger_level,notice}, {logger_sasl_compatible,false}]}, {lager, [{async_threshold,20}, {async_threshold_window,5}, {colored,false}, {colors, [{debug,"\e[0;38m"}, {info,"\e[1;37m"}, {notice,"\e[1;36m"}, {warning,"\e[1;33m"}, {error,"\e[1;31m"}, {critical,"\e[1;35m"}, {alert,"\e[1;44m"}, {emergency,"\e[1;41m"}]}, {crash_log,"log/crash.log"}, {crash_log_count,5}, {crash_log_date,"$D0"}, {crash_log_msg_size,65536}, {crash_log_rotator,lager_rotator_default}, {crash_log_size,10485760}, {error_logger_format_raw,true}, {error_logger_hwm,50}, {error_logger_hwm_original,50}, {error_logger_redirect,true}, {extra_sinks, [{error_logger_lager_event, [{handlers,[{lager_forwarder_backend,[lager_event,inherit]}]}, {rabbit_handlers, [{lager_forwarder_backend,[lager_event,inherit]}]}]}, {rabbit_log_lager_event, [{handlers,[{lager_forwarder_backend,[lager_event,inherit]}]}, {rabbit_handlers, [{lager_forwarder_backend,[lager_event,inherit]}]}]}, {rabbit_log_channel_lager_event, [{handlers,[{lager_forwarder_backend,[lager_event,inherit]}]}, {rabbit_handlers, [{lager_forwarder_backend,[lager_event,inherit]}]}]}, {rabbit_log_connection_lager_event, [{handlers,[{lager_forwarder_backend,[lager_event,inherit]}]}, {rabbit_handlers, [{lager_forwarder_backend,[lager_event,inherit]}]}]}, {rabbit_log_mirroring_lager_event, [{handlers,[{lager_forwarder_backend,[lager_event,inherit]}]}, {rabbit_handlers, [{lager_forwarder_backend,[lager_event,inherit]}]}]}, {rabbit_log_queue_lager_event, [{handlers,[{lager_forwarder_backend,[lager_event,inherit]}]}, {rabbit_handlers, [{lager_forwarder_backend,[lager_event,inherit]}]}]}, {rabbit_log_federation_lager_event, [{handlers,[{lager_forwarder_backend,[lager_event,inherit]}]}, {rabbit_handlers, [{lager_forwarder_backend,[lager_event,inherit]}]}]}, {rabbit_log_upgrade_lager_event, [{handlers, [{lager_file_backend, [{date,[]}, {file, "/mnt/data02/rabbitmq/log/rabbit@T-BJCA2-3RD-01_upgrade.log"}, {formatter_config, [date," ",time," ",color,"[",severity,"] ", {pid,[]}, " ",message,"\n"]}, {level,error}, {size,0}]}]}, {rabbit_handlers, [{lager_file_backend, [{date,[]}, {file, "/mnt/data02/rabbitmq/log/rabbit@T-BJCA2-3RD-01_upgrade.log"}, {formatter_config, [date," ",time," ",color,"[",severity,"] ", {pid,[]}, " ",message,"\n"]}, {level,error}, {size,0}]}]}]}]}, {handlers, [{lager_file_backend, [{date,[]}, {file,"/mnt/data02/rabbitmq/log/[email protected]"}, {formatter_config, [date," ",time," ",color,"[",severity,"] ", {pid,[]}, " ",message,"\n"]}, {level,error}, {size,0}]}]}, {log_root,"/mnt/data02/rabbitmq/log"}, {rabbit_handlers, [{lager_file_backend, [{date,[]}, {file,"/mnt/data02/rabbitmq/log/[email protected]"}, {formatter_config, [date," ",time," ",color,"[",severity,"] ", {pid,[]}, " ",message,"\n"]}, {level,error}, {size,0}]}]}]}, {mnesia,[{dir,"/mnt/data02/rabbitmq/data/rabbit@T-BJCA2-3RD-01"}]}, {os_mon, [{start_cpu_sup,false}, {start_disksup,false}, {start_memsup,false}, {start_os_sup,false}]}, {public_key,[]}, {rabbit, [{auth_backends,[rabbit_auth_backend_internal]}, {auth_mechanisms,['PLAIN','AMQPLAIN']}, {autocluster, [{peer_discovery_backend,rabbit_peer_discovery_classic_config}]}, {background_gc_enabled,false}, {background_gc_target_interval,60000}, {backing_queue_module,rabbit_priority_queue}, {channel_max,2047}, {channel_operation_timeout,15000}, {cluster_keepalive_interval,10000}, {cluster_nodes,{[],disc}}, {cluster_partition_handling,autoheal}, {collect_statistics,fine}, {collect_statistics_interval,5000}, {config_entry_decoder, [{cipher,aes_cbc256}, {hash,sha512}, {iterations,1000}, {passphrase,undefined}]}, {connection_max,infinity}, {credit_flow_default_credit,{400,200}}, {default_consumer_prefetch,{false,0}},
Here is rabbitmq log:
`2023-03-30 23:07:22.134 [error] <0.26190.1585> Supervisor {<0.26190.1585>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error
2023-03-30 23:10:45.256 [error] <0.9600.1587> Supervisor {<0.9600.1587>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error
2023-03-30 23:11:48.731 [error] <0.22394.1587> Supervisor {<0.22394.1587>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error
2023-03-30 23:11:53.478 [error] <0.25652.1587> Supervisor {<0.25652.1587>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error
2023-03-30 23:12:39.761 [error] <0.11639.1588> Supervisor {<0.11639.1588>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error
2023-03-30 23:12:42.091 [error] <0.10141.1588> CRASH REPORT Process <0.10141.1588> with 0 neighbours exited with reason: {shutdown,{gen_server2,call,[<0.2805.0>,{submit,#Fun<rabbit_mgmt_db.27.82356814>,<0.10141.1588>,reuse},infinity]}} in gen_server2:call/3 line 329 in gen_server2:call/3 line 329
2023-03-30 23:12:42.092 [error] <0.2747.1588> CRASH REPORT Process <0.2747.1588> with 0 neighbours exited with reason: {shutdown,{gen_server2,call,[<0.2804.0>,{submit,#Fun<rabbit_mgmt_db.27.82356814>,<0.2747.1588>,reuse},infinity]}} in gen_server2:call/3 line 329 in gen_server2:call/3 line 329
2023-03-30 23:12:42.093 [error] <0.9262.1588> CRASH REPORT Process <0.9262.1588> with 0 neighbours exited with reason: {shutdown,{gen_server2,call,[<0.2803.0>,{submit,#Fun<rabbit_mgmt_db.27.82356814>,<0.9262.1588>,reuse},infinity]}} in gen_server2:call/3 line 329 in gen_server2:call/3 line 329
2023-03-30 23:12:42.093 [error] <0.21059.1588> CRASH REPORT Process <0.21059.1588> with 0 neighbours exited with reason: {shutdown,{gen_server2,call,[management_worker_pool,{next_free,<0.21059.1588>},infinity]}} in gen_server2:call/3 line 329 in gen_server2:call/3 line 329
2023-03-30 23:12:42.568 [error] <0.13955.2979> Error on AMQP connection <0.13955.2979> (192.172.1.22:49284 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.568 [error] <0.11850.6335> Error on AMQP connection <0.11850.6335> (192.172.1.22:42026 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.568 [error] <0.23376.6335> Error on AMQP connection <0.23376.6335> (192.172.1.21:45766 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.568 [error] <0.3384.1440> Error on AMQP connection <0.3384.1440> (192.172.1.21:39406 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.568 [error] <0.23948.6335> Error on AMQP connection <0.23948.6335> (192.172.1.22:42934 -> 192.172.1.11:5672 - DRDCIEC104Charge-prodBJCSet:EC-CM-EstimatedFinishTime:Leader, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.568 [error] <0.14055.2979> Error on AMQP connection <0.14055.2979> (192.172.1.22:49258 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.568 [error] <0.17880.6335> Error on AMQP connection <0.17880.6335> (192.172.1.21:44744 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.568 [error] <0.2895.1317> Error on AMQP connection <0.2895.1317> (192.172.1.21:37020 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.569 [error] <0.14277.2979> Error on AMQP connection <0.14277.2979> (192.172.1.22:49370 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.569 [error] <0.13041.2979> Error on AMQP connection <0.13041.2979> (192.172.1.22:49174 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.569 [error] <0.17901.6336> Error on AMQP connection <0.17901.6336> (192.172.1.21:47006 -> 192.172.1.11:5672 - DRDCV3ChargeSet-prodBJCSetV3:EC-CM-StopCharge:Leader, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.569 [error] <0.3083.2981> Error on AMQP connection <0.3083.2981> (192.172.1.21:43388 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.569 [error] <0.20893.6335> Error on AMQP connection <0.20893.6335> (192.172.1.22:42546 -> 192.172.1.11:5672 - DRDCIEC104Charge-prodBJCSet:EC-CM-StopCharge:Leader, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.569 [error] <0.17655.6336> Error on AMQP connection <0.17655.6336> (192.172.1.22:43984 -> 192.172.1.11:5672 - DRDCIEC104Charge-prodBJCSet:EC-CM-Meter:Leader, vhost: '/', user: 'Teld', state: blocked), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.569 [error] <0.15002.2979> Error on AMQP connection <0.15002.2979> (192.172.1.22:49592 -> 192.172.1.11:5672 - DRDCV3RealTimeData-prodBJCSetV3:EC-CM-FullCharge:Leader, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.569 [error] <0.18324.6335> Error on AMQP connection <0.18324.6335> (192.172.1.21:44932 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.569 [error] <0.21654.6335> Error on AMQP connection <0.21654.6335> (192.172.1.21:45428 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.569 [error] <0.9427.2979> Error on AMQP connection <0.9427.2979> (192.172.1.21:41680 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.569 [error] <0.16518.0> Error on AMQP connection <0.16518.0> (192.172.1.22:41246 -> 192.172.1.11:5672 - DRDCV3ChargeSet-prodBJCSetV3:EC-CM-DevStartChargeApply:Leader, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.569 [error] <0.16521.0> Error on AMQP connection <0.16521.0> (192.172.1.21:51474 -> 192.172.1.11:5672 - DRDCIEC104Charge-prodBJCSet:EC-CM-ChargerSuspendTimeout:Leader, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:42.569 [error] <0.14820.2979> Error on AMQP connection <0.14820.2979> (192.172.1.21:42302 -> 192.172.1.11:5672 - DRDCIEC104Charge-prodBJCSet:EC-CM-FullCharge:Leader, vhost: '/', user: 'Teld', state: running), channel 0:
operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'"
2023-03-30 23:12:53.011 [warning] lager_file_backend dropped 845 messages in the last second that exceeded the limit of 50 messages/sec
2023-03-30 23:12:53.403 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 982:error while terminating:
shutdown
2023-03-30 23:12:53.404 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 980:error while terminating:
shutdown
2023-03-30 23:12:53.404 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 971:error while terminating:
shutdown
2023-03-30 23:12:53.404 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 972:error while terminating:
shutdown
2023-03-30 23:12:53.404 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 981:error while terminating:
shutdown
2023-03-30 23:12:53.405 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 970:error while terminating:
shutdown
2023-03-30 23:12:53.406 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 975:error while terminating:
shutdown
2023-03-30 23:12:53.408 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 978:error while terminating:
shutdown
2023-03-30 23:12:53.408 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 727:error while terminating:
shutdown
2023-03-30 23:12:53.408 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 973:error while terminating:
shutdown
2023-03-30 23:12:53.410 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 976:error while terminating:
shutdown
2023-03-30 23:12:53.413 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 991:error while terminating:
shutdown
2023-03-30 23:12:53.415 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 238:error while terminating:
shutdown
2023-03-30 23:12:53.415 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 990:error while terminating:
shutdown
2023-03-30 23:12:53.415 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 983:error while terminating:
shutdown
2023-03-30 23:12:53.416 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 974:error while terminating:
shutdown
2023-03-30 23:12:53.417 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 984:error while terminating:
shutdown
2023-03-30 23:12:53.418 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 243:error while terminating:
shutdown
2023-03-30 23:12:53.418 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 724:error while terminating:
shutdown
2023-03-30 23:12:53.418 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 992:error while terminating:
shutdown
2023-03-30 23:12:53.418 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 994:error while terminating:
shutdown
2023-03-30 23:12:53.419 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 736:error while terminating:
shutdown
2023-03-30 23:12:53.419 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 997:error while terminating:
shutdown
2023-03-30 23:12:53.419 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 746:error while terminating:
shutdown
2023-03-30 23:12:53.419 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 989:error while terminating:
shutdown
2023-03-30 23:12:53.420 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 985:error while terminating:
shutdown
2023-03-30 23:12:53.673 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 993:error while terminating:
shutdown
2023-03-30 23:12:53.674 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 979:error while terminating:
shutdown
2023-03-30 23:12:53.674 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 986:error while terminating:
shutdown
2023-03-30 23:12:53.674 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1001:error while terminating:
shutdown
2023-03-30 23:12:53.674 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 998:error while terminating:
shutdown
2023-03-30 23:12:53.674 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 987:error while terminating:
shutdown
2023-03-30 23:12:53.674 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 739:error while terminating:
shutdown
2023-03-30 23:12:53.674 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 995:error while terminating:
shutdown
2023-03-30 23:12:53.675 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1000:error while terminating:
shutdown
2023-03-30 23:12:53.675 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 735:error while terminating:
shutdown
2023-03-30 23:12:53.675 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 996:error while terminating:
shutdown
2023-03-30 23:12:53.675 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 988:error while terminating:
shutdown
2023-03-30 23:12:53.700 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 999:error while terminating:
shutdown
2023-03-30 23:12:53.700 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 730:error while terminating:
shutdown
2023-03-30 23:12:53.701 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 715:error while terminating:
shutdown
2023-03-30 23:12:53.703 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 242:error while terminating:
shutdown
2023-03-30 23:12:53.703 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 713:error while terminating:
shutdown
2023-03-30 23:12:53.703 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 744:error while terminating:
shutdown
2023-03-30 23:12:53.705 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 743:error while terminating:
shutdown
2023-03-30 23:12:53.705 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 720:error while terminating:
shutdown
2023-03-30 23:12:53.707 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 726:error while terminating:
shutdown
2023-03-30 23:12:53.707 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 795:error while terminating:
shutdown
2023-03-30 23:12:53.707 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 745:error while terminating:
shutdown
2023-03-30 23:12:54.009 [warning] lager_file_backend dropped 27 messages in the last second that exceeded the limit of 50 messages/sec
2023-03-30 23:12:54.072 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1023:error while terminating:
shutdown
2023-03-30 23:12:54.073 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1020:error while terminating:
shutdown
2023-03-30 23:12:54.074 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1008:error while terminating:
shutdown
2023-03-30 23:12:54.075 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1016:error while terminating:
shutdown
2023-03-30 23:12:54.076 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1005:error while terminating:
shutdown
2023-03-30 23:12:54.077 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1004:error while terminating:
shutdown
2023-03-30 23:12:54.077 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1024:error while terminating:
shutdown
2023-03-30 23:12:54.078 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1022:error while terminating:
shutdown
2023-03-30 23:12:54.079 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1006:error while terminating:
shutdown
2023-03-30 23:12:54.080 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1003:error while terminating:
shutdown
2023-03-30 23:12:54.081 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1012:error while terminating:
shutdown
2023-03-30 23:12:54.082 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1011:error while terminating:
shutdown
2023-03-30 23:12:54.082 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1010:error while terminating:
shutdown
2023-03-30 23:12:54.082 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1014:error while terminating:
shutdown
2023-03-30 23:12:54.082 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1026:error while terminating:
shutdown
2023-03-30 23:12:54.082 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1009:error while terminating:
shutdown
2023-03-30 23:12:54.083 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1013:error while terminating:
shutdown
2023-03-30 23:12:54.083 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1038:error while terminating:
shutdown
2023-03-30 23:12:54.084 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1035:error while terminating:
shutdown
2023-03-30 23:12:54.084 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1027:error while terminating:
shutdown
2023-03-30 23:12:54.084 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1034:error while terminating:
shutdown
2023-03-30 23:12:54.084 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1028:error while terminating:
shutdown
2023-03-30 23:12:54.084 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1025:error while terminating:
shutdown
2023-03-30 23:12:54.085 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1031:error while terminating:
shutdown
2023-03-30 23:12:54.085 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1042:error while terminating:
shutdown
2023-03-30 23:12:54.088 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1037:error while terminating:
shutdown
2023-03-30 23:12:54.089 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1039:error while terminating:
shutdown
2023-03-30 23:12:54.124 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1045:error while terminating:
shutdown
2023-03-30 23:12:54.426 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1044:error while terminating:
shutdown
2023-03-30 23:12:54.426 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1040:error while terminating:
shutdown
2023-03-30 23:12:54.426 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1041:error while terminating:
shutdown
2023-03-30 23:12:54.426 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1046:error while terminating:
shutdown
2023-03-30 23:12:54.426 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1043:error while terminating:
shutdown
2023-03-30 23:12:54.426 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1033:error while terminating:
shutdown
2023-03-30 23:12:54.426 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1030:error while terminating:
shutdown
2023-03-30 23:12:54.426 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1029:error while terminating:
shutdown
2023-03-30 23:12:54.426 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1036:error while terminating:
shutdown
2023-03-30 23:12:54.426 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1032:error while terminating:
shutdown
2023-03-30 23:12:54.427 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1047:error while terminating:
shutdown
2023-03-30 23:12:54.427 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1052:error while terminating:
shutdown
2023-03-30 23:12:54.427 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1054:error while terminating:
shutdown
2023-03-30 23:12:54.427 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1050:error while terminating:
shutdown
2023-03-30 23:12:54.427 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1049:error while terminating:
shutdown
2023-03-30 23:12:54.427 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1056:error while terminating:
shutdown
2023-03-30 23:12:54.427 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1051:error while terminating:
shutdown
2023-03-30 23:12:54.428 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1048:error while terminating:
shutdown
2023-03-30 23:12:54.428 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1057:error while terminating:
shutdown
2023-03-30 23:12:54.428 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1053:error while terminating:
shutdown
2023-03-30 23:12:54.428 [error] <0.16471.6335> Error on AMQP connection <0.16471.6335> (192.172.1.22:41974 -> 192.172.1.11:5672, vhost: '/', user: 'Teld', state: running), channel 1058:error while terminating:
shutdown
2023-03-30 23:12:55.012 [warning] lager_file_backend dropped 434 messages in the last second that exceeded the limit of 50 messages/sec
2023-03-30 23:12:57.619 [error] <0.16783.0> ** Generic server <0.16783.0> terminating
** Last message in was {'EXIT',<0.16782.0>,killed}
** When Server state == {state,{<0.16783.0>,rabbit_connection_helper_sup},one_for_one,[{child,<0.16808.0>,channel_sup_sup,{rabbit_channel_sup_sup,start_link,[]},intrinsic,infinity,supervisor,[rabbit_channel_sup_sup]},{child,<0.16787.0>,heartbeat_receiver,{rabbit_heartbeat,start_heartbeat_receiver,[#Port<0.250>,60,#Fun<rabbit_reader.37.58201347>,{heartbeat_receiver,<<"192.172.1.22:41268 -> 192.172.1.11:5672">>}]},transient,30000,worker,[rabbit_heartbeat]},{child,<0.16786.0>,heartbeat_sender,{rabbit_heartbeat,start_heartbeat_sender,[#Port<0.250>,60,#Fun<rabbit_reader.36.58201347>,{heartbeat_sender,<<"192.172.1.22:41268 -> 192.172.1.11:5672">>}]},transient,30000,worker,[rabbit_heartbeat]},{child,<0.16785.0>,collector,{rabbit_queue_collector,start_link,[<<"192.172.1.22:41268 -> 192.172.1.11:5672">>]},intrinsic,30000,worker,[rabbit_queue_collector]}],undefined,10,10,[],0,rabbit_connection_helper_sup,[]}
** Reason for termination ==
** killed
2023-03-30 23:12:57.619 [error] <0.16783.0> CRASH REPORT Process <0.16783.0> with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432
2023-03-30 23:12:57.622 [error] <0.17735.6336> ** Generic server <0.17735.6336> terminating
** Last message in was {'EXIT',<0.17617.6336>,killed}
** When Server state == {state,{<0.17735.6336>,rabbit_connection_helper_sup},one_for_one,[{child,<0.17675.6336>,channel_sup_sup,{rabbit_channel_sup_sup,start_link,[]},intrinsic,infinity,supervisor,[rabbit_channel_sup_sup]},{child,<0.17446.6336>,heartbeat_receiver,{rabbit_heartbeat,start_heartbeat_receiver,[#Port<0.569976>,60,#Fun<rabbit_reader.37.58201347>,{heartbeat_receiver,<<"192.172.1.21:46982 -> 192.172.1.11:5672">>}]},transient,30000,worker,[rabbit_heartbeat]},{child,<0.17490.6336>,heartbeat_sender,{rabbit_heartbeat,start_heartbeat_sender,[#Port<0.569976>,60,#Fun<rabbit_reader.36.58201347>,{heartbeat_sender,<<"192.172.1.21:46982 -> 192.172.1.11:5672">>}]},transient,30000,worker,[rabbit_heartbeat]},{child,<0.17793.6336>,collector,{rabbit_queue_collector,start_link,[<<"192.172.1.21:46982 -> 192.172.1.11:5672">>]},intrinsic,30000,worker,[rabbit_queue_collector]}],undefined,10,10,[],0,rabbit_connection_helper_sup,[]}
** Reason for termination ==
** killed
2023-03-30 23:12:57.623 [error] <0.17735.6336> CRASH REPORT Process <0.17735.6336> with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432
2023-03-30 23:12:57.624 [error] <0.3238.2981> ** Generic server <0.3238.2981> terminating
** Last message in was {'EXIT',<0.3188.2981>,killed}
** When Server state == {state,{<0.3238.2981>,rabbit_connection_helper_sup},one_for_one,[{child,<0.3401.2981>,channel_sup_sup,{rabbit_channel_sup_sup,start_link,[]},intrinsic,infinity,supervisor,[rabbit_channel_sup_sup]},{child,<0.3222.2981>,heartbeat_receiver,{rabbit_heartbeat,start_heartbeat_receiver,[#Port<0.281872>,60,#Fun<rabbit_reader.37.58201347>,{heartbeat_receiver,<<"192.172.1.21:43388 -> 192.172.1.11:5672">>}]},transient,30000,worker,[rabbit_heartbeat]},{child,<0.3312.2981>,heartbeat_sender,{rabbit_heartbeat,start_heartbeat_sender,[#Port<0.281872>,60,#Fun<rabbit_reader.36.58201347>,{heartbeat_sender,<<"192.172.1.21:43388 -> 192.172.1.11:5672">>}]},transient,30000,worker,[rabbit_heartbeat]},{child,<0.3262.2981>,collector,{rabbit_queue_collector,start_link,[<<"192.172.1.21:43388 -> 192.172.1.11:5672">>]},intrinsic,30000,worker,[rabbit_queue_collector]}],undefined,10,10,[],0,rabbit_connection_helper_sup,[]}
** Reason for termination ==
** killed
2023-03-30 23:12:57.624 [error] <0.3238.2981> CRASH REPORT Process <0.3238.2981> with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432
2023-03-30 23:12:57.635 [error] <0.3517.2981> ** Generic server <0.3517.2981> terminating
** Last message in was {'EXIT',<0.3373.2981>,killed}
** When Server state == {state,{<0.3517.2981>,rabbit_connection_helper_sup},one_for_one,[{child,<0.3629.2981>,channel_sup_sup,{rabbit_channel_sup_sup,start_link,[]},intrinsic,infinity,supervisor,[rabbit_channel_sup_sup]},{child,<0.3800.2981>,heartbeat_receiver,{rabbit_heartbeat,start_heartbeat_receiver,[#Port<0.281899>,60,#Fun<rabbit_reader.37.58201347>,{heartbeat_receiver,<<"192.172.1.21:43442 -> 192.172.1.11:5672">>}]},transient,30000,worker,[rabbit_heartbeat]},{child,<0.3731.2981>,heartbeat_sender,{rabbit_heartbeat,start_heartbeat_sender,[#Port<0.281899>,60,#Fun<rabbit_reader.36.58201347>,{heartbeat_sender,<<"192.172.1.21:43442 -> 192.172.1.11:5672">>}]},transient,30000,worker,[rabbit_heartbeat]},{child,<0.32247.2980>,collector,{rabbit_queue_collector,start_link,[<<"192.172.1.21:43442 -> 192.172.1.11:5672">>]},intrinsic,30000,worker,[rabbit_queue_collector]}],undefined,10,10,[],0,rabbit_connection_helper_sup,[]}
** Reason for termination ==
** killed
2023-03-30 23:12:57.635 [error] <0.3525.2981> ** Generic server <0.3525.2981> terminating
** Last message in was {'EXIT',<0.3392.2981>,killed}
** When Server state == {state,{<0.3525.2981>,rabbit_connection_helper_sup},one_for_one,[{child,<0.3344.2981>,channel_sup_sup,{rabbit_channel_sup_sup,start_link,[]},intrinsic,infinity,supervisor,[rabbit_channel_sup_sup]},{child,<0.3357.2981>,heartbeat_receiver,{rabbit_heartbeat,start_heartbeat_receiver,[#Port<0.281892>,60,#Fun<rabbit_reader.37.58201347>,{heartbeat_receiver,<<"192.172.1.22:50710 -> 192.172.1.11:5672">>}]},transient,30000,worker,[rabbit_heartbeat]},{child,<0.3445.2981>,heartbeat_sender,{rabbit_heartbeat,start_heartbeat_sender,[#Port<0.281892>,60,#Fun<rabbit_reader.36.58201347>,{heartbeat_sender,<<"192.172.1.22:50710 -> 192.172.1.11:5672">>}]},transient,30000,worker,[rabbit_heartbeat]},{child,<0.3752.2981>,collector,{rabbit_queue_collector,start_link,[<<"192.172.1.22:50710 -> 192.172.1.11:5672">>]},intrinsic,30000,worker,[rabbit_queue_collector]}],undefined,10,10,[],0,rabbit_connection_helper_sup,[]}
** Reason for termination ==
** killed
2023-03-30 23:12:57.635 [error] <0.3517.2981> CRASH REPORT Process <0.3517.2981> with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432
2023-03-30 23:12:57.636 [error] <0.3525.2981> CRASH REPORT Process <0.3525.2981> with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432
2023-03-30 23:12:57.689 [error] <0.3334.2981> ** Generic server <0.3334.2981> terminating
** Last message in was {'EXIT',<0.2341.2981>,killed}
** When Server state == {state,{<0.3334.2981>,rabbit_connection_helper_sup},one_for_one,[{child,<0.3251.2981>,channel_sup_sup,{rabbit_channel_sup_sup,start_link,[]},intrinsic,infinity,supervisor,[rabbit_channel_sup_sup]},{child,<0.3418.2981>,heartbeat_receiver,{rabbit_heartbeat,start_heartbeat_receiver,[#Port<0.281883>,60,#Fun<rabbit_reader.37.58201347>,{heartbeat_receiver,<<"192.172.1.21:43394 -> 192.172.1.11:5672">>}]},transient,30000,worker,[rabbit_heartbeat]},{child,<0.3240.2981>,heartbeat_sender,{rabbit_heartbeat,start_heartbeat_sender,[#Port<0.281883>,60,#Fun<rabbit_reader.36.58201347>,{heartbeat_sender,<<"192.172.1.21:43394 -> 192.172.1.11:5672">>}]},transient,30000,worker,[rabbit_heartbeat]},{child,<0.3330.2981>,collector,{rabbit_queue_collector,start_link,[<<"192.172.1.21:43394 -> 192.172.1.11:5672">>]},intrinsic,30000,worker,[rabbit_queue_collector]}],undefined,10,10,[],0,rabbit_connection_helper_sup,[]}
** Reason for termination ==
** killed
2023-03-30 23:12:57.689 [error] <0.3334.2981> CRASH REPORT Process <0.3334.2981> with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432
2023-03-30 23:12:57.933 [error] <0.17873.6336> ** Generic server <0.17873.6336> terminating
** Last message in was {'EXIT',<0.17997.6336>,killed}
** When Server state == {state,{<0.17873.6336>,rabbit_connection_helper_sup},one_for_one,[{child,<0.13591.6336>,channel_sup_sup,{rabbit_channel_sup_sup,start_link,[]},intrinsic,infinity,supervisor,[rabbit_channel_sup_sup]},{child,<0.17531.6336>,heartbeat_receiver,{rabbit_heartbeat,start_heartbeat_receiver,[#Port<0.569984>,60,#Fun<rabbit_reader.37.58201347>,{heartbeat_receiver,<<"192.172.1.21:46988 -> 192.172.1.11:5672">>}]},transient,30000,worker,[rabbit_heartbeat]},{child,<0.17782.6336>,heartbeat_sender,{rabbit_heartbeat,start_heartbeat_sender,[#Port<0.569984>,60,#Fun<rabbit_reader.36.58201347>,{heartbeat_sender,<<"192.172.1.21:46988 -> 192.172.1.11:5672">>}]},transient,30000,worker,[rabbit_heartbeat]},{child,<0.17804.6336>,collector,{rabbit_queue_collector,start_link,[<<"192.172.1.21:46988 -> 192.172.1.11:5672">>]},intrinsic,30000,worker,[rabbit_queue_collector]}],undefined,10,10,[],0,rabbit_connection_helper_sup,[]}
** Reason for termination ==
** killed
2023-03-30 23:12:57.934 [error] <0.17873.6336> CRASH REPORT Process <0.17873.6336> with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432
2023-03-30 23:13:17.664 [error] <0.13621.6336> Supervisor {<0.13621.6336>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"amq.gen-I3_hVSDetuwb02ESxgE0Sw">>},false,true,<0.13129.6336>,...}, declare, <0.13102.6336>) at <0.13190.6336> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.837 [error] <0.1535.0> Supervisor {<0.1535.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"CSM-GroundLockStateChangedSubscriber_Transfer">>},true,false,...}, slave, <0.1534.0>) at <0.1536.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.839 [error] <0.23847.6335> Supervisor {<0.23847.6335>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"amq.gen-lAjwGCo1sfdD4K36Mh9uFQ">>},false,true,<0.23798.6335>,...}, declare, <0.23851.6335>) at <0.20639.6335> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.848 [error] <0.1229.0> Supervisor {<0.1229.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"HaDSPDataQueue1">>},true,false,none,[],<14914.847.0>,[<14915.3264.0>],...}, slave, <0.1228.0>) at <0.1230.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.849 [error] <0.1407.0> Supervisor {<0.1407.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"CpCommandBrgThirdProt-ieslab-T-BJCA2-RTE-02">>},true,false,...}, slave, <0.1406.0>) at <0.1408.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.849 [error] <0.1440.0> Supervisor {<0.1440.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"CpCommandBrgThirdProt-costar-T-BJCA2-RTE-02">>},true,false,...}, slave, <0.1439.0>) at <0.1441.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.850 [error] <0.8053.2979> Supervisor {<0.8053.2979>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"amq.gen-gxvySmQnf9_Q-EDZS5fK4A">>},false,true,<0.6947.2979>,...}, declare, <0.7932.2979>) at <0.8037.2979> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.850 [error] <0.2012.0> Supervisor {<0.2012.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"CpCommandBrgQueue-T-BJCA2-RTE-03">>},true,false,none,[],<14914.1001.4623>,...}, slave, <0.2011.0>) at <0.2013.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.851 [error] <0.1899.0> Supervisor {<0.1899.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"HaPatchInstallerQueue">>},true,false,none,[],<14914.1154.0>,...}, slave, <0.1898.0>) at <0.1900.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.852 [error] <0.1855.0> Supervisor {<0.1855.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"CpCommandBrgThirdProt-sinexcel-T-BJCA2-RTE-01">>},true,false,...}, slave, <0.1854.0>) at <0.1856.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.852 [error] <0.1399.0> Supervisor {<0.1399.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"CpCommandBrgThirdProt-zhongxing-T-BJCA2-RTE-01">>},true,false,...}, slave, <0.1398.0>) at <0.1400.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.852 [error] <0.2066.0> Supervisor {<0.2066.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"HaCES-TaskForReceiveGunDisconnect8Queue">>},true,false,none,...}, slave, <0.2065.0>) at <0.2067.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.853 [error] <0.952.0> Supervisor {<0.952.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"HaSMS3rdQueue">>},true,false,none,[],<14914.735.0>,[<14915.3077.0>],...}, slave, <0.951.0>) at <0.953.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.853 [error] <0.1391.0> Supervisor {<0.1391.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"CpCommandBrgThirdProt-snail-T-BJCA2-RTE-02">>},true,false,none,...}, slave, <0.1390.0>) at <0.1392.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.854 [error] <0.1731.0> Supervisor {<0.1731.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"CpCommandBrgThirdProt-xinye-T-BJCA2-RTE-02">>},true,false,none,...}, slave, <0.1729.0>) at <0.1732.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.854 [error] <0.1812.0> Supervisor {<0.1812.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"HaOpenCM-ThirdStopChargeBillQueue">>},true,false,none,[],<14914.1094.0>,...}, slave, <0.1811.0>) at <0.1815.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.854 [error] <0.1096.0> Supervisor {<0.1096.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"HACCHD-BJC.A2.SCH.02.HSF.8003">>},true,false,none,[],<14914.12013.4011>,...}, slave, <0.1095.0>) at <0.1097.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.855 [error] <0.2148.0> Supervisor {<0.2148.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"HaSGPChargeTraffic-DataCenterCheckTaskQueue">>},true,false,...}, slave, <0.2147.0>) at <0.2149.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.855 [error] <0.1603.0> Supervisor {<0.1603.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"HaEventCenter#TFSSyncWithSYS-SubscriberQueue">>},true,false,...}, slave, <0.1602.0>) at <0.1604.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.856 [error] <0.1719.0> Supervisor {<0.1719.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"HACCHD-BJC.A2.SCH.01.SCH.8004">>},true,false,none,[],<14914.650.0>,...}, slave, <0.1718.0>) at <0.1720.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.856 [error] <0.1912.0> Supervisor {<0.1912.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"HaCM-Gen-FullChargeEventTaskQueue">>},true,false,none,[],<14914.1158.0>,...}, slave, <0.1911.0>) at <0.1913.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.857 [error] <0.1993.0> Supervisor {<0.1993.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"HaCES-TaskForReceiveCtrlOffline3Queue">>},true,false,none,[],...}, slave, <0.1992.0>) at <0.1994.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.857 [error] <0.1743.0> Supervisor {<0.1743.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"CpCommandBrgThirdProt-taiyong-T-BJCA2-RTE-01">>},true,false,...}, slave, <0.1742.0>) at <0.1744.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.857 [error] <0.1168.0> Supervisor {<0.1168.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"HaCM-Gen-ForecastConfirmResultQueue">>},true,false,none,[],...}, slave, <0.1167.0>) at <0.1169.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.858 [error] <0.3272.2981> Supervisor {<0.3272.2981>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"amq.gen-74_8nJUV6wfebOvSWvmoQg">>},false,true,<0.3083.2981>,...}, declare, <0.3353.2981>) at <0.3075.2981> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.862 [error] <0.1827.0> Supervisor {<0.1827.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"HACCHD-BJC.A2.VRDC.01.MAC">>},true,false,none,[],<14914.13747.4011>,...}, slave, <0.1826.0>) at <0.1828.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.862 [error] <0.1312.0> Supervisor {<0.1312.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"HaBJCA2VRDC02MAC3Queue">>},true,false,none,[],<14914.21304.8062>,...}, slave, <0.1311.0>) at <0.1313.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.863 [error] <0.1543.0> Supervisor {<0.1543.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"CpCommandBrgThirdProt-teld-T-BJCA2-RTE-03">>},true,false,none,...}, slave, <0.1542.0>) at <0.1544.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.864 [error] <0.6121.2980> Supervisor {<0.6121.2980>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"amq.gen-KYRF_xT7qBhq3ljz1PXZ7A">>},false,true,<0.6133.2980>,...}, declare, <0.6156.2980>) at <0.5810.2980> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.864 [error] <0.1863.0> Supervisor {<0.1863.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"CpCommandBrgThirdProt-yunshan-T-BJCA2-RTE-02">>},true,false,...}, slave, <0.1862.0>) at <0.1864.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.865 [error] <0.1136.0> Supervisor {<0.1136.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"CpCommandBrgThirdProt-hekang-T-BJCA2-RTE-02">>},true,false,...}, slave, <0.1135.0>) at <0.1137.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:17.865 [error] <0.1367.0> Supervisor {<0.1367.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"HaDRDC2-RecieveCtrlStateChangeExecutorQueue">>},true,false,...}, slave, <0.1366.0>) at <0.1368.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:18.410 [error] <0.1307.0> Supervisor {<0.1307.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"routeSwitchT-BJCA2-RTE-01">>},true,false,none,[],<14914.13147.127>,...}, slave, <0.1306.0>) at <0.1309.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:18.410 [error] <0.12963.6335> Supervisor {<0.12963.6335>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"amq.gen-yY6R6BvSVzLKSEnz5dqG2Q">>},false,true,<0.13132.6335>,...}, declare, <0.12990.6335>) at <0.12800.6335> exit with reason killed in context shutdown_error
2023-03-30 23:13:18.411 [error] <0.1144.0> Supervisor {<0.1144.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"CpCommandBrgQueue-T-BJCA2-RTE-01">>},true,false,none,[],<14914.22441.5377>,...}, slave, <0.1143.0>) at <0.1145.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:19.012 [warning] lager_file_backend dropped 311 messages in the last second that exceeded the limit of 50 messages/sec
2023-03-30 23:13:48.151 [error] <0.375.0> Supervisor rabbit_event_sup had child rabbit_event started with rabbit_event:start_link() at <0.376.0> exit with reason killed in context shutdown_error
2023-03-30 23:13:48.153 [error] <0.18815.1588> ** Generic server <0.18815.1588> terminating
** Last message in was {'$gen_cast',{method,{'queue.bind',0,<<"CpCommandBrgThirdProt-xinye-T-BJCA2-RTE-02">>,<<"CpCommand">>,<<>>,false,[]},none,noflow}}
** When Server state == {ch,running,rabbit_framing_amqp_0_9_1,1,<0.18593.1588>,<0.18938.1588>,<0.18593.1588>,<<"192.172.1.22:47096 -> 192.172.1.11:5672">>,{lstate,<0.18693.1588>,false},none,1,{[],[]},{user,<<"Teld">>,[administrator],[{rabbit_auth_backend_internal,none}]},<<"/">>,<<"CpCommandBrgThirdProt-xinye-T-BJCA2-RTE-02">>,#{},{state,{dict,0,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},erlang},#{},#{},{set,0,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},<0.19006.1588>,{state,fine,5000,#Ref<0.3811685947.3323461633.160843>},false,1,{{0,nil},{0,nil}},[],[],{{0,nil},{0,nil}},[{<<"connection.blocked">>,bool,true},{<<"consumer_cancel_notify">>,bool,true}],none,0,none,flow,[]}
** Reason for termination ==
** {{shutdown,{gen_server2,call,[<0.280.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.18815.1588>,single},infinity]}},[{gen_server2,call,3,[{file,"src/gen_server2.erl"},{line,329}]},{rabbit_misc,execute_mnesia_transaction,1,[{file,"src/rabbit_misc.erl"},{line,538}]},{rabbit_misc,execute_mnesia_tx_with_tail,1,[{file,"src/rabbit_misc.erl"},{line,580}]},{rabbit_channel,binding_action,9,[{file,"src/rabbit_channel.erl"},{line,1655}]},{rabbit_channel,handle_method,3,[{file,"src/rabbit_channel.erl"},{line,1423}]},{rabbit_channel,handle_cast,2,[{file,"src/rabbit_channel.erl"},{line,527}]},{gen_server2,handle_msg,2,[{file,"src/gen_server2.erl"},{line,1050}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,249}]}]}
2023-03-30 23:13:48.154 [error] <0.18415.1588> ** Generic server <0.18415.1588> terminating
** Last message in was {'$gen_cast',{method,{'queue.bind',0,<<"CpCommandBrgThirdProt-keda_v3_8-T-BJCA2-RTE-01">>,<<"CpCommand">>,<<>>,false,[]},none,noflow}}
** When Server state == {ch,running,rabbit_framing_amqp_0_9_1,1,<0.18981.1588>,<0.18890.1588>,<0.18981.1588>,<<"192.172.1.21:33616 -> 192.172.1.11:5672">>,{lstate,<0.19142.1588>,false},none,1,{[],[]},{user,<<"Teld">>,[administrator],[{rabbit_auth_backend_internal,none}]},<<"/">>,<<"CpCommandBrgThirdProt-keda_v3_8-T-BJCA2-RTE-01">>,#{},{state,{dict,0,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},erlang},#{},#{},{set,0,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},<0.18492.1588>,{state,fine,5000,#Ref<0.3811685947.3302752263.87837>},false,1,{{0,nil},{0,nil}},[],[],{{0,nil},{0,nil}},[{<<"connection.blocked">>,bool,true},{<<"consumer_cancel_notify">>,bool,true}],none,0,none,flow,[]}
** Reason for termination ==
** {{shutdown,{gen_server2,call,[<0.279.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.18415.1588>,single},infinity]}},[{gen_server2,call,3,[{file,"src/gen_server2.erl"},{line,329}]},{rabbit_misc,execute_mnesia_transaction,1,[{file,"src/rabbit_misc.erl"},{line,538}]},{rabbit_misc,execute_mnesia_tx_with_tail,1,[{file,"src/rabbit_misc.erl"},{line,580}]},{rabbit_channel,binding_action,9,[{file,"src/rabbit_channel.erl"},{line,1655}]},{rabbit_channel,handle_method,3,[{file,"src/rabbit_channel.erl"},{line,1423}]},{rabbit_channel,handle_cast,2,[{file,"src/rabbit_channel.erl"},{line,527}]},{gen_server2,handle_msg,2,[{file,"src/gen_server2.erl"},{line,1050}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,249}]}]}
2023-03-30 23:13:48.154 [error] <0.18815.1588> CRASH REPORT Process <0.18815.1588> with 0 neighbours exited with reason: {shutdown,{gen_server2,call,[<0.280.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.18815.1588>,single},infinity]}} in gen_server2:call/3 line 329 in gen_server2:terminate/3 line 1166
2023-03-30 23:13:48.154 [error] <0.18415.1588> CRASH REPORT Process <0.18415.1588> with 0 neighbours exited with reason: {shutdown,{gen_server2,call,[<0.279.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.18415.1588>,single},infinity]}} in gen_server2:call/3 line 329 in gen_server2:terminate/3 line 1166
2023-03-30 23:13:48.155 [error] <0.6831.1588> ** Generic server <0.6831.1588> terminating
** Last message in was {'$gen_cast',{method,{'queue.bind',0,<<"CpCommandBrgThirdProt-snail-T-BJCA2-RTE-02">>,<<"CpCommand">>,<<>>,false,[]},none,noflow}}
** When Server state == {ch,running,rabbit_framing_amqp_0_9_1,1,<0.7176.1588>,<0.6265.1588>,<0.7176.1588>,<<"192.172.1.21:32936 -> 192.172.1.11:5672">>,{lstate,<0.6891.1588>,false},none,1,{[],[]},{user,<<"Teld">>,[administrator],[{rabbit_auth_backend_internal,none}]},<<"/">>,<<"CpCommandBrgThirdProt-snail-T-BJCA2-RTE-02">>,#{},{state,{dict,0,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},erlang},#{},#{},{set,0,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},<0.6976.1588>,{state,fine,5000,#Ref<0.3811685947.2507669509.35104>},false,1,{{0,nil},{0,nil}},[],[],{{0,nil},{0,nil}},[{<<"connection.blocked">>,bool,true},{<<"consumer_cancel_notify">>,bool,true}],none,0,none,flow,[]}
** Reason for termination ==
** {{shutdown,{gen_server2,call,[<0.278.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.6831.1588>,single},infinity]}},[{gen_server2,call,3,[{file,"src/gen_server2.erl"},{line,329}]},{rabbit_misc,execute_mnesia_transaction,1,[{file,"src/rabbit_misc.erl"},{line,538}]},{rabbit_misc,execute_mnesia_tx_with_tail,1,[{file,"src/rabbit_misc.erl"},{line,580}]},{rabbit_channel,binding_action,9,[{file,"src/rabbit_channel.erl"},{line,1655}]},{rabbit_channel,handle_method,3,[{file,"src/rabbit_channel.erl"},{line,1423}]},{rabbit_channel,handle_cast,2,[{file,"src/rabbit_channel.erl"},{line,527}]},{gen_server2,handle_msg,2,[{file,"src/gen_server2.erl"},{line,1050}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,249}]}]}
2023-03-30 23:13:48.155 [error] <0.6831.1588> CRASH REPORT Process <0.6831.1588> with 0 neighbours exited with reason: {shutdown,{gen_server2,call,[<0.278.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.6831.1588>,single},infinity]}} in gen_server2:call/3 line 329 in gen_server2:terminate/3 line 1166
2023-03-30 23:13:48.156 [error] <0.6326.1588> Supervisor {<0.6326.1588>,rabbit_channel_sup} had child channel started with rabbit_channel:start_link(1, <0.7176.1588>, <0.6265.1588>, <0.7176.1588>, <<"192.172.1.21:32936 -> 192.172.1.11:5672">>, rabbit_framing_amqp_0_9_1, {user,<<"Teld">>,[administrator],[{rabbit_auth_backend_internal,none}]}, <<"/">>, [{<<"connection.blocked">>,bool,true},{<<"consumer_cancel_notify">>,bool,true}], <0.6976.1588>, <0.6891.1588>) at <0.6831.1588> exit with reason {shutdown,{gen_server2,call,[<0.278.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.6831.1588>,single},infinity]}} in gen_server2:call/3 line 329 in context shutdown_error
2023-03-30 23:13:48.157 [error] <0.18397.1588> Supervisor {<0.18397.1588>,rabbit_channel_sup} had child channel started with rabbit_channel:start_link(1, <0.18593.1588>, <0.18938.1588>, <0.18593.1588>, <<"192.172.1.22:47096 -> 192.172.1.11:5672">>, rabbit_framing_amqp_0_9_1, {user,<<"Teld">>,[administrator],[{rabbit_auth_backend_internal,none}]}, <<"/">>, [{<<"connection.blocked">>,bool,true},{<<"consumer_cancel_notify">>,bool,true}], <0.19006.1588>, <0.18693.1588>) at <0.18815.1588> exit with reason {shutdown,{gen_server2,call,[<0.280.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.18815.1588>,single},infinity]}} in gen_server2:call/3 line 329 in context shutdown_error
2023-03-30 23:13:48.157 [error] <0.18356.1588> Supervisor {<0.18356.1588>,rabbit_channel_sup} had child channel started with rabbit_channel:start_link(1, <0.18981.1588>, <0.18890.1588>, <0.18981.1588>, <<"192.172.1.21:33616 -> 192.172.1.11:5672">>, rabbit_framing_amqp_0_9_1, {user,<<"Teld">>,[administrator],[{rabbit_auth_backend_internal,none}]}, <<"/">>, [{<<"connection.blocked">>,bool,true},{<<"consumer_cancel_notify">>,bool,true}], <0.18492.1588>, <0.19142.1588>) at <0.18415.1588> exit with reason {shutdown,{gen_server2,call,[<0.279.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.18415.1588>,single},infinity]}} in gen_server2:call/3 line 329 in context shutdown_error
2023-03-30 23:13:48.158 [error] <0.15533.1588> ** Generic server <0.15533.1588> terminating
** Last message in was {'$gen_cast',{method,{'queue.bind',0,<<"CpCommandBrgThirdProt-painuoV1.2-T-BJCA2-RTE-01">>,<<"CpCommand">>,<<>>,false,[]},none,noflow}}
** When Server state == {ch,running,rabbit_framing_amqp_0_9_1,1,<0.18790.1588>,<0.18551.1588>,<0.18790.1588>,<<"192.172.1.21:33628 -> 192.172.1.11:5672">>,{lstate,<0.19307.1588>,false},none,1,{[],[]},{user,<<"Teld">>,[administrator],[{rabbit_auth_backend_internal,none}]},<<"/">>,<<"CpCommandBrgThirdProt-painuoV1.2-T-BJCA2-RTE-01">>,#{},{state,{dict,0,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},erlang},#{},#{},{set,0,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},<0.18886.1588>,{state,fine,5000,#Ref<0.3811685947.3810000900.176583>},false,1,{{0,nil},{0,nil}},[],[],{{0,nil},{0,nil}},[{<<"connection.blocked">>,bool,true},{<<"consumer_cancel_notify">>,bool,true}],none,0,none,flow,[]}
** Reason for termination ==
** {{shutdown,{gen_server2,call,[<0.277.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.15533.1588>,single},infinity]}},[{gen_server2,call,3,[{file,"src/gen_server2.erl"},{line,329}]},{rabbit_misc,execute_mnesia_transaction,1,[{file,"src/rabbit_misc.erl"},{line,538}]},{rabbit_misc,execute_mnesia_tx_with_tail,1,[{file,"src/rabbit_misc.erl"},{line,580}]},{rabbit_channel,binding_action,9,[{file,"src/rabbit_channel.erl"},{line,1655}]},{rabbit_channel,handle_method,3,[{file,"src/rabbit_channel.erl"},{line,1423}]},{rabbit_channel,handle_cast,2,[{file,"src/rabbit_channel.erl"},{line,527}]},{gen_server2,handle_msg,2,[{file,"src/gen_server2.erl"},{line,1050}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,249}]}]}
2023-03-30 23:13:48.158 [error] <0.15533.1588> CRASH REPORT Process <0.15533.1588> with 0 neighbours exited with reason: {shutdown,{gen_server2,call,[<0.277.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.15533.1588>,single},infinity]}} in gen_server2:call/3 line 329 in gen_server2:terminate/3 line 1166
2023-03-30 23:13:48.158 [error] <0.18536.1588> Supervisor {<0.18536.1588>,rabbit_channel_sup} had child channel started with rabbit_channel:start_link(1, <0.18790.1588>, <0.18551.1588>, <0.18790.1588>, <<"192.172.1.21:33628 -> 192.172.1.11:5672">>, rabbit_framing_amqp_0_9_1, {user,<<"Teld">>,[administrator],[{rabbit_auth_backend_internal,none}]}, <<"/">>, [{<<"connection.blocked">>,bool,true},{<<"consumer_cancel_notify">>,bool,true}], <0.18886.1588>, <0.19307.1588>) at <0.15533.1588> exit with reason {shutdown,{gen_server2,call,[<0.277.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.15533.1588>,single},infinity]}} in gen_server2:call/3 line 329 in context shutdown_error
2023-03-30 23:13:48.159 [error] <0.18189.1588> ** Generic server <0.18189.1588> terminating
** Last message in was {'$gen_cast',{method,{'queue.bind',0,<<"CpCommandBrgThirdProt-kelu-T-BJCA2-RTE-02">>,<<"CpCommand">>,<<>>,false,[]},none,noflow}}
** When Server state == {ch,running,rabbit_framing_amqp_0_9_1,1,<0.18279.1588>,<0.19423.1588>,<0.18279.1588>,<<"192.172.1.22:47090 -> 192.172.1.11:5672">>,{lstate,<0.18740.1588>,false},none,1,{[],[]},{user,<<"Teld">>,[administrator],[{rabbit_auth_backend_internal,none}]},<<"/">>,<<"CpCommandBrgThirdProt-kelu-T-BJCA2-RTE-02">>,#{},{state,{dict,0,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},erlang},#{},#{},{set,0,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},<0.19184.1588>,{state,fine,5000,#Ref<0.3811685947.3419930627.217596>},false,1,{{0,nil},{0,nil}},[],[],{{0,nil},{0,nil}},[{<<"connection.blocked">>,bool,true},{<<"consumer_cancel_notify">>,bool,true}],none,0,none,flow,[]}
** Reason for termination ==
** {{shutdown,{gen_server2,call,[<0.274.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.18189.1588>,single},infinity]}},[{gen_server2,call,3,[{file,"src/gen_server2.erl"},{line,329}]},{rabbit_misc,execute_mnesia_transaction,1,[{file,"src/rabbit_misc.erl"},{line,538}]},{rabbit_misc,execute_mnesia_tx_with_tail,1,[{file,"src/rabbit_misc.erl"},{line,580}]},{rabbit_channel,binding_action,9,[{file,"src/rabbit_channel.erl"},{line,1655}]},{rabbit_channel,handle_method,3,[{file,"src/rabbit_channel.erl"},{line,1423}]},{rabbit_channel,handle_cast,2,[{file,"src/rabbit_channel.erl"},{line,527}]},{gen_server2,handle_msg,2,[{file,"src/gen_server2.erl"},{line,1050}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,249}]}]}
2023-03-30 23:13:48.159 [error] <0.18189.1588> CRASH REPORT Process <0.18189.1588> with 0 neighbours exited with reason: {shutdown,{gen_server2,call,[<0.274.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.18189.1588>,single},infinity]}} in gen_server2:call/3 line 329 in gen_server2:terminate/3 line 1166
2023-03-30 23:13:48.159 [error] <0.6162.1588> ** Generic server <0.6162.1588> terminating
** Last message in was {'$gen_cast',{method,{'queue.bind',0,<<"CpCommandBrgThirdProt-keshida-T-BJCA2-RTE-02">>,<<"CpCommand">>,<<>>,false,[]},none,noflow}}
** When Server state == {ch,running,rabbit_framing_amqp_0_9_1,1,<0.5746.1588>,<0.7167.1588>,<0.5746.1588>,<<"192.172.1.22:46410 -> 192.172.1.11:5672">>,{lstate,<0.6950.1588>,false},none,1,{[],[]},{user,<<"Teld">>,[administrator],[{rabbit_auth_backend_internal,none}]},<<"/">>,<<"CpCommandBrgThirdProt-keshida-T-BJCA2-RTE-02">>,#{},{state,{dict,0,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},erlang},#{},#{},{set,0,16,16,8,80,48,{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]},{{[],[],[],[],[],[],[],[],[],[],[],[],[],[],[],[]}}},<0.6610.1588>,{state,fine,5000,#Ref<0.3811685947.2507669509.35113>},false,1,{{0,nil},{0,nil}},[],[],{{0,nil},{0,nil}},[{<<"connection.blocked">>,bool,true},{<<"consumer_cancel_notify">>,bool,true}],none,0,none,flow,[]}
** Reason for termination ==
** {{shutdown,{gen_server2,call,[<0.276.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.6162.1588>,single},infinity]}},[{gen_server2,call,3,[{file,"src/gen_server2.erl"},{line,329}]},{rabbit_misc,execute_mnesia_transaction,1,[{file,"src/rabbit_misc.erl"},{line,538}]},{rabbit_misc,execute_mnesia_tx_with_tail,1,[{file,"src/rabbit_misc.erl"},{line,580}]},{rabbit_channel,binding_action,9,[{file,"src/rabbit_channel.erl"},{line,1655}]},{rabbit_channel,handle_method,3,[{file,"src/rabbit_channel.erl"},{line,1423}]},{rabbit_channel,handle_cast,2,[{file,"src/rabbit_channel.erl"},{line,527}]},{gen_server2,handle_msg,2,[{file,"src/gen_server2.erl"},{line,1050}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,249}]}]}
2023-03-30 23:13:48.160 [error] <0.19209.1588> Supervisor {<0.19209.1588>,rabbit_channel_sup} had child channel started with rabbit_channel:start_link(1, <0.18279.1588>, <0.19423.1588>, <0.18279.1588>, <<"192.172.1.22:47090 -> 192.172.1.11:5672">>, rabbit_framing_amqp_0_9_1, {user,<<"Teld">>,[administrator],[{rabbit_auth_backend_internal,none}]}, <<"/">>, [{<<"connection.blocked">>,bool,true},{<<"consumer_cancel_notify">>,bool,true}], <0.19184.1588>, <0.18740.1588>) at <0.18189.1588> exit with reason {shutdown,{gen_server2,call,[<0.274.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.18189.1588>,single},infinity]}} in gen_server2:call/3 line 329 in context shutdown_error
2023-03-30 23:13:48.160 [error] <0.6162.1588> CRASH REPORT Process <0.6162.1588> with 0 neighbours exited with reason: {shutdown,{gen_server2,call,[<0.276.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.6162.1588>,single},infinity]}} in gen_server2:call/3 line 329 in gen_server2:terminate/3 line 1166
2023-03-30 23:13:48.160 [error] <0.6832.1588> Supervisor {<0.6832.1588>,rabbit_channel_sup} had child channel started with rabbit_channel:start_link(1, <0.5746.1588>, <0.7167.1588>, <0.5746.1588>, <<"192.172.1.22:46410 -> 192.172.1.11:5672">>, rabbit_framing_amqp_0_9_1, {user,<<"Teld">>,[administrator],[{rabbit_auth_backend_internal,none}]}, <<"/">>, [{<<"connection.blocked">>,bool,true},{<<"consumer_cancel_notify">>,bool,true}], <0.6610.1588>, <0.6950.1588>) at <0.6162.1588> exit with reason {shutdown,{gen_server2,call,[<0.276.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.6162.1588>,single},infinity]}} in gen_server2:call/3 line 329 in context shutdown_error
2023-03-30 23:18:20.222 [error] <0.18004.0> CRASH REPORT Process <0.18004.0> with 0 neighbours exited with reason: {shutdown,{gen_server2,call,[<0.18890.0>,{submit,#Fun<rabbit_misc.5.103157688>,<0.18005.0>,single},infinity]}} in application_master:init/4 line 138
2023-03-30 23:18:35.059 [error] emulator Discarding message {'$gen_cast',{deliver,{delivery,false,false,<7685.27741.7206>,{basic_message,{resource,<<"/">>,exchange,<<"CpCommand">>},[<<>>],{content,60,{'P_basic',undefined,undefined,[{<<"MessageType">>,signedint,2}],1,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<56,0,0,0,0,17,11,77,101,115,115,97,103,101,84,121,112,101,73,0,0,0,2,1,0>>,rabbit_framing_amqp_0_9_1,[<<99,64,3,1,0,0,0,0,3,0,0,0,0,0,0,0,51,49,48,49,49,53,48,50,48,57,67,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,49,52,49,101,51,102,53,97,97,52,55,54,49,56,50,99>>]},<<60,182,222,45,100,161,42,90,60,222,191,140,239,50,253,103>>,false},undefined,flow},false}} from <0.2599.0> to <0.1069.0> in an old incarnation (1) of this node (2)

2023-03-30 23:18:35.059 [error] emulator Discarding message {'$gen_cast',{deliver,{delivery,false,false,<7685.27741.7206>,{basic_message,{resource,<<"/">>,exchange,<<"CpCommand">>},[<<>>],{content,60,{'P_basic',undefined,undefined,[{<<"MessageType">>,signedint,2}],1,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<56,0,0,0,0,17,11,77,101,115,115,97,103,101,84,121,112,101,73,0,0,0,2,1,0>>,rabbit_framing_amqp_0_9_1,[<<99,64,3,1,0,0,0,0,3,0,0,0,0,0,0,0,51,49,48,49,49,53,48,50,48,57,67,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,49,52,49,101,51,102,53,97,97,52,55,54,49,56,50,99>>]},<<60,182,222,45,100,161,42,90,60,222,191,140,239,50,253,103>>,false},undefined,flow},false}} from <0.2599.0> to <0.1157.0> in an old incarnation (1) of this node (2)

2023-03-30 23:18:35.060 [error] emulator Discarding message {'$gen_cast',{deliver,{delivery,false,false,<7685.27741.7206>,{basic_message,{resource,<<"/">>,exchange,<<"CpCommand">>},[<<>>],{content,60,{'P_basic',undefined,undefined,[{<<"MessageType">>,signedint,2}],1,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<56,0,0,0,0,17,11,77,101,115,115,97,103,101,84,121,112,101,73,0,0,0,2,1,0>>,rabbit_framing_amqp_0_9_1,[<<99,64,3,1,0,0,0,0,3,0,0,0,0,0,0,0,51,49,48,49,49,53,48,50,48,57,67,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,49,52,49,101,51,102,53,97,97,52,55,54,49,56,50,99>>]},<<60,182,222,45,100,161,42,90,60,222,191,140,239,50,253,103>>,false},undefined,flow},false}} from <0.2599.0> to <0.988.0> in an old incarnation (1) of this node (2)

2023-03-30 23:18:35.060 [error] emulator Discarding message {'$gen_cast',{deliver,{delivery,false,false,<7685.27741.7206>,{basic_message,{resource,<<"/">>,exchange,<<"CpCommand">>},[<<>>],{content,60,{'P_basic',undefined,undefined,[{<<"MessageType">>,signedint,2}],1,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<56,0,0,0,0,17,11,77,101,115,115,97,103,101,84,121,112,101,73,0,0,0,2,1,0>>,rabbit_framing_amqp_0_9_1,[<<99,64,3,1,0,0,0,0,3,0,0,0,0,0,0,0,51,49,48,49,49,53,48,50,48,57,67,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,49,52,49,101,51,102,53,97,97,52,55,54,49,56,50,99>>]},<<60,182,222,45,100,161,42,90,60,222,191,140,239,50,253,103>>,false},undefined,flow},false}} from <0.2599.0> to <0.1942.0> in an old incarnation (1) of this node (2)

2023-03-30 23:18:35.060 [error] emulator Discarding message {'$gen_cast',{deliver,{delivery,false,false,<7685.27741.7206>,{basic_message,{resource,<<"/">>,exchange,<<"CpCommand">>},[<<>>],{content,60,{'P_basic',undefined,undefined,[{<<"MessageType">>,signedint,2}],1,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<56,0,0,0,0,17,11,77,101,115,115,97,103,101,84,121,112,101,73,0,0,0,2,1,0>>,rabbit_framing_amqp_0_9_1,[<<99,64,3,1,0,0,0,0,3,0,0,0,0,0,0,0,51,49,48,49,49,53,48,50,48,57,67,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,49,52,49,101,51,102,53,97,97,52,55,54,49,56,50,99>>]},<<60,182,222,45,100,161,42,90,60,222,191,140,239,50,253,103>>,false},undefined,flow},false}} from <0.2599.0> to <0.1145.0> in an old incarnation (1) of this node (2)

2023-03-30 23:18:35.060 [error] emulator Discarding message {'$gen_cast',{deliver,{delivery,false,false,<7685.27741.7206>,{basic_message,{resource,<<"/">>,exchange,<<"CpCommand">>},[<<>>],{content,60,{'P_basic',undefined,undefined,[{<<"MessageType">>,signedint,2}],1,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<56,0,0,0,0,17,11,77,101,115,115,97,103,101,84,121,112,101,73,0,0,0,2,1,0>>,rabbit_framing_amqp_0_9_1,[<<99,64,3,1,0,0,0,0,3,0,0,0,0,0,0,0,51,49,48,49,49,53,48,50,48,57,67,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,49,52,49,101,51,102,53,97,97,52,55,54,49,56,50,99>>]},<<60,182,222,45,100,161,42,90,60,222,191,140,239,50,253,103>>,false},undefined,flow},false}} from <0.2599.0> to <0.1651.0> in an old incarnation (1) of this node (2)

2023-03-30 23:18:35.061 [error] emulator Discarding message {'$gen_cast',{deliver,{delivery,false,false,<7685.27741.7206>,{basic_message,{resource,<<"/">>,exchange,<<"CpCommand">>},[<<>>],{content,60,{'P_basic',undefined,undefined,[{<<"MessageType">>,signedint,2}],1,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<56,0,0,0,0,17,11,77,101,115,115,97,103,101,84,121,112,101,73,0,0,0,2,1,0>>,rabbit_framing_amqp_0_9_1,[<<99,64,3,1,0,0,0,0,3,0,0,0,0,0,0,0,51,49,48,49,49,53,48,50,48,57,67,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,49,52,49,101,51,102,53,97,97,52,55,54,49,56,50,99>>]},<<60,182,222,45,100,161,42,90,60,222,191,140,239,50,253,103>>,false},undefined,flow},false}} from <0.2599.0> to <0.1430.0> in an old incarnation (1) of this node (2)

2023-03-30 23:18:35.061 [error] emulator Discarding message {'$gen_cast',{deliver,{delivery,false,false,<7685.27741.7206>,{basic_message,{resource,<<"/">>,exchange,<<"CpCommand">>},[<<>>],{content,60,{'P_basic',undefined,undefined,[{<<"MessageType">>,signedint,2}],1,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<56,0,0,0,0,17,11,77,101,115,115,97,103,101,84,121,112,101,73,0,0,0,2,1,0>>,rabbit_framing_amqp_0_9_1,[<<99,64,3,1,0,0,0,0,3,0,0,0,0,0,0,0,51,49,48,49,49,53,48,50,48,57,67,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,49,52,49,101,51,102,53,97,97,52,55,54,49,56,50,99>>]},<<60,182,222,45,100,161,42,90,60,222,191,140,239,50,253,103>>,false},undefined,flow},false}} from <0.2599.0> to <0.2013.0> in an old incarnation (1) of this node (2)

2023-03-30 23:18:35.061 [error] emulator Discarding message {'$gen_cast',{deliver,{delivery,false,false,<7685.27741.7206>,{basic_message,{resource,<<"/">>,exchange,<<"CpCommand">>},[<<>>],{content,60,{'P_basic',undefined,undefined,[{<<"MessageType">>,signedint,2}],1,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<56,0,0,0,0,17,11,77,101,115,115,97,103,101,84,121,112,101,73,0,0,0,2,1,0>>,rabbit_framing_amqp_0_9_1,[<<99,64,3,1,0,0,0,0,3,0,0,0,0,0,0,0,51,49,48,49,49,53,48,50,48,57,67,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,49,52,49,101,51,102,53,97,97,52,55,54,49,56,50,99>>]},<<60,182,222,45,100,161,42,90,60,222,191,140,239,50,253,103>>,false},undefined,flow},false}} from <0.2599.0> to <0.1586.0> in an old incarnation (1) of this node (2)

2023-03-30 23:18:35.061 [error] emulator Discarding message {'$gen_cast',{deliver,{delivery,false,false,<7685.27741.7206>,{basic_message,{resource,<<"/">>,exchange,<<"CpCommand">>},[<<>>],{content,60,{'P_basic',undefined,undefined,[{<<"MessageType">>,signedint,2}],1,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<56,0,0,0,0,17,11,77,101,115,115,97,103,101,84,121,112,101,73,0,0,0,2,1,0>>,rabbit_framing_amqp_0_9_1,[<<99,64,3,1,0,0,0,0,3,0,0,0,0,0,0,0,51,49,48,49,49,53,48,50,48,57,67,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,49,52,49,101,51,102,53,97,97,52,55,54,49,56,50,99>>]},<<60,182,222,45,100,161,42,90,60,222,191,140,239,50,253,103>>,false},undefined,flow},false}} from <0.2599.0> to <0.2035.0> in an old incarnation (1) of this node (2)

2023-03-30 23:18:35.061 [error] emulator Discarding message {'$gen_cast',{deliver,{delivery,false,false,<7685.27741.7206>,{basic_message,{resource,<<"/">>,exchange,<<"CpCommand">>},[<<>>],{content,60,{'P_basic',undefined,undefined,[{<<"MessageType">>,signedint,2}],1,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<56,0,0,0,0,17,11,77,101,115,115,97,103,101,84,121,112,101,73,0,0,0,2,1,0>>,rabbit_framing_amqp_0_9_1,[<<99,64,3,1,0,0,0,0,3,0,0,0,0,0,0,0,51,49,48,49,49,53,48,50,48,57,67,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,49,52,49,101,51,102,53,97,97,52,55,54,49,56,50,99>>]},<<60,182,222,45,100,161,42,90,60,222,191,140,239,50,253,103>>,false},undefined,flow},false}} from <0.2599.0> to <0.1909.0> in an old incarnation (1) of this node (2)

2023-03-30 23:18:35.061 [error] emulator Discarding message {'$gen_cast',{deliver,{delivery,false,false,<7685.27741.7206>,{basic_message,{resource,<<"/">>,exchange,<<"CpCommand">>},[<<>>],{content,60,{'P_basic',undefined,undefined,[{<<"MessageType">>,signedint,2}],1,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<56,0,0,0,0,17,11,77,101,115,115,97,103,101,84,121,112,101,73,0,0,0,2,1,0>>,rabbit_framing_amqp_0_9_1,[<<99,64,3,1,0,0,0,0,3,0,0,0,0,0,0,0,51,49,48,49,49,53,48,50,48,57,67,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,49,52,49,101,51,102,53,97,97,52,55,54,49,56,50,99>>]},<<60,182,222,45,100,161,42,90,60,222,191,140,239,50,253,103>>,false},undefined,flow},false}} from <0.2599.0> to <0.1303.0> in an old incarnation (1) of this node (2)

2023-03-30 23:18:35.061 [error] emulator Discarding message {'$gen_cast',{deliver,{delivery,false,false,<7685.27741.7206>,{basic_message,{resource,<<"/">>,exchange,<<"CpCommand">>},[<<>>],{content,60,{'P_basic',undefined,undefined,[{<<"MessageType">>,signedint,2}],1,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<56,0,0,0,0,17,11,77,101,115,115,97,103,101,84,121,112,101,73,0,0,0,2,1,0>>,rabbit_framing_amqp_0_9_1,[<<99,64,3,1,0,0,0,0,3,0,0,0,0,0,0,0,51,49,48,49,49,53,48,50,48,57,67,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,49,52,49,101,51,102,53,97,97,52,55,54,49,56,50,99>>]},<<60,182,222,45,100,161,42,90,60,222,191,140,239,50,253,103>>,false},undefined,flow},false}} from <0.2599.0> to <0.1868.0> in an old incarnation (1) of this node (2)

2023-03-30 23:18:35.062 [error] emulator Discarding message {'$gen_cast',{deliver,{delivery,false,false,<7685.27741.7206>,{basic_message,{resource,<<"/">>,exchange,<<"CpCommand">>},[<<>>],{content,60,{'P_basic',undefined,undefined,[{<<"MessageType">>,signedint,2}],1,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<56,0,0,0,0,17,11,77,101,115,115,97,103,101,84,121,112,101,73,0,0,0,2,1,0>>,rabbit_framing_amqp_0_9_1,[<<99,64,3,1,0,0,0,0,3,0,0,0,0,0,0,0,51,49,48,49,49,53,48,50,48,57,67,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,49,52,49,101,51,102,53,97,97,52,55,54,49,56,50,99>>]},<<60,182,222,45,100,161,42,90,60,222,191,140,239,50,253,103>>,false},undefined,flow},false}} from <0.2599.0> to <0.1441.0> in an old incarnation (1) of this node (2)

2023-03-30 23:18:35.062 [error] emulator Discarding message {'$gen_cast',{deliver,{delivery,false,false,<7685.27741.7206>,{basic_message,{resource,<<"/">>,exchange,<<"CpCommand">>},[<<>>],{content,60,{'P_basic',undefined,undefined,[{<<"MessageType">>,signedint,2}],1,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<56,0,0,0,0,17,11,77,101,115,115,97,103,101,84,121,112,101,73,0,0,0,2,1,0>>,rabbit_framing_amqp_0_9_1,[<<99,64,3,1,0,0,0,0,3,0,0,0,0,0,0,0,51,49,48,49,49,53,48,50,48,57,67,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,49,52,49,101,51,102,53,97,97,52,55,54,49,56,50,99>>]},<<60,182,222,45,100,161,42,90,60,222,191,140,239,50,253,103>>,false},undefined,flow},false}} from <0.2599.0> to <0.1680.0> in an old incarnation (1) of this node (2)

2023-03-30 23:18:35.062 [error] emulator Discarding message {'$gen_cast',{deliver,{delivery,false,false,<7685.27741.7206>,{basic_message,{resource,<<"/">>,exchange,<<"CpCommand">>},[<<>>],{content,60,{'P_basic',undefined,undefined,[{<<"MessageType">>,signedint,2}],1,0,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined,undefined},<<56,0,0,0,0,17,11,77,101,115,115,97,103,101,84,121,112,101,73,0,0,0,2,1,0>>,rabbit_framing_amqp_0_9_1,[<<99,64,3,1,0,0,0,0,3,0,0,0,0,0,0,0,51,49,48,49,49,53,48,50,48,57,67,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,49,52,49,101,51,102,53,97,97,52,55,54,49,56,50,99>>]},<<60,182,222,45,100,161,42,90,60,222,191,140,239,50,253,103>>,false},undefined,flow},false}} from <0.2599.0> to <0.1848.0> in an old incarnation (1) of this node (2)
`

Please help.
Thanks.

Answered by mkuratczyk

Mar 31, 2023

Do not ask the same question in multiple places at the same time. I've replied on the mailing list: https://groups.google.com/g/rabbitmq-users/c/oUWY9efxCUE/m/rM0t4SY3BAAJ

3.7 has been out of support for 2.5 years at this point.

View full answer

mkuratczyk · 2023-03-31T07:20:42Z

mkuratczyk
Mar 31, 2023
Maintainer

Do not ask the same question in multiple places at the same time. I've replied on the mailing list: https://groups.google.com/g/rabbitmq-users/c/oUWY9efxCUE/m/rM0t4SY3BAAJ

3.7 has been out of support for 2.5 years at this point.

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Help, RabbitMQ 3.7.9 Mirror Cluster High CPU usage and node crash problem #7785

Uh oh!

{{title}}

Uh oh!

Replies: 1 comment

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Help, RabbitMQ 3.7.9 Mirror Cluster High CPU usage and node crash problem #7785

Uh oh!

zhouguoqing Mar 31, 2023

Replies: 1 comment

Uh oh!

mkuratczyk Mar 31, 2023 Maintainer

zhouguoqing
Mar 31, 2023

mkuratczyk
Mar 31, 2023
Maintainer