Not getting updates from fedbus

[brianjmurrell]

For the second time now, my fedbus consumer is no longer getting messages from Anitya. It is still connected:

$ systemctl status fm-consumer@watch_new_releases.service
● fm-consumer@watch_new_releases.service - Fedora Messaging consumer
     Loaded: loaded (/home/brian/.config/systemd/user/fm-consumer@.service; enabled; preset: disabled)
    Drop-In: /usr/lib/systemd/user/service.d
             └─10-timeout-abort.conf
     Active: active (running) since Tue 2025-12-23 10:21:02 EST; 5 days ago
 Invocation: 78fcd55937e94312b9a2c800d349e230
       Docs: http://fedora-messaging.readthedocs.io/
   Main PID: 603739 (fedora-messagin)
      Tasks: 2 (limit: 18688)
     Memory: 6.9M (peak: 4.3G, swap: 62M, swap peak: 96M)
        CPU: 9min 54.241s
     CGroup: /user.slice/user-1001.slice/user@1001.service/app.slice/app-fm\x2dconsumer.slice/fm-consumer@watch_new_releases.service
             └─603739 /usr/bin/python3 -P /usr/bin/fedora-messaging --conf .config/fedora-messaging/watch_new_releases.toml consume

Notice: journal has been rotated since unit was started, output may be incomplete.
$ lsof -n -p 603739
COMMAND      PID  USER   FD      TYPE             DEVICE SIZE/OFF     NODE NAME
fedora-me 603739 brian  cwd       DIR               0,43    55848      262 /home/brian
fedora-me 603739 brian  rtd       DIR               0,36      362      256 /
fedora-me 603739 brian  txt       REG               0,36    11712 26715353 /usr/bin/python3.13
fedora-me 603739 brian  mem       REG               0,34          26715353 /usr/bin/python3.13 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          25948086 /usr/lib64/libnss_resolve.so.2 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          23421455 /usr/lib64/python3.13/site-packages/rpds/rpds.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          25202712 /usr/lib64/python3.13/site-packages/bcrypt/_bcrypt.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          23341587 /usr/lib64/libffi.so.8.1.4 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714605 /usr/lib64/python3.13/lib-dynload/_ctypes.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          23434442 /usr/lib64/python3.13/site-packages/_cffi_backend.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          23434523 /usr/lib64/python3.13/site-packages/cryptography/hazmat/bindings/_rust.abi3.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26656997 /usr/lib64/libgomp.so.1.0.0 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          25849026 /usr/lib64/python3.13/site-packages/zstandard/backend_c.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26711609 /usr/lib64/python3.13/site-packages/_brotli.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          25776877 /usr/lib64/libcrypto.so.3.2.6 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26655203 /usr/lib64/libgcc_s-15-20251211.so.1 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          25776881 /usr/lib64/ossl-modules/legacy.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          23424466 /usr/lib64/python3.13/site-packages/zope/interface/_zope_interface_coptimizations.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714593 /usr/lib64/python3.13/lib-dynload/_asyncio.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          25776879 /usr/lib64/libssl.so.3.2.6 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          23352994 /usr/lib64/libcap.so.2.73 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          25948085 /usr/lib64/libnss_myhostname.so.2 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26498045 /usr/lib64/libexpat.so.1.11.1 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714647 /usr/lib64/python3.13/lib-dynload/pyexpat.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          23420672 /usr/lib64/python3.13/site-packages/wrapt/_wrappers.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714633 /usr/lib64/python3.13/lib-dynload/_socket.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714625 /usr/lib64/python3.13/lib-dynload/_pickle.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          23408218 /usr/lib64/libmpdec.so.4.0.1 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          23486381 /usr/lib64/libnss_mdns_minimal.so.2 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714640 /usr/lib64/python3.13/lib-dynload/array.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714608 /usr/lib64/python3.13/lib-dynload/_datetime.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714653 /usr/lib64/python3.13/lib-dynload/unicodedata.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714652 /usr/lib64/python3.13/lib-dynload/termios.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714622 /usr/lib64/python3.13/lib-dynload/_multibytecodec.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          23973240 /usr/lib64/python3.13/site-packages/simplejson/_speedups.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          23361747 /usr/lib64/libb2.so.1.0.4 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714613 /usr/lib64/python3.13/lib-dynload/_hashlib.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714635 /usr/lib64/python3.13/lib-dynload/_ssl.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26452504 /usr/lib64/liblzma.so.5.8.1 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714595 /usr/lib64/python3.13/lib-dynload/_blake2.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714610 /usr/lib64/python3.13/lib-dynload/_decimal.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34             80893 /usr/lib/locale/locale-archive (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714603 /usr/lib64/python3.13/lib-dynload/_contextvars.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          23341423 /usr/lib64/libbz2.so.1.0.8 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714629 /usr/lib64/python3.13/lib-dynload/_random.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714594 /usr/lib64/python3.13/lib-dynload/_bisect.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714645 /usr/lib64/python3.13/lib-dynload/math.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714637 /usr/lib64/python3.13/lib-dynload/_struct.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714620 /usr/lib64/python3.13/lib-dynload/_lzma.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714596 /usr/lib64/python3.13/lib-dynload/_bz2.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26732064 /usr/lib64/libm.so.6 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26732062 /usr/lib64/libc.so.6 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26713748 /usr/lib64/libpython3.13.so.1.0 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          25207230 /usr/lib64/libz.so.1.3.1.zlib-ng (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714628 /usr/lib64/python3.13/lib-dynload/_queue.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714650 /usr/lib64/python3.13/lib-dynload/select.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714627 /usr/lib64/python3.13/lib-dynload/_posixsubprocess.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714643 /usr/lib64/python3.13/lib-dynload/fcntl.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714614 /usr/lib64/python3.13/lib-dynload/_heapq.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26732083 /usr/lib64/libuuid.so.1.3.0 (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714638 /usr/lib64/python3.13/lib-dynload/_uuid.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714654 /usr/lib64/python3.13/lib-dynload/zlib.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714641 /usr/lib64/python3.13/lib-dynload/binascii.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714644 /usr/lib64/python3.13/lib-dynload/grp.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714624 /usr/lib64/python3.13/lib-dynload/_opcode.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26714618 /usr/lib64/python3.13/lib-dynload/_json.cpython-313-x86_64-linux-gnu.so (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26811007 /usr/lib64/gconv/gconv-modules.cache (path dev=0,36)
fedora-me 603739 brian  mem       REG               0,34          26732059 /usr/lib64/ld-linux-x86-64.so.2 (path dev=0,36)
fedora-me 603739 brian    0r      CHR                1,3      0t0        4 /dev/null
fedora-me 603739 brian    1u     unix 0x00000000795f3619      0t0 46913267 type=STREAM (CONNECTED)
fedora-me 603739 brian    2u     unix 0x00000000795f3619      0t0 46913267 type=STREAM (CONNECTED)
fedora-me 603739 brian    3u  a_inode               0,16        0     2076 [eventpoll:4,6,8,10]
fedora-me 603739 brian    4u     unix 0x000000003f714ee6      0t0 46931059 type=STREAM (CONNECTED)
fedora-me 603739 brian    5u     unix 0x00000000988292d3      0t0 46931060 type=STREAM (CONNECTED)
fedora-me 603739 brian    6r     FIFO               0,15      0t0 46931061 pipe
fedora-me 603739 brian    7w     FIFO               0,15      0t0 46931061 pipe
fedora-me 603739 brian    8r     FIFO               0,15      0t0 46928985 pipe
fedora-me 603739 brian    9w     FIFO               0,15      0t0 46928985 pipe
fedora-me 603739 brian   10u     IPv4           46928986      0t0      TCP 10.75.22.1:55982->38.145.32.21:amqps (ESTABLISHED)

So as you an see by the last line above there, the socket to the Fedora amqps server is still in the ESTABLISHED state, yet I have not received any Anitya message since:

2025-12-27 20:38:40.551614: vaultwarden-1.35.0 from 1.34.3 and is stable from Anitya project backend GitHub; mappings: [{'package_name': 'vaultwarden', 'distro': 'AOSC OS'}, {'package_name': 'vaultwarden', 'distro': 'Alpine'}, {'package_name': 'vaultwarden', 'distro': 'Fedora'}]; Fedora package is vaultwarden

[Zlopez]

Could you share your config? Which queue are you connecting to?

[brianjmurrell]

# A basic configuration for Fedora's message broker, using the example callback
# which simply prints messages to standard output.
#
# This file is in the TOML format.
amqp_url = "amqps://fedora:@rabbitmq.fedoraproject.org/%2Fpublic_pubsub"
callback = "watch_new_releases.watcher:HotnessConsumer"

[tls]
ca_cert = "/etc/fedora-messaging/cacert.pem"
keyfile = "/etc/fedora-messaging/fedora-key.pem"
certfile = "/etc/fedora-messaging/fedora-cert.pem"

[client_properties]
app = "Example Application"
# Some suggested extra fields:
# URL of the project that provides this consumer
app_url = "https://github.com/fedora-infra/fedora-messaging"
# Contact emails for the maintainer(s) of the consumer - in case the
# broker admin needs to contact them, for e.g.
app_contacts_email = ["jcline@fedoraproject.org"]

[exchanges."amq.topic"]
type = "topic"
durable = true
auto_delete = false
arguments = {}

# Queue names *must* be in the normal UUID format: run "uuidgen" and use the
# output as your queue name. If your queue is not exclusive, anyone can connect
# and consume from it, causing you to miss messages, so do not share your queue
# name. Any queues that are not auto-deleted on disconnect are garbage-collected
# after approximately one hour.
#
# If you require a stronger guarantee about delivery, please talk to Fedora's
# Infrastructure team.
[queues.16819f2a-1413-4eaa-9e09-0eb159e9d61f]
durable = false
auto_delete = true
exclusive = true
arguments = {}

[[bindings]]
queue = "16819f2a-1413-4eaa-9e09-0eb159e9d61f"
exchange = "amq.topic"
routing_keys = ["org.release-monitoring.prod.anitya.project.version.update.v2"]  # Set this to the specific topics you are interested in.

[consumer_config]
example_key = "for my consumer"

[qos]
prefetch_size = 0
prefetch_count = 25

[log_config]
version = 1
disable_existing_loggers = true

[log_config.formatters.simple]
format = "[%(levelname)s %(name)s] %(message)s"

[log_config.handlers.console]
class = "logging.StreamHandler"
formatter = "simple"
stream = "ext://sys.stdout"

[log_config.loggers.fedora_messaging]
level = "WARN"
propagate = false
handlers = ["console"]

[log_config.loggers.twisted]
level = "WARN"
propagate = false
handlers = ["console"]

[log_config.loggers.pika]
level = "WARNING"
propagate = false
handlers = ["console"]

# If your consumer sets up a logger, you must add a configuration for it
# here in order for the messages to show up. e.g. if it set up a logger
# called 'example_printer', you could do:
[log_config.loggers.watch_new_releases]
level = "INFO"
propagate = false
handlers = ["console"]

[log_config.root]
level = "ERROR"
handlers = ["console"]

Which queue are you connecting to?

Does the above answer that question or is that still an open question.?

[brianjmurrell]

Additionally, here is the socket info:

Netid                   Recv-Q                   Send-Q                                       Local Address:Port                                        Peer Address:Port                    
tcp                     0                        0                                               10.75.22.1:55982                                       38.145.32.21:amqps                   

So as you can see the receive queue is not full, so it's no the process being blocked and failing to consume from the socket.

The socket is not entirely silent. There seems to be a periodic 30 byte message going back and forth on it:

[pid 603739] recvfrom(10, "\27\3\3\0\31\1\365u\254s\226\220g\231C\265\216e\210C9\317I\32\r\273\307\177?\200", 65536, 0, NULL, NULL) = 30
[pid 603739] epoll_wait(3, [], 4, 5612) = 0
[pid 603739] epoll_wait(3, [], 4, 0)    = 0
[pid 603739] epoll_ctl(3, EPOLL_CTL_MOD, 10, {events=EPOLLIN|EPOLLOUT, data=0xa}) = 0
[pid 603739] epoll_wait(3, [{events=EPOLLOUT, data=0xa}], 4, 299999) = 1
[pid 603739] sendto(10, "\27\3\3\0\31c\221BR\36\3356Q\212\247\7i1\22472\216N\303\206(Z\245\262\271", 30, 0, NULL, 0) = 30
[pid 603739] epoll_ctl(3, EPOLL_CTL_MOD, 10, {events=EPOLLIN, data=0xa}) = 0
[pid 603739] epoll_wait(3, [{events=EPOLLIN, data=0xa}], 4, 299998) = 1
[pid 603739] recvfrom(10, "\27\3\3\0\31\370F\341\37\370Oc\316>\230_\370b\264\vh\353\2750\356\327\f\311\20Q", 65536, 0, NULL, NULL) = 30
[pid 603739] epoll_wait(3, [], 4, 5618) = 0
[pid 603739] epoll_wait(3, [], 4, 0)    = 0
[pid 603739] epoll_ctl(3, EPOLL_CTL_MOD, 10, {events=EPOLLIN|EPOLLOUT, data=0xa}) = 0
[pid 603739] epoll_wait(3, [{events=EPOLLOUT, data=0xa}], 4, 77839) = 1
[pid 603739] sendto(10, "\27\3\3\0\31y]\212\vO\f\333\374\33`\276\311\16\4\360N\313\341d\236\226&\205]\216", 30, 0, NULL, 0) = 30
[pid 603739] epoll_ctl(3, EPOLL_CTL_MOD, 10, {events=EPOLLIN, data=0xa}) = 0
[pid 603739] epoll_wait(3, [], 4, 77839) = 0
[pid 603739] epoll_wait(3, [{events=EPOLLIN, data=0xa}], 4, 222097) = 1
[pid 603739] recvfrom(10, "\27\3\3\0\31\225^\360\31\236\337\237\346\334\277Zt\365\362\233\257\302?\26\256\30f\5Pm", 65536, 0, NULL, NULL) = 30
[pid 603739] epoll_wait(3, [], 4, 5622) = 0
[pid 603739] epoll_wait(3, [], 4, 0)    = 0
[pid 603739] epoll_ctl(3, EPOLL_CTL_MOD, 10, {events=EPOLLIN|EPOLLOUT, data=0xa}) = 0
[pid 603739] epoll_wait(3, [{events=EPOLLOUT, data=0xa}], 4, 299999) = 1
[pid 603739] sendto(10, "\27\3\3\0\31\25\24\212S2\230\251\244:\323%\177q\366\365\227\344\26\1\220\31\264\34y;", 30, 0, NULL, 0) = 30
[pid 603739] epoll_ctl(3, EPOLL_CTL_MOD, 10, {events=EPOLLIN, data=0xa}) = 0
[pid 603739] epoll_wait(3, [{events=EPOLLIN, data=0xa}], 4, 299998) = 1
[pid 603739] recvfrom(10, "\27\3\3\0\31@a\232#\247&wf2\300\265\27\344\6\23\10\336\372\337\r\254D\207\307\211", 65536, 0, NULL, NULL) = 30
[pid 603739] epoll_wait(3, [], 4, 5628) = 0
[pid 603739] epoll_wait(3, [], 4, 0)    = 0
[pid 603739] epoll_ctl(3, EPOLL_CTL_MOD, 10, {events=EPOLLIN|EPOLLOUT, data=0xa}) = 0
[pid 603739] epoll_wait(3, [{events=EPOLLOUT, data=0xa}], 4, 82889) = 1
[pid 603739] sendto(10, "\27\3\3\0\31j\36C=c\375\334\303\302k%\31\300\341'\37\23\3074\277<\332)Kb", 30, 0, NULL, 0) = 30
[pid 603739] epoll_ctl(3, EPOLL_CTL_MOD, 10, {events=EPOLLIN, data=0xa}) = 0
[pid 603739] epoll_wait(3, [], 4, 82888) = 0
[pid 603739] epoll_wait(3, [{events=EPOLLIN, data=0xa}], 4, 217070) = 1
[pid 603739] recvfrom(10, "\27\3\3\0\0314\20\10Y*\361\3\276\302\317\220\214[8\256\306\10\1r\323\5\353\205\302)", 65536, 0, NULL, NULL) = 30
[pid 603739] epoll_wait(3, [], 4, 5634) = 0
[pid 603739] epoll_wait(3, [], 4, 0)    = 0
[pid 603739] epoll_ctl(3, EPOLL_CTL_MOD, 10, {events=EPOLLIN|EPOLLOUT, data=0xa}) = 0
[pid 603739] epoll_wait(3, [{events=EPOLLOUT, data=0xa}], 4, 299999) = 1
[pid 603739] sendto(10, "\27\3\3\0\31\217\v\275\277h62\342\313\312p\323\26\27UP\326\347\331\26\325^\22%\202", 30, 0, NULL, 0) = 30
[pid 603739] epoll_ctl(3, EPOLL_CTL_MOD, 10, {events=EPOLLIN, data=0xa}) = 0
[pid 603739] epoll_wait(3

and the network traffic:

11:31:07.051347 IP 38.145.32.21.5671 > 10.75.22.1.55982: Flags [P.], seq 2842454166:2842454196, ack 2073192227, win 73, options [nop,nop,TS val 2233271961 ecr 1310321442], length 30
11:31:07.051693 IP 10.75.22.1.55982 > 38.145.32.21.5671: Flags [.], ack 30, win 2038, options [nop,nop,TS val 1310615828 ecr 2233271961], length 0
11:31:12.672903 IP 10.75.22.1.55982 > 38.145.32.21.5671: Flags [P.], seq 1:31, ack 30, win 2038, options [nop,nop,TS val 1310621449 ecr 2233271961], length 30
11:31:12.727799 IP 38.145.32.21.5671 > 10.75.22.1.55982: Flags [.], ack 31, win 73, options [nop,nop,TS val 2233277637 ecr 1310621449], length 0
11:36:07.052222 IP 38.145.32.21.5671 > 10.75.22.1.55982: Flags [P.], seq 30:60, ack 31, win 73, options [nop,nop,TS val 2233571962 ecr 1310621449], length 30
11:36:07.052560 IP 10.75.22.1.55982 > 38.145.32.21.5671: Flags [.], ack 60, win 2038, options [nop,nop,TS val 1310915829 ecr 2233571962], length 0
11:36:12.678624 IP 10.75.22.1.55982 > 38.145.32.21.5671: Flags [P.], seq 31:61, ack 60, win 2038, options [nop,nop,TS val 1310921455 ecr 2233571962], length 30
11:36:12.734758 IP 38.145.32.21.5671 > 10.75.22.1.55982: Flags [.], ack 61, win 73, options [nop,nop,TS val 2233577644 ecr 1310921455], length 0
11:41:07.053117 IP 38.145.32.21.5671 > 10.75.22.1.55982: Flags [P.], seq 60:90, ack 61, win 73, options [nop,nop,TS val 2233871963 ecr 1310921455], length 30
11:41:07.053455 IP 10.75.22.1.55982 > 38.145.32.21.5671: Flags [.], ack 90, win 2038, options [nop,nop,TS val 1311215830 ecr 2233871963], length 0
11:41:12.684899 IP 10.75.22.1.55982 > 38.145.32.21.5671: Flags [P.], seq 61:91, ack 90, win 2038, options [nop,nop,TS val 1311221461 ecr 2233871963], length 30
11:41:12.740311 IP 38.145.32.21.5671 > 10.75.22.1.55982: Flags [.], ack 91, win 73, options [nop,nop,TS val 2233877650 ecr 1311221461], length 0
11:46:07.054255 IP 38.145.32.21.5671 > 10.75.22.1.55982: Flags [P.], seq 90:120, ack 91, win 73, options [nop,nop,TS val 2234171964 ecr 1311221461], length 30
11:46:07.054607 IP 10.75.22.1.55982 > 38.145.32.21.5671: Flags [.], ack 120, win 2038, options [nop,nop,TS val 1311515831 ecr 2234171964], length 0
11:46:12.691966 IP 10.75.22.1.55982 > 38.145.32.21.5671: Flags [P.], seq 91:121, ack 120, win 2038, options [nop,nop,TS val 1311521468 ecr 2234171964], length 30
11:46:12.748061 IP 38.145.32.21.5671 > 10.75.22.1.55982: Flags [.], ack 121, win 73, options [nop,nop,TS val 2234177658 ecr 1311521468], length 0
11:51:07.054895 IP 38.145.32.21.5671 > 10.75.22.1.55982: Flags [P.], seq 120:150, ack 121, win 73, options [nop,nop,TS val 2234471965 ecr 1311521468], length 30
11:51:07.055227 IP 10.75.22.1.55982 > 38.145.32.21.5671: Flags [.], ack 150, win 2038, options [nop,nop,TS val 1311815832 ecr 2234471965], length 0
11:51:12.698816 IP 10.75.22.1.55982 > 38.145.32.21.5671: Flags [P.], seq 121:151, ack 150, win 2038, options [nop,nop,TS val 1311821475 ecr 2234471965], length 30
11:51:12.755209 IP 38.145.32.21.5671 > 10.75.22.1.55982: Flags [.], ack 151, win 73, options [nop,nop,TS val 2234477665 ecr 1311821475], length 0

Seems like that could be some kind of keep-alive/heartbeat?

[Zlopez]

I'm looking at the queue in fedora messaging and I can see that there is one consumer that acknowledges all messages messages in last hour. I assume that is your consumer. At least I know that the messages are correctly published in 16819f2a-1413-4eaa-9e09-0eb159e9d61f queue.

This seems to be more a problem with publishing fedora messages outside fedora infrastructure than problem with release-monitoring.org. Could you open ticket on https://pagure.io/fedora-infrastructure/issues?

[abompard]

Hey @brianjmurrell , yeah there's a keepalive every 30s. It looks like your consumer is actually receiving the messages. Could you share the watch_new_releases.watcher:HotnessConsumer code please?

[brianjmurrell]

Could you open ticket on https://pagure.io/fedora-infrastructure/issues?

https://pagure.io/fedora-infrastructure/issue/13019

Could you share the watch_new_releases.watcher:HotnessConsumer code please?

class HotnessConsumer(object):
    def __call__(self, msg: "fedora_messaging.message.Message") -> None:  # noqa: F821
        """
        Called when a message is received from RabbitMQ queue.
        Params:
            msg: The message we received from the queue.
        """
        topic, body, msg_id = msg.topic, msg.body, msg.id
        logger.debug("Received %r" % msg_id)
        logger.debug("topic: %s" % topic)
        logger.debug("body: %s" % body)

        if topic.endswith("anitya.project.version.update"):
            from anitya_schema.project_messages import ProjectVersionUpdated

            message = ProjectVersionUpdated(topic=topic, body=body)
            logger.debug("message: %s" % message)
            version = message.version
        elif topic.endswith("anitya.project.version.update.v2"):
            from anitya_schema.project_messages import ProjectVersionUpdatedV2

            message = ProjectVersionUpdatedV2(topic=topic, body=body)
            logger.debug("message: %s" % message)
            logger.debug("upstream_verisons: %s" % message.upstream_versions)
            versions = message.upstream_versions
        else:
            return


        for version in versions:
            stable = version in message.stable_versions
            msg = "%s-%s" % (message.project_name, version)
            try:
                msg += " from %s" % message.versions[1]
            except IndexError:
                msg += " as the initial version"

            msg += " and is %sstable" % ("" if stable else "not ")
            msg += " from Anitya project backend %s" % message.project_backend
            msg += "; mappings: %s" % message.mappings if message.mappings else ""
            for i in message.mappings:
                if i['distro'] == "Fedora":
                    msg += "; Fedora package is %s" % i['package_name']
            logger.info(msg)
            with open("/tmp/watch_new_releases.log", "a") as f:
                f.write(str(datetime.now()) + ": " + msg + "\n")
                cmd = [os.getenv('HOME') + f'/.local/lib/watch_new_releases/{message.project_name}.sh']
                cmd += [message.project_backend]
                cmd += [version]
                cmd += [str(stable)]
                for i in message.mappings:
                    if i['distro'] == "Fedora":
                        cmd += [i['package_name']]
                f.write('Running: ' + ' '.join(cmd) + '\n')
                try:
                    subprocess.run(cmd, shell=False)
                except PermissionError as e:
                    f.write(f"PermissionError: {str(e)} on {cmd[0]}\n")
                except FileNotFoundError as e:
                    f.write(f"No {cmd[0]} to execute\n")
                    pass

[james-antill]

I assume it's not the problem, but the "anitya.project.version.update" path doesn't assign anything to "versions"

[brianjmurrell]

Just noticing that this did seem to "magically" start working again on 2026-01-05 12:36:56.021653 EDT. Here's the gap showing when it stopped working and when it started again:

2025-12-27 20:38:40.551614: vaultwarden-1.35.0 from 1.34.3 and is stable from Anitya project backend GitHub; mappings: [{'package_name': 'vaultwarden', 'distro': 'AOSC OS'}, {'package_name>
2026-01-05 12:36:56.021653: whyis-2.4.0b9 from 2.4.0b10 and is stable from Anitya project backend PyPI

[brianjmurrell]

I assume it's not the problem, but the "anitya.project.version.update" path doesn't assign anything to "versions"

To what are you referring exactly? versions is being assigned from message.upstream_versions only in the anitya.project.version.update.v2 topic. And it must have valid values or else the for version in versions: would never run and I can assure you it does run. I.e.:

Running: /home/brian/.local/lib/watch_new_releases/aepp.sh PyPI 0.4.1.post2 True

[james-antill]

I assume it's not the problem, but the "anitya.project.version.update" path doesn't assign anything to "versions"

To what are you referring exactly? versions is being assigned from message.upstream_versions only in the anitya.project.version.update.v2 topic.

Yeh, exactly. In the "anitya.project.version.update" topic it's undeclared, but then the for version in versions: loop is still run which I assume would traceback.

I'd guess you want versions = [message.version]