Thumbnail generation not working - BullMQ queue stuck #24973
-
I have searched the existing issues, both open and closed, to make sure this is not a duplicate report.
The bugIn Immich v2.4.1, BullMQ workers register with Redis and appear connected, but fail to process jobs from the queue. The thumbnailGeneration worker specifically:
The core issue: Jobs accumulate in immich_bull:thumbnailGeneration:wait (list), markers are added and consumed, but the worker's Lua script to move jobs from wait→active never executes successfully. Additionally, in UI, after restarting the docker container, when triggering Generate Thumbnails (ALL) only 1 appears in the queue and get processed. EXTRACT METADATA has 1 stuck in Waiting. 
The OS that Immich Server is running onDebian Trixie (Linux 6.12) Version of Immich Serverv2.4.1 Version of Immich Mobile Appv1.0.0 Platform with the issue
Device make and modelNo response Your docker-compose.yml content#
# WARNING: To install Immich, follow our guide: https://immich.app/docs/install/docker-co>
#
# Make sure to use the docker-compose.yml of the current release:
#
# https://github.com/immich-app/immich/releases/latest/download/docker-compose.yml
#
# The compose file on main may not be compatible with the latest release.
name: immich
services:
immich-server:
container_name: immich_server
image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
user: "1000:1000"
# extends:
# file: hwaccel.transcoding.yml
# service: cpu # set to one of [nvenc, quicksync, rkmpp, vaapi, vaapi-wsl] for acce>
volumes:
# Do not edit the next line. If you want to change the media storage location on yo>
- ${UPLOAD_LOCATION}:/data
- /mnt/backup/immich:/data/backups
- /etc/localtime:/etc/localtime:ro
- /mnt/data/photos/Photography/exports/private:/mnt/data/photos/Photography/exports>
env_file:
- .env
environment:
IMMICH_PORT: "2283"
ports:
- '2283:2283'
depends_on:
- redis
restart: always
healthcheck:
disable: false
networks: [infra]
labels:
- "traefik.enable=true"
- "traefik.http.routers.immich.rule=Host(`lola`)"
- "traefik.http.services.immich.loadbalancer.server.port=2283"
- "traefik.http.routers.immich.tls=true"
logging:
driver: "json-file"
options:
max-size: "10m"
max-file: "3"
immich-machine-learning:
container_name: immich_machine_learning
# For hardware acceleration, add one of -[armnn, cuda, rocm, openvino, rknn] to the i>
# Example tag: ${IMMICH_VERSION:-release}-cuda
image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
user: "1000:1000"
# extends: # uncomment this section for hardware acceleration - see https://immich.ap>
# file: hwaccel.ml.yml
# service: cpu # set to one of [armnn, cuda, rocm, openvino, openvino-wsl, rknn] fo>
volumes:
- model-cache:/cache
environment:
IMMICH_PORT: 3003
env_file:
- .env
restart: always
healthcheck:
disable: false
networks: [infra]
logging:
driver: "json-file"
options:
max-size: "10m"
max-file: "3"
redis:
container_name: immich_redis
image: docker.io/valkey/valkey:8-bookworm@sha256:xxxxx>
healthcheck:
test: redis-cli ping || exit 1
restart: always
networks: [infra]
logging:
driver: "json-file"
options:
max-size: "10m"
max-file: "3"
volumes:
model-cache:
networks:
infra:
external: trueYour .env content# You can find documentation for all the supported env variables at https://immich.app/do>
# The location where your uploaded files are stored
UPLOAD_LOCATION=/mnt/data/docker-apps/immich/
# The location where your database files are stored. Network shares are not supported for>
DB_URL=postgresql://xxx:xxx@postgres:5432/db
# To set a timezone, uncomment the next line and change Etc/UTC to a TZ identifier from t>
TZ=Europe/Berlin
# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release
DB_VECTOR_EXTENSION=vectorchord
# Ensure the API binds to all interfaces (LAN access)
HOST=0.0.0.0
IMMICH_PORT=2283
IMMICH_HOST=0.0.0.0Reproduction steps
Relevant log outputStartup logs (normal):
[Microservices:QueueService] Setting thumbnailGeneration concurrency to 2
[Microservices:InstanceLoader] BullModule dependencies initialized
[Microservices:Bootstrap] Immich Microservices is running [v2.4.1] [production]
No processing logs appear - no MediaService or thumbnail generation activity.
Only 404 errors when UI tries to display missing thumbnails:
[Api:GlobalExceptionFilter] HttpException(404): {"message":"Asset media not found","error":"Not Found","statusCode":404}
---
Redis State Evidence
Worker connected but idle:
id=73 name=immich_bull:dGh1bWJuYWlsR2VuZXJhdGlvbg== age=1310 idle=2 flags=b cmd=bzpopmin
(Base64 dGh1bWJuYWlsR2VuZXJhdGlvbg== = thumbnailGeneration)
Queue state:
# Jobs waiting (accumulating)
LLEN immich_bull:thumbnailGeneration:wait
# Result: 76446
# Jobs active (always 0)
LLEN immich_bull:thumbnailGeneration:active
# Result: 0
# Jobs completed (always 0)
ZCARD immich_bull:thumbnailGeneration:completed
# Result: 0
# Marker missing after being consumed
TYPE immich_bull:thumbnailGeneration:marker
# Result: none
Events stream shows jobs added but never activated:
XRANGE immich_bull:thumbnailGeneration:events - + COUNT 5
# Shows: event=added, event=waiting (repeating)
# Never shows: event=active, event=completed
BullMQ version:
HGETALL immich_bull:thumbnailGeneration:meta
# version: bullmq:5.66.0Additional informationEnvironment
Additional Findings
|
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 3 replies
-
|
Do you have any other redis containers in your [infra] network? Any special reason you decided to partition this off and add a custom network? You are much better off putting only immich_server on the external network and everything else on an internal one. |
Beta Was this translation helpful? Give feedback.
-
|
@Mraedis thank you for your feedback. I have 2 Redis containers in my infra network: Both are separate instances serving different applications. Each app is using its own separate Redis instance: Immich → immich_redis (Valkey 8) on 172.18.0.2 I actually didn't partition Immich off - I actually did the opposite. I integrated it into my centralized infrastructure network so it can have access to shared Postgres instance. Can you tell me more about what do you mean by "You are much better off putting only immich_server on the external network and everything else on an internal one." - Should I only put immich_server on my shared |
Beta Was this translation helpful? Give feedback.
-
|
I understand they are separate things, but the service name in both cases is "redis", I wager. |
Beta Was this translation helpful? Give feedback.
-
|
@Mraedis that fixed it! Thank you! |
Beta Was this translation helpful? Give feedback.
-
|
Thanks so much @Mraedis, I was beginning to lose my mind over here |
Beta Was this translation helpful? Give feedback.
I understand they are separate things, but the service name in both cases is "redis", I wager.
Immich doesn't check for IP or whatever, it just connects to "redis", which is available from the other container because you are mingling the networks.