[Bug]: Beta4 rockchip: ffmpeg scale_rkrga issue #19169
-
Checklist
Describe the problem you are havingOn frigate:0.16.0-beta4-rk, getting the following errors and detect stream is unusable: Steps to reproduce
See below for ffmpeg logs. Version0.16.0-d96efdb (beta4) In which browser(s) are you experiencing the issue with?No response Frigate config file# yaml-language-server: $schema=http://127.0.0.1:5000/api/config/schema.json
#################################################################################################
semantic_search:
enabled: true
reindex: false
model_size: small
genai:
enabled: true
provider: gemini
api_key: AIzaSyCQMIVTEZhgQJLhu1CYeHqtbaiMJcAZQ6A
model: gemini-2.5-flash
#model: gemini-2.0-flash
prompt: Analyze the images from the {camera} security cam. Summarize what is going
on in the sequence in a short 2-4 sentence format. If there is a car, person or
animal in the sequence, describe their direction of travel and a likely description
of what they are doing. Do not mention the sequence itself, and do not bother
to mention that your response is a summary. Ignore any items that do not appear
relevant to the object in motion.
#################################################################################################
detectors:
rknn_all:
type: rknn
num_cores: 0
model:
#########################################
# - frigate-fp16-yolov9-t
# - frigate-fp16-yolov9-s
# - frigate-fp16-yolov9-m
# - frigate-fp16-yolov9-c
# - frigate-fp16-yolov9-e
path: frigate-fp16-yolov9-s
model_type: yolo-generic
width: 320
height: 320
input_tensor: nhwc
input_dtype: float
labelmap_path: /labelmap/coco-80.txt
cameras:
###
driveway:
enabled: true
ffmpeg:
output_args:
record: preset-record-generic-audio-copy
inputs:
- path: rtsp://127.0.0.1:8554/driveway?mp4
input_args: preset-rtsp-restream-low-latency
roles:
- record
- audio
- path: rtsp://127.0.0.1:8554/driveway_sub
input_args: preset-rtsp-restream-low-latency
roles:
- detect
motion:
mask:
- 0.002,0.005,0.001,0.034,0.196,0.037,0.197,0.003
- 0,0.513,0.101,0.476,0.177,0.342,0.193,0.174,0.264,0.134,0.271,0.068,0.221,0,0,0
zones:
near_house:
coordinates: 0,0.561,0.243,0.522,0.766,0.406,0.88,0.348,1,0.315,1,1,0,1
inertia: 3
driveway_motion:
coordinates: 0.272,0.151,0.157,0.505,0.091,1,1,1,1,0.031
loitering_time: 0
detect:
fps: 3
## Full Resolution
#width: 2688
#height: 1512
## One-Third Resolution
#width: 896
#height: 504
objects:
filters:
person:
mask: 0.234,0.173,0.268,0.173,0.269,0.212,0.236,0.221
car:
mask:
- 0.505,0,0.533,0.094,0.269,0.134,0.239,0
- 0.186,0.474,0.304,0.435,0.35,1,0.139,1,0.143,0.799
review:
alerts:
required_zones:
- near_house
- driveway_motion
genai:
required_zones:
- near_house
- driveway_motion
##
back_yard_patio:
enabled: true
genai:
enabled: false
audio:
enabled: false
ffmpeg:
output_args:
record: preset-record-generic-audio-copy
inputs:
- path: rtsp://127.0.0.1:8554/back_yard_patio
input_args: preset-rtsp-restream
roles:
- record
- detect
motion:
threshold: 20
contour_area: 10
improve_contrast: 'true'
mask:
- 0,0,0,0.044,0.199,0.043,0.197,0
- 0.862,0.005,0.862,0.041,0.997,0.043,0.998,0.003
detect:
fps: 1
width: 1920
height: 1080
side_yard_cam:
enabled: true
genai:
enabled: true
objects:
- person
ffmpeg:
output_args:
record: preset-record-generic-audio-copy
inputs:
- path: rtsp://127.0.0.1:8554/side_yard_cam?mp4
input_args: preset-rtsp-restream-low-latency
roles:
- record
- audio
- path: rtsp://127.0.0.1:8554/side_yard_cam_sub
input_args: preset-rtsp-restream-low-latency
roles:
- detect
detect:
fps: 2
## Half Resolution
# width: 1344
#height: 756
## One-Third Resolution
#width: 896
#height: 504
motion:
mask:
- 0.66,1,0.997,0.989,1,0.462,0.831,0.426,0.672,0.353,0.535,0.396,0.477,0.45,0.535,0.572,0.528,0.764
- 0,0.035,0.203,0.036,0.203,0,0,0
- 0.317,0.272,0.32,0.404,0.371,0.487,0.426,0.53,0.464,0.444,0.532,0.381,0.659,0.316,0.606,0.257,0.549,0.242
- 0.42,0.094,0.404,0.129,0.419,0.144,0.437,0.129
zones:
side_yard_cam_near_house:
coordinates: 0,0.373,0.262,0.351,0.56,0.2,0.649,0.195,1,0.329,1,1,0,1
inertia: 3
loitering_time: 0
side_yard_motion:
coordinates: 0.002,0.043,0.2,0.066,0.37,0,0.638,0.005,0.427,0.189,0,0.356
loitering_time: 0
review:
alerts:
required_zones: side_yard_cam_near_house
objects:
filters:
car:
mask: 0.033,0.278,0,0.315,0,1,1,1,0.531,0.177,0.277,0.275
front_doorbell_cam:
genai:
use_snapshot: true
prompt: This is a doorbell camera at my front door. Analyze the {label} from
these images, focusing on the actions
object_prompts:
person: Analyze the person in these images. Try to determine what they are
doing, and if they are delivering something. If there is a delivery vehicle
in the background, describe it, including which carrier service it might
be from. If there is a package in the images, describe the package type,
size and description. If this is not likely a delivery person, do not mention
anything related to deliveries, packages or delivery trucks.
dog: Describe the appearance and size of the dog. Try to determine what they
are doing. If a person is with the dog, describe the persons height, build,
and general description.
car: Describe the vehicle in the sequence. If it has a logo or looks to be
a delivery or work vehicle, try to determine the type of vehicle and the
company name or business type. If this is likely not a delivery or work
vehicle, just give a brief description of the likely type, make, model and
color of the vehicle.
required_zones:
- front_doorbell_near_house
- front_doorbell_face_zone
enabled: true
audio:
enabled: false
ffmpeg:
output_args:
record: preset-record-generic-audio-copy
inputs:
- path: rtsp://127.0.0.1:8554/front_doorbell_cam?video&audio
input_args: preset-rtsp-restream
roles:
- record
- detect
detect:
fps: 2
## Native Resolution - Used for face detection (maybe)
width: 2560
height: 1920
## Half Resolution
# width: 1280
# height: 960
annotation_offset: -1750
mqtt:
timestamp: false
bounding_box: false
crop: true
quality: 100
height: 1000
motion:
mask:
- 0.866,0.577,0.715,0.608,0.703,0.646,0.722,0.665,0.77,0.685,0.831,0.689,0.91,0.686,0.945,0.633
- 1,0.092,1,0,0.935,0,0.888,0,0.797,0,0.59,0,0.607,0.274,0.611,0.527,0.949,0.395,0.999,0.338
- 0,0,0.726,0,0.72,0.147,0.162,0.191,0.133,0.688,0,1,0,0.417,0,0.246
- 0.655,0.958,0.658,1,0.987,1,0.986,0.958
threshold: 32
contour_area: 19
improve_contrast: 'true'
zones:
front_doorbell_near_house:
coordinates: 0,0.707,0.138,0.699,0.266,0.682,0.544,0.65,0.846,0.57,1,0.742,1,1,0,1
front_doorbell_face_zone:
coordinates: 0.309,0.766,0.69,0.694,0.672,1,0,1,0.004,0.742
loitering_time: 0
objects: person
inertia: 3
Guest_Parking_Low:
coordinates: 0.238,0.682,0.239,0.707,0.143,0.714,0.143,0.686
loitering_time: 0
objects: car
inertia: 3
Guest_Parking_High:
coordinates: 0.436,0.656,0.436,0.691,0.634,0.644,0.813,0.589,0.808,0.558,0.566,0.632
loitering_time: 0
objects: car
review:
alerts:
required_zones: front_doorbell_near_house
objects:
filters:
car:
mask: 0.284,0.524,0.228,0.623,0.434,0.597,0.438,0.525
camera_groups:
Front_Yard:
order: 1
icon: LuFish
cameras:
- driveway
- front_door
- side_yard_cam
- front_doorbell_cam
- back_yard_patio
Front_of_house:
order: 2
icon: LuActivity
cameras: birdseye
go2rtc:
ffmpeg:
global: -v info
log:
level: info
webrtc:
candidates:
- 192.168.11.8:8555
- stun:8555
streams:
driveway:
- rtsps://192.168.255.136:7441/LvsMuZNLIj1hAeXE#video=copy#audio=opus
- ffmpeg:driveway#audio=opus
#- path: rtsps://192.168.11.182:7441/sJKCVajaBKvzO1RS # Med Res
driveway_sub:
- rtsps://192.168.255.136:7441/sJKCVajaBKvzO1RS#video=copy#audio=opus
side_yard_cam:
- rtsps://192.168.255.136:7441/eZjRzeAWvqY1E8W5#video=copy#audio=opus
side_yard_cam_sub:
- rtsps://192.168.255.136:7441/o8t88VBOqewk4hBo#video=copy#audio=opus
back_yard_patio:
- rtsp://thingino:thingino@192.168.255.11/ch0#video=copy#audio=opus
back_yard_patio_sub:
- rtsp://thingino:thingino@192.168.255.11/ch1
front_doorbell_cam:
- ffmpeg:http://192.168.255.54/flv?port=1935&app=bcs&stream=channel0_main.bcs&user=admin&password=<REDACTED>#video=copy#audio=copy#audio=opus
- rtsp://admin:<REDACTED>@192.168.255.54:554/h264Preview_01_main
front_doorbell_cam_substream:
- rtsp://admin:<REDACTED>@192.168.255.54:554/h264Preview_01_sub#video=copy#audio=opus
version: 0.16-0
#################################################################################################
auth:
enabled: false
#################################################################################################
birdseye:
enabled: true
mode: motion
#################################################################################################
logger:
default: info
logs:
ffmpeg: debug
ffmpeg.front_doorbell_cam.detect: debug
#################################################################################################
mqtt:
enabled: true
host: 192.168.11.5
client_id: frigate-rock5
topic_prefix: frigate-rock5
#################################################################################################
audio: # <- enable audio events for all camera
enabled: true
# Optional: Configure the min rms volume required to run audio detection (default: shown below)
# As a rule of thumb:
# - 200 - high sensitivity
# - 500 - medium sensitivity
# - 1000 - low sensitivity
min_volume: 600
listen:
- fire_alarm
- scream
- yell
- whoop
- crying
- yip
- howl
- wild_animals
- splinter
- crack
- shatter
ffmpeg:
hwaccel_args: preset-rk-h264
output_args:
record: preset-record-generic-audio-copy
#################################################################################################
objects:
track:
- person
- dog
- car
- bicycle
- cat
- motorcycle
- bear
- sheep
- truck
- horse
- sheep
- cow
filters:
dog:
min_score: 0.4
threshold: 0.5
#################################################################################################
snapshots:
enabled: true
#################################################################################################
record:
enabled: true
retain:
days: 2
mode: all
alerts:
retain:
days: 30
pre_capture: 5
post_capture: 15
detections:
retain:
days: 30
pre_capture: 5
post_capture: 15
detect:
enabled: true
face_recognition:
enabled: true
model_size: large
min_area: 12000
lpr:
enabled: false
classification:
bird:
enabled: falsedocker-compose file or Docker CLI commandfrigate:
container_name: frigate-rock5
restart: unless-stopped
image: ghcr.io/blakeblackshear/frigate:0.16.0-beta4-rk
shm_size: "450mb"
environment:
- "PLUS_API_KEY=<REDACTED>"
- TZ=America/Los_Angeles
volumes:
- ./frigate/config:/config
- ./frigate/storage:/media/frigate
- /etc/group:/media/group:rw
- /sys:/sys:ro
ports:
- "5000:5000"
- "8554:8554" # rtsp
- "8555:8555" # STUN
- "1984:1984" # go2rtc
#- "1935:1935" # rtmp, stated as needed for homeassistant integration
privileged: true
security_opt:
- apparmor=unconfined
- systempaths=unconfined
devices:
- /dev/dri
- /dev/dma_heap
- /dev/rga
- /dev/mpp_service
deploy:
resources:
limits:
memory: 24G
pids: 1024Relevant Frigate log outputwarning | 2025-07-16 11:46:53 | frigate.record.maintainer | Too many unprocessed recording segments in cache for front_doorbell_cam. This likely indicates an issue with the detect stream, keeping the 6 most recent segments out of 7 and discarding the rest...
info | 2025-07-16 11:46:54 | watchdog.front_doorbell_cam | No frames received from front_doorbell_cam in 20 seconds. Exiting ffmpeg...
info | 2025-07-16 11:46:54 | watchdog.front_doorbell_cam | Waiting for ffmpeg to exit gracefully...
error | 2025-07-16 11:46:54 | frigate.video | front_doorbell_cam: Unable to read frames from ffmpeg process.
error | 2025-07-16 11:46:54 | frigate.video | front_doorbell_cam: ffmpeg process is not running. exiting capture thread...
error | 2025-07-16 11:46:54 | watchdog.front_doorbell_cam | The following ffmpeg logs include the last 100 lines prior to exit.
error | 2025-07-16 11:46:54 | ffmpeg.front_doorbell_cam.detect | [segment @ 0xaaaadf21af10] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
error | 2025-07-16 11:46:54 | ffmpeg.front_doorbell_cam.detect | [Parsed_scale_rkrga_0 @ 0xaaaadf4d5e00] No hw context provided on input
error | 2025-07-16 11:46:54 | ffmpeg.front_doorbell_cam.detect | [Parsed_scale_rkrga_0 @ 0xaaaadf4d5e00] Failed to configure output pad on Parsed_scale_rkrga_0
error | 2025-07-16 11:46:54 | ffmpeg.front_doorbell_cam.detect | Error initializing filters!
error | 2025-07-16 11:46:54 | ffmpeg.front_doorbell_cam.detect | Error marking filters as finished
error | 2025-07-16 11:46:54 | ffmpeg.front_doorbell_cam.detect | [out#1/rawvideo @ 0xaaaadf21b1a0] Nothing was written into output file, because at least one of its streams received no packets.
info | 2025-07-16 11:46:54 | watchdog.front_doorbell_cam | Restarting ffmpeg...Relevant go2rtc log outputN/A, go2rtc is working just fine.Operating systemDebian Install methodDocker Compose Network connectionWired Camera make and modelReolink POE doorbell Screenshots of the Frigate UI's System metrics pages
Any other information that may be helpfulManually tested in cmdline (docker exec -ti frigate /bin/bash, ffmpeg executed manually): Bad (Beta4)Good (beta3) |
Beta Was this translation helpful? Give feedback.
Answered by
MarcA711
Jul 30, 2025
Replies: 6 comments 10 replies
-
|
This seems relevant - @MarcA711 #18535 (comment) |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
Similar report from another user: https://github.com/blakeblackshear/frigate/discussions/19114#discussioncomment-13757431 |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
Hey, |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
Nothing abnormal is in dmesg, just the normal kernel messages about docker networking devices being created/torn down. Kernel version: |
Beta Was this translation helpful? Give feedback.
5 replies
-
|
This is Ubuntu rockchip, right? If so, could you try out armbian (maybe using a spare SD Card)? Ubuntu rockchip is not actively maintained at the moment, so I would recommend to switch in any case. Maybe this issue is caused by an outdated RGA driver in Ubuntu rockchip. Otherwise, I will install Ubuntu rockchip tomorrow and test it. |
Beta Was this translation helpful? Give feedback.
-
|
Fair point, it's been on my TODO list for a while to try armbian again (I didn't get opencl support working last time I used it). FWIW it looks like RGA is version 1.3.4 on ubuntu-rockchip: |
Beta Was this translation helpful? Give feedback.
-
|
On current Armbian it is: |
Beta Was this translation helpful? Give feedback.
-
|
I copied in the RGA driver files from linux-rockchip (armbian repo) and recompiled the kernel to pick up rkrga 1.3.7 and beta4 is still broken with the exact same behavior. Beta3 works fine. |
Beta Was this translation helpful? Give feedback.
-
|
It's also a bit odd because there is another camera using scale_rkrga without issue - a thingino (wyze3) camera at 1920x1080 is working fine. The broken camera is a 2560x1920 reolink poe doorbell cam. |
Beta Was this translation helpful? Give feedback.
-
|
Maybe @nyanmisaka can help here? @gwmullin if you want, you can downgrade to the older FFmpeg version so that all of your cams work in the beta 4. and mount it to the container: |
Beta Was this translation helpful? Give feedback.
3 replies
-
Beta Was this translation helpful? Give feedback.
-
|
Thanks, I didn't have this in mind. I will create a 7.0 binary then. Is the 7.0 or 7.1 branch stable enough to use it as default or should the default still be 6.1? |
Beta Was this translation helpful? Give feedback.
-
|
7.x should be stable enough at least in my use case. 7.0 is not an LTS version, it will lose upstream maintenance after the last distro upgraded to 7.1. |
Beta Was this translation helpful? Give feedback.
-
|
Hey @gwmullin,
|
Beta Was this translation helpful? Give feedback.
2 replies
-
|
Just got a bit of time to test this - The ffmpeg binary you provided above and the input args completely resolve the issues, works perfectly with the changes! Thanks for the continued efforts on this project! |
Beta Was this translation helpful? Give feedback.
-
|
Glad that it works. For details, see https://deploy-preview-16390--frigate-docs.netlify.app/configuration/hardware_acceleration_video#rockchip-platform |
Beta Was this translation helpful? Give feedback.
Answer selected by
NickM-27
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Glad that it works.
If you upgrade to rc1 (or higher) you can add this to your config:
For details, see https://deploy-preview-16390--frigate-docs.netlify.app/configuration/hardware_acceleration_video#rockchip-platform