ffmpeg - 0.11 beta on synlogy 1019+ (no coral) #3801

joelegg · 2022-09-08T23:03:11Z

joelegg
Sep 8, 2022

hi all,

i was running this in my config which worked on 0.10 (tho i had pretty high cpu)

ffmpeg:
  hwaccel_args:
    - -hwaccel
    - qsv
    - -qsv_device
    - /dev/dri/renderD128

Just moved to the 0.11 beta running supervisor on my synology in a VMM. And i had to remove that ffmpeg for it to work.

Tho my cpu is quite low compared to how it was running before. I am not sure if it is due to me removing ffmpeg.

Anyway i can't use this setting anymore as it fails to read (green cams). should I just leave it for now out? I am getting a coral ai in the next week also

Thank you

NickM-27 · 2022-09-08T23:05:45Z

NickM-27
Sep 8, 2022
Collaborator Sponsor

Read the new docs, the new recommended arg is

ffmpeg:
  hwaccel_args: -c:v h264_qsv

https://deploy-preview-2829--frigate-docs.netlify.app/configuration/hardware_acceleration

0 replies

joelegg · 2022-09-08T23:08:04Z

joelegg
Sep 8, 2022
Author

thank you - i missed that and was looking on the old page some how.

0 replies

joelegg · 2022-09-08T23:14:52Z

joelegg
Sep 8, 2022
Author

I've tried both versions and it's failing.

I am running my cameras on h264+ - could that cause an issue?

2022-09-09 09:13:45] ws4py                          INFO    : Using epoll
[2022-09-09 09:13:55] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:60474]
[2022-09-09 09:13:56] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:60474]
[2022-09-09 09:14:04] watchdog.Side                  INFO    : No frames received from Side in 20 seconds. Exiting ffmpeg...
[2022-09-09 09:14:04] watchdog.Side                  INFO    : Waiting for ffmpeg to exit gracefully...
[2022-09-09 09:14:04] frigate.video                  ERROR   : Side: Unable to read frames from ffmpeg process.
[2022-09-09 09:14:04] frigate.video                  ERROR   : Side: ffmpeg process is not running. exiting capture thread...
[2022-09-09 09:14:05] watchdog.Backyard              INFO    : No frames received from Backyard in 20 seconds. Exiting ffmpeg...
[2022-09-09 09:14:05] watchdog.Backyard              INFO    : Waiting for ffmpeg to exit gracefully...
[2022-09-09 09:14:05] watchdog.Front_PTZ             INFO    : No frames received from Front_PTZ in 20 seconds. Exiting ffmpeg...
[2022-09-09 09:14:05] watchdog.Front_PTZ             INFO    : Waiting for ffmpeg to exit gracefully...
[2022-09-09 09:14:05] watchdog.Porch                 INFO    : No frames received from Porch in 20 seconds. Exiting ffmpeg...
[2022-09-09 09:14:05] watchdog.Porch                 INFO    : Waiting for ffmpeg to exit gracefully...
[2022-09-09 09:14:05] frigate.video                  ERROR   : Porch: Unable to read frames from ffmpeg process.
[2022-09-09 09:14:05] frigate.video                  ERROR   : Porch: ffmpeg process is not running. exiting capture thread...
[2022-09-09 09:14:05] frigate.video                  ERROR   : Front_PTZ: Unable to read frames from ffmpeg process.
[2022-09-09 09:14:05] frigate.video                  ERROR   : Front_PTZ: ffmpeg process is not running. exiting capture thread...
[2022-09-09 09:14:05] watchdog.Driveway              INFO    : No frames received from Driveway in 20 seconds. Exiting ffmpeg...
[2022-09-09 09:14:05] watchdog.Driveway              INFO    : Waiting for ffmpeg to exit gracefully...
[2022-09-09 09:14:05] frigate.video                  ERROR   : Backyard: Unable to read frames from ffmpeg process.
[2022-09-09 09:14:05] frigate.video                  ERROR   : Backyard: ffmpeg process is not running. exiting capture thread...
[2022-09-09 09:14:05] frigate.video                  ERROR   : Driveway: Unable to read frames from ffmpeg process.
[2022-09-09 09:14:05] frigate.video                  ERROR   : Driveway: ffmpeg process is not running. exiting capture thread...

11 replies

NickM-27 Sep 8, 2022
Collaborator Sponsor

You'll need to add

environment_vars:
 LIBVA_DRIVER_NAME: i965

joelegg Sep 8, 2022
Author

ok i've tried that in a few different areas but it's giving the same error. should this go under each camera config perhaps?
ffmpeg:
hwaccel_args: -c:v h264_qsv

environment_vars:
LIBVA_DRIVER_NAME: i965

NickM-27 Sep 8, 2022
Collaborator Sponsor

No, it goes at the base level of the config.

joelegg Sep 9, 2022
Author

hmm. i have tried that also. with ffmpeg under mqtt

and the variable at the bottom

no luck . i have also tried both < and > 10th gen intel settings

any ideas what i'm doing wrong? thank you

joelegg Sep 9, 2022
Author

trying turning h264+ off on one of the cams. edit: no luck

seeing these errors with above settings:

 22-09-09 10:22:33] ffmpeg.Backyard.detect         ERROR   : [h264_qsv @ 0x55bbf2d36e00] get_buffer() failed
[2022-09-09 10:22:33] ffmpeg.Backyard.detect         ERROR   : Error while decoding stream #0:0: Invalid argument
[2022-09-09 10:22:33] ffmpeg.Backyard.detect         ERROR   : Finishing stream 1:0 without any data written to it.
[2022-09-09 10:22:33] ffmpeg.Backyard.detect         ERROR   : [swscaler @ 0x55bbf2d5ee00] [swscaler @ 0x55bbf2e62000] deprecated pixel format used, make sure you did set range correctly
[2022-09-09 10:22:33] ffmpeg.Backyard.detect         ERROR   : [swscaler @ 0x55bbf2d5ee00] [swscaler @ 0x55bbf2dc3380] deprecated pixel format used, make sure you did set range correctly
[2022-09-09 10:22:33] ffmpeg.Backyard.detect         ERROR   : [swscaler @ 0x55bbf2d5ee00] [swscaler @ 0x55bbf2d9a600] deprecated pixel format used, make sure you did set range correctly
[2022-09-09 10:22:33] ffmpeg.Backyard.detect         ERROR   : [swscaler @ 0x55bbf2d5ee00] [swscaler @ 0x55bbf2dfca40] deprecated pixel format used, make sure you did set range correctly
[2022-09-09 10:22:33] ffmpeg.Backyard.detect         ERROR   : [swscaler @ 0x55bbf2d5ee00] [swscaler @ 0x55bbf2e807c0] deprecated pixel format used, make sure you did set range correctly
[2022-09-09 10:22:33] ffmpeg.Front_PTZ.detect        ERROR   : [h264_qsv @ 0x558f42caeb40] get_buffer() failed
[2022-09-09 10:22:33] ffmpeg.Front_PTZ.detect        ERROR   : Error while decoding stream #0:0: Invalid argument
[2022-09-09 10:22:33] ffmpeg.Front_PTZ.detect        ERROR   : Finishing stream 1:0 without any data written to it.
[2022-09-09 10:22:33] ffmpeg.Front_PTZ.detect        ERROR   : [swscaler @ 0x558f42d37680] [swscaler @ 0x558f42da4580] deprecated pixel format used, make sure you did set range correctly
[2022-09-09 10:22:33] ffmpeg.Front_PTZ.detect        ERROR   : [swscaler @ 0x558f42d37680] [swscaler @ 0x558f42db1540] deprecated pixel format used, make sure you did set range correctly
[2022-09-09 10:22:33] ffmpeg.Front_PTZ.detect        ERROR   : [swscaler @ 0x558f42d37680] [swscaler @ 0x558f42dbe500] deprecated pixel format used, make sure you did set range correctly
[2022-09-09 10:22:33] ffmpeg.Front_PTZ.detect        ERROR   : [swscaler @ 0x558f42d37680] [swscaler @ 0x558f42e086c0] deprecated pixel format used, make sure you did set range correctly
[2022-09-09 10:22:33] ffmpeg.Front_PTZ.detect        ERROR   : [swscaler @ 0x558f42d37680] [swscaler @ 0x558f42e1dc80] deprecated pixel format used, make sure you did set range correctly
[2022-09-09 10:22:33] ffmpeg.Front_PTZ.detect        ERROR   : [flv @ 0x558f42cb4c80] Failed to update header with correct duration.
[2022-09-09 10:22:33] ffmpeg.Front_PTZ.detect        ERROR   : [flv @ 0x558f42cb4c80] Failed to update header with correct filesize.
[2022-09-09 10:22:33] ffmpeg.Backyard.detect         ERROR   : [flv @ 0x55bbf2d30380] Failed to update header with correct duration.
[2022-09-09 10:22:33] ffmpeg.Backyard.detect         ERROR   : [flv @ 0x55bbf2d30380] Failed to update header with correct filesize.
[2022-09-09 10:22:33] watchdog.Side                  ERROR   : Ffmpeg process crashed unexpectedly for Side.
[2022-09-09 10:22:33] watchdog.Side                  ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Failed to create a VAAPI device.
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error initializing an MFX session
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error decoding header
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Generic error in an external library
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [flv @ 0x5645dc49fb00] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] Error querying IO surface: unsupported (-3)
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Function not implemented
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] video_get_buffer: image parameters invalid
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [h264_qsv @ 0x5645dc4513c0] get_buffer() failed
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Error while decoding stream #0:0: Invalid argument
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : Finishing stream 1:0 without any data written to it.
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [swscaler @ 0x5645dc535e40] [swscaler @ 0x5645dc480180] deprecated pixel format used, make sure you did set range correctly
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [swscaler @ 0x5645dc535e40] [swscaler @ 0x5645dc4fc400] deprecated pixel format used, make sure you did set range correctly
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [swscaler @ 0x5645dc535e40] [swscaler @ 0x5645dc549dc0] deprecated pixel format used, make sure you did set range correctly
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [swscaler @ 0x5645dc535e40] [swscaler @ 0x5645dc59ecc0] deprecated pixel format used, make sure you did set range correctly
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [swscaler @ 0x5645dc535e40] [swscaler @ 0x5645dc5b26c0] deprecated pixel format used, make sure you did set range correctly
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [flv @ 0x5645dc49fb00] Failed to update header with correct duration.
[2022-09-09 10:22:33] ffmpeg.Side.detect             ERROR   : [flv @ 0x5645dc49fb00] Failed to update header with correct filesize.
[2022-09-09 10:22:42] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:45840]
[2022-09-09 10:22:43] ws4py                          INFO    : Managing websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:55434]
[2022-09-09 10:22:49] ws4py                          INFO    : Terminating websocket [Local => 127.0.0.1:5002 | Remote => 127.0.0.1:55434]

joelegg · 2022-09-09T20:32:15Z

joelegg
Sep 9, 2022
Author

Tried a few modem variations and can't get this to work. Hopefully it I work it out it will help someone else with this setup

0 replies

uvjustin · 2022-09-12T13:15:08Z

uvjustin
Sep 12, 2022

AFAIK, access to the iGPU is not available in the Synology VMM, so hardware decode is not possible. Why are you running Frigate in a VM? To run alongside HAOS? Even if you are using HAOS in a VM, you can still run Frigate in a Docker container outside of the VM.

0 replies

joelegg · 2022-09-12T20:54:14Z

joelegg
Sep 12, 2022
Author

cause i like having it as an add on. what is the negative of having it in a VM? what is the positive of doing it outside of the VM?

3 replies

NickM-27 Sep 12, 2022
Collaborator Sponsor

The addon has a number of restrictions including inability to use a network share / other driver for Frigate recordings (only main drive is supported without manual udev rules)

Also device access is more difficult, in this case sounds like the latest Synology might not allow gpu passthrough (same as how USB passthrough is difficult)

You can see an example of this here: #2426 (comment)

I'll have to see if I can find someone else who uses Synology with vm / passthrough.

joelegg Sep 12, 2022
Author

ah i'll def move off the VM if i have trouble with usb passthrough.

uvjustin Sep 13, 2022

Actually for USB the VM works.
On Synology DSM 7:
VM:

USB works
iGPU doesn't work

Docker:

iGPU works
USB doesn't work, but you can easily work around it using the information in @NickM-27 's link

Negatives of having it in a VM:

more overhead both in CPU and memory and other I/O
need to pre allocate resources (e.g., you need to set aside X amount of RAM)
various issues like not being able to access the iGPU

Positives of having it in a VM:

May be easier to use add-ons than docker containers
Conceptually it may be neater to keep it all in one place

Uh oh!

ffmpeg - 0.11 beta on synlogy 1019+ (no coral) #3801

Uh oh!

joelegg Sep 8, 2022

Replies: 6 comments · 14 replies

Uh oh!

Uh oh!

NickM-27 Sep 8, 2022 Collaborator Sponsor

Uh oh!

joelegg Sep 8, 2022 Author

Uh oh!

joelegg Sep 8, 2022 Author

Uh oh!

Uh oh!

NickM-27 Sep 8, 2022 Collaborator Sponsor

Uh oh!

joelegg Sep 8, 2022 Author

Uh oh!

NickM-27 Sep 8, 2022 Collaborator Sponsor

Uh oh!

joelegg Sep 9, 2022 Author

Uh oh!

Uh oh!

joelegg Sep 9, 2022 Author

Uh oh!

joelegg Sep 9, 2022 Author

Uh oh!

uvjustin Sep 12, 2022

Uh oh!

joelegg Sep 12, 2022 Author

Uh oh!

NickM-27 Sep 12, 2022 Collaborator Sponsor

Uh oh!

joelegg Sep 12, 2022 Author

Uh oh!

Uh oh!

uvjustin Sep 13, 2022

joelegg
Sep 8, 2022

Replies: 6 comments 14 replies

NickM-27
Sep 8, 2022
Collaborator Sponsor

joelegg
Sep 8, 2022
Author

joelegg
Sep 8, 2022
Author

NickM-27 Sep 8, 2022
Collaborator Sponsor

joelegg Sep 8, 2022
Author

NickM-27 Sep 8, 2022
Collaborator Sponsor

joelegg Sep 9, 2022
Author

joelegg Sep 9, 2022
Author

joelegg
Sep 9, 2022
Author

uvjustin
Sep 12, 2022

joelegg
Sep 12, 2022
Author

NickM-27 Sep 12, 2022
Collaborator Sponsor

joelegg Sep 12, 2022
Author