Banana Pi M5 ffmpeg hw acceleration

[pszafer]

Hi,
I have Banana Pi M5 and I wanted to test camera stream on it.
Unfortunately I can't get hardware acceleration working with either Home Assistant addon or docker image.

It's based on Debian 10, ffmpeg on host shows:

root@bananapi:~# ffmpeg -hide_banner -hwaccels
Hardware acceleration methods:
vdpau
vaapi
drm

Current docker-compose looks like this:

version: "3"
services:
  frigate:
    container_name: frigate
    privileged: true # this may not be necessary for all setups
    restart: unless-stopped
    image: blakeblackshear/frigate:stable-aarch64
    shm_size: "64mb" # update for your cameras based on calculation above
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - /home/pi/frigate/frigate.yml:/config/config.yml:ro
      - /home/pi/frigate/storage:/media/frigate
      - type: tmpfs # Optional: 1GB of memory, reduces SSD/SD Card wear
        target: /tmp/cache
        tmpfs:
          size: 500000000
    ports:
      - 5002:5000
      - 1935:1935
    environment:
      FRIGATE_RTSP_PASSWORD: "password"

Is it possible to enable hardware accelleration on this machine?

[NickM-27]

What hwaccel config inside frigate have you used?

[NickM-27]

It uses a different build of ffmpeg with some additional binaries included so hwaccel should have the best chance of being found / usable

[pszafer]

Now it show drm codec only and kernel panic with this build.
I guess I have to find better hardware for tests.

[NickM-27]

If you have any logs or something I may be able to help. Also did you try with / without hwaccel enabled?

[pszafer]

Hi, withouth hwaccess it works, but it takes 78% CPU all the time with one camera.
Logs with b36b635 are hard to get but after a while it makes kernel crash with some segfault message:

kernel:[60976.092945@3] bb80: ffffffc0b8747000 000000000000000a ffffffc0b7ba9e00 0000000000000000

Logs of ffmpeg are not very meaningful:

[2022-07-14 07:17:02] frigate.video                  ERROR   : wiata: Unable to read frames from ffmpeg process.
[2022-07-14 07:17:02] frigate.video                  ERROR   : wiata: ffmpeg process is not running. exiting capture thread...

Then after ffmpeg process restart kernel crashes and goes into reboot.

[pszafer]

I got something from dmesg

[  218.208738] [4] release decoder                                                                                     
[  228.200205] videosync_open                                                                                          
[  228.202945] ioctl invalid cmd 0x80685600                                                                            
[  228.205743] videosync_release                                                                                       
[  228.209222] [5] vcodec_dec decoder                                                                                  
[  228.212443] [5] release decoder                                                                                     
[  228.215841] [6] vcodec_dec decoder                                                                                  
[  228.218593] vdec_create instance ffffff8010caa000, total 3                                                          
[  228.218598] the demux           clock on, ref cnt: 3                                                                
[  228.218601] the parser_top      clock on, ref cnt: 3                                                                
[  228.218602] the vdec            clock on, ref cnt: 3                                                                
[  228.218608] vdec_init, dev_name:ammvdec_h264, vdec_type=VDEC_TYPE_FRAME_BLOCK                                       
[  228.225398] vdec: Decoder device ammvdec_h264 driver probe failed.                                                  
[  228.231388] video_component_init 354, failed                                                                        
[  228.235769] video_component_init  failed                                                                            
[  228.239744] adec_release                                                                                            
[  228.242683] Audio stbuf alloced at 00000000cfc00000, secure = 0, size = 1572864                                     
[  228.242705] vdec ports init fail.                                                                                   
[  228.245902] [ERR][6]vdec_h264 init err=-19                                                                          
[  228.250148] [ERR][6]: vdec_if_init() fail ret=-19                                                                   
[  228.255204] [6] release decoder                                                                                     
[  238.215499] videosync_open                                                                                          
[  238.218049] ioctl invalid cmd 0x80685600                                                                            
[  238.220696] videosync_release                                                                                       
[  238.223743] [7] vcodec_dec decoder                                                                                  
[  238.226679] [7] release decoder                                                                                     
[  238.229536] [8] vcodec_dec decoder                                                                                  
[  238.233200] vdec_create instance ffffff8010cbd000, total 4                                 
[  238.233206] the demux           clock on, ref cnt: 4                                                                
[  238.233209] the parser_top      clock on, ref cnt: 4
[  238.233211] the vdec            clock on, ref cnt: 4
[  238.233216] vdec_init, dev_name:ammvdec_h264, vdec_type=VDEC_TYPE_FRAME_BLOCK
[  238.241217] vdec: Decoder device ammvdec_h264 driver probe failed.
[  238.246658] video_component_init 354, failed
[  238.250895] video_component_init  failed
[  238.254891] adec_release
[  238.257900] Audio stbuf alloced at 00000000cfc00000, secure = 0, size = 1572864
[  238.257930] vdec ports init fail.
[  238.261223] [ERR][8]vdec_h264 init err=-19
[  238.265483] [ERR][8]: vdec_if_init() fail ret=-19
[  238.270634] [8] release decoder
[  248.206866] videosync_open
[  248.209231] ioctl invalid cmd 0x80685600
[  248.211692] videosync_release
[  248.214252] [9] vcodec_dec decoder
[  248.217148] [9] release decoder
[  248.221084] [10] vcodec_dec decoder
[  248.224207] Unable to handle kernel NULL pointer dereference at virtual address 00000000
[  248.232349] pgd = ffffffc0baa37000
[  248.235863] [0000000000000000] *pgd=0000000000000000, *pud=0000000000000000
[  248.243032] Internal error: Oops: 96000005 [#1] PREEMPT SMP
[  248.248707] Modules linked in: xt_nat xt_tcpudp xt_conntrack ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_conntrack_netlink xt_addrtype iptable_filter iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack br_netfilte
r bridge stp llc wireguard ip6_udp_tunnel udp_tunnel overlay spidev amvdec_ports spi_meson_spicc i2c_meson_master stream_input decoder_common firmware media_clock ip_tables x_tables ipv6
[  248.286080] CPU: 3 PID: 9429 Comm: ffmpeg Not tainted 4.9.241-BPI-M5 #2
[  248.292975] Hardware name: Bananapi BPI-M5 (DT)
[  248.297614] task: ffffffc0bda02a00 task.stack: ffffffc0bab6c000
[  248.303713] PC is at strcmp+0x18/0x160
[  248.307623] LR is at vf_reg_receiver+0x54/0xd0
[  248.312209] pc : [<ffffff8009456f58>] lr : [<ffffff8009852404>] pstate: 40400145
[  248.319808] sp : ffffffc0bab6faa0
[  248.323264] x29: ffffffc0bab6faa0 x28: 0000000000000000 
[  248.328701] x27: ffffffc0c9e2f800 x26: 0000000000000000 
[  248.334140] x25: ffffffc0b986d420 x24: ffffffc0b986d5c8 
[  248.339592] x23: ffffff8001e0f028 x22: ffffff800a952000 
[  248.345060] x21: ffffffc0b9af8eb8 x20: ffffff800a952e08 
[  248.350524] x19: ffffff800a952da8 x18: 0000000000000001 
[  248.355972] x17: 0000007f7f204f00 x16: ffffff8009252208 
[  248.361444] x15: ffffffffffffffff x14: ffffffc0b9af8e78 
[  248.366911] x13: ffffffc0b9af8e65 x12: 0000000000000000 
[  248.372403] x11: 0000000000000001 x10: 0101010101010101 
[  248.377803] x9 : fffffffffffffffc x8 : 7f7fff7f7fffff7f 
[  248.383229] x7 : 0000000000000000 x6 : 68fceb5c33831251 
[  248.388735] x5 : 511283335cebfc68 x4 : 0000000000000000 
[  248.394181] x3 : ec68d8645aecd2c8 x2 : 000000000000003d 
[  248.399636] x1 : ffffffc0b9af8e38 x0 : 0000000000000000 
[  248.405089] 
               SP: 0xffffffc0bab6fa20:
...(a lot of addresses)
[  249.062497] Process ffmpeg (pid: 9429, stack limit = 0xffffffc0bab6c000)
...(a lot of addresses)
[  249.417918] Call trace:
[  249.420585] Exception stack(0xffffffc0bab6f8d0 to 0xffffffc0bab6fa00)
[  249.427096] f8c0:                                   ffffff800a952da8 0000007fffffffff
[  249.435112] f8e0: ffffffc0bab6faa0 ffffff8009456f58 0000000000000000 0000000000000006
[  249.443102] f900: 0000000000000003 ffffff800a864000 ffffffc0bab6f930 0000000000000000
[  249.451101] f920: 0000000100000001 ffffff8009fbe8b8 ffffffc0bab6f9d0 ffffff800910d2f8
[  249.459105] f940: ffffffc0bab6f950 ffffff800946312c ffffffc0bab6f9d0 ffffff80094662c0
[  249.467109] f960: ffffffc0b9af8e63 ffffffc0b9af8e78 0000000000000000 ffffffc0b9af8e38
[  249.475101] f980: 000000000000003d ec68d8645aecd2c8 0000000000000000 511283335cebfc68
[  249.483134] f9a0: 68fceb5c33831251 0000000000000000 7f7fff7f7fffff7f fffffffffffffffc
[  249.491137] f9c0: 0101010101010101 0000000000000001 0000000000000000 ffffffc0b9af8e65
[  249.499076] f9e0: ffffffc0b9af8e78 ffffffffffffffff ffffff8009252208 0000007f7f204f00
[  249.507121] [<ffffff8009456f58>] strcmp+0x18/0x160
[  249.512041] [<ffffff8001df6370>] vcodec_vfm_init+0x90/0xc0 [amvdec_ports]
[  249.518983] [<ffffff8001df6b70>] vdec_h264_init+0x88/0x230 [amvdec_ports]
[  249.525918] [<ffffff8001df644c>] vdec_if_init+0x7c/0x110 [amvdec_ports]
[  249.532669] [<ffffff8001df3108>] vidioc_vdec_s_fmt+0x148/0x318 [amvdec_ports]
[  249.539918] [<ffffff8009714534>] v4l_s_fmt+0x414/0x548
[  249.545216] [<ffffff8009713324>] __video_do_ioctl+0x1fc/0x2c0
[  249.551126] [<ffffff8009712d40>] video_usercopy+0x250/0x5e8
[  249.556815] [<ffffff8009713114>] video_ioctl2+0x3c/0x50
[  249.562136] [<ffffff800970ce50>] v4l2_ioctl+0x88/0x118
[  249.567415] [<ffffff8009251a40>] do_vfs_ioctl+0xb0/0x878
[  249.572856] [<ffffff8009252294>] SyS_ioctl+0x8c/0xa8
[  249.577913] [<ffffff8009083740>] el0_svc_naked+0x34/0x38
[  249.583375] Code: f24008ff 540002e1 f2400807 54000141 (f8408402) 
[  249.589660] ---[ end trace 1bfb396adc3ece0f ]---
[  249.604341] [10] release decoder