[Detector Support]: Migrating to 0.17.0 and Nvidia GeForce RTX 5070 Ti, No Detection

[dolai1]

Describe the problem you are having

Much appreciation for the amazing software, as before.

I am in the process of migrating from 0.16 and mini PCIe Corals (4) to 0.17.0 and a discrete GPU, an Nvidia GeForce RTX 5070 Ti.

I have been able to get the GPU to the container and to fulfill decoding roles (nvidia-smi shows both ffmpeg and frigate.detector:onnx processes), but no detection is occurring (motion boxes show up, but no labels are assigned in debug views).

I exported the model as ONNX using the command here.

What am I missing?

Thank you.

Note: Onvif, motion, objects, and zones sections have been removed from the per-camera settings of the config file to keep things cleaner; it's long enough as-is...

Version

0.17.0-f0d69f7

Frigate config file

mqtt:
  host: IP
  port: PORT
  user: USER
  password: PASS

detectors:
  onnx:
    type: onnx

model:
  model_type: yolo-generic
  width: 320
  height: 320
  input_tensor: nchw
  input_dtype: float
  path: /config/model_cache/yolov9-t-320.onnx
  labelmap_path: /labelmap/coco-80.txt

birdseye:
  enabled: true
  width: 3840
  height: 2160
  quality: 5
  mode: continuous
  restream: true
  inactivity_threshold: 15
  layout:
    max_cameras: 9

ffmpeg:
  hwaccel_args: preset-nvidia

objects:
  track:
    - person
    - car
    - horse

record:
  enabled: true
  alerts:
    retain:
      days: 90
    pre_capture: 10
    post_capture: 10
  detections:
    retain:
      days: 90
    pre_capture: 10
    post_capture: 10
  continuous:
    days: 45
  motion:
    days: 45

snapshots:
  enabled: true
  timestamp: true
  bounding_box: true
  crop: true
  retain:
    default: 90
    objects:
      person: 180
      car: 90

go2rtc:
  streams:
    cam1:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
    cam1_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
    cam2:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam2#audio=opus
    cam2_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam2#audio=opus
    cam3:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam3#audio=opus
    cam3_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam3_sub#audio=opus
    cam4:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam4#audio=opus
    cam4_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam4_sub#audio=opus
    cam5:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam5#audio=opus
    cam5_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam5_sub#audio=opus
    cam6:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam6#audio=opus
    cam6_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam6_sub#audio=opus
    cam7:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam7#audio=opus
    cam7_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam7_sub#audio=opus
    cam8:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
    cam8_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
    cam9:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
    cam9_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
    cam10:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam10#audio=opus
    cam10_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam10#audio=opus
    cam11:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
    cam11_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
    cam12:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam12#audio=opus
    cam12_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam12_sub#audio=opus
    cam13:
      - ffmpeg:http://IP:PORT/flv?port=PORT&app=bcs&stream=channel0_main.bcs&user=USER&password=PASS#video=copy#audio=copy#audio=opus
    cam13_sub:
      - ffmpeg:http://IP:PORT/flv?port=PORT&app=bcs&stream=channel0_ext.bcs&user=USER&password=PASS#video=copy#audio=copy#audio=opus
    cam14:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
    cam14_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
    cam15:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam15#audio=opus
    cam15_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam15_sub#audio=opus
    cam16:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam16#audio=opus
    cam16_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam16_sub#audio=opus
    cam17:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam17#audio=opus
    cam17_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam17_sub#audio=opus
    cam18:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam18#audio=opus
    cam18_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam18_sub#audio=opus
    cam19:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam19#audio=opus
    cam19_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam19_sub#audio=opus
    cam20:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam20#audio=opus
    cam20_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam20_sub#audio=opus
    cam21:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
    cam21_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
    cam22:
      - ffmpeg:http://IP:PORT/flv?port=PORT&app=bcs&stream=channel0_main.bcs&user=USER&password=PASS#video=copy#audio=copy#audio=opus
    cam22_sub:
      - ffmpeg:http://IP:PORT/flv?port=PORT&app=bcs&stream=channel0_ext.bcs&user=USER&password=PASS#video=copy#audio=copy#audio=opus
    cam23:
      - ffmpeg:http://IP:PORT/flv?port=PORT&app=bcs&stream=channel0_main.bcs&user=USER&password=PASS#video=copy#audio=copy#audio=opus
    cam23_sub:
      - ffmpeg:http://IP:PORT/flv?port=PORT&app=bcs&stream=channel0_ext.bcs&user=USER&password=PASS#video=copy#audio=copy#audio=opus
    cam24:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam24#audio=opus
    cam24_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam24_sub#audio=opus
    cam25:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam25#audio=opus
    cam25_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam25_sub#audio=opus
    cam26:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam26#audio=opus
    cam26_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam26_sub#audio=opus
    cam27:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=0
      - ffmpeg:cam27_west#audio=opus
    cam27_sub:
      - rtsp://USER:PASS@IP:PORT/cam/realmonitor?channel=1&subtype=2
      - ffmpeg:cam27_sub#audio=opus
  webrtc:
    candidates:
      - IP1:8555
      - IP2:8555
      - stun:8555

timestamp_style:
  format: '%Y.%m.%d %H:%M:%S'
  thickness: 1

cameras:
  cam1:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam1
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam1_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam2:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam2
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam2_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    birdseye:
      mode: objects
  cam3:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam3
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam3_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam4:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam4
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam4_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam5:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam5
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam5_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam6:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam6
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam6_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam7:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam7
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam7_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1920
      height: 1080
    birdseye:
      order: 1
  cam8:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam8
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam8_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam9:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam9
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam9_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam10:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam10
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam10_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam11:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam11
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam11_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam12:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam12
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam12_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1920
      height: 1080
    birdseye:
      order: 0
  cam13:
    ffmpeg:
      inputs:
        - path: 
            rtsp://127.0.0.1:8554/cam13?video=copy&audio=aac
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: 
            rtsp://127.0.0.1:8554/cam13_sub?video=copy&audio=aac
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam14:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam14
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam14_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    detect:
      width: 1280
      height: 720
    birdseye:
      enabled: false
  cam15:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam15
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam15_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1920
      height: 1080
    birdseye:
      order: 3
  cam16:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam16
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam16_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam17:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam17
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam17_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam18:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam18
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam18_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1920
      height: 1080
    birdseye:
      order: 2
  cam19:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam19
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam19_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam20:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam20
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam20_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam21:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam21
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam21_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam22:
    ffmpeg:
      inputs:
        - path: 
            rtsp://127.0.0.1:8554/cam22?video=copy&audio=aac
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: 
            rtsp://127.0.0.1:8554/cam22_sub?video=copy&audio=aac
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam23:
    ffmpeg:
      inputs:
        - path: 
            rtsp://127.0.0.1:8554/cam23?video=copy&audio=aac
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: 
            rtsp://127.0.0.1:8554/cam23_sub?video=copy&audio=aac
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam24:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam24
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam24_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam25:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam25
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam25_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam26:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam26
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam26_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects
  cam27:
    ffmpeg:
      inputs:
        - path: rtsp://127.0.0.1:8554/cam27
          input_args: preset-rtsp-restream
          roles:
            - record
        - path: rtsp://127.0.0.1:8554/cam27_sub
          input_args: preset-rtsp-restream
          roles:
            - detect
      output_args:
        record: preset-record-generic-audio-copy
    detect:
      width: 1280
      height: 720
    birdseye:
      mode: objects

version: 0.17-0

docker-compose file or Docker CLI command

services:
  frigate:
    container_name: frigate
    privileged: true
    restart: unless-stopped
    stop_grace_period: 30s # Added on migration
    image: ghcr.io/blakeblackshear/frigate:stable-tensorrt # Version changed from "stable" on migration
    deploy: # Section added on migration
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: 1
              capabilities: [gpu]
    shm_size: "1280mb"
    devices:
      - /dev/accel:/dev/accel
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - ./config/:/config/
      - /mnt/DockerVols/leonidas:/media/frigate
      - type: tmpfs
        target: /tmp/cache
        tmpfs:
          size: 1000000000
    ports:
      - "5000:5000"     # HTTP, temporary
      - "8554:8554"     # RTSP feeds
      - "8555:8555/tcp" # WebRTC over TCP
      - "8555:8555/udp" # WebRTC over UDP
      - "8971:8971"     # Added on migration
    environment:
      FRIGATE_RTSP_PASSWORD: "RTSP_password_placeholder"

Relevant Frigate log output

ONNX: loading /config/model_cache/yolov9-t-320.onnx
ONNX: /config/model_cache/yolov9-t-320.onnx loaded

Install method

Docker Compose

Object Detector

TensorRT

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

No response

[NickM-27]

There are some known issues with blackwell in 0.17, support will be improved in 0.18

[dolai1]

Does it seem like that's what's going on here (no clear issues with my config)? GPU-based decoding and encoding are working well. Thanks.