[Camera Support]: Thermal camera

[temuccio]

Describe the problem you are having

Hello, I am using this system with 3 cameras. 2 of them are regular cameras and work quite well, but 1 is a thermal camera. Considering that, understandably, no objects are detected by the thermal camera, how can I enable recording only through motion detection?

Version

0.13.2-6476f8a

Frigate config file

mqtt:
  enabled: False

detectors:
  ov:
    type: openvino
    device: AUTO
    model:
      path: /openvino-model/ssdlite_mobilenet_v2.xml

model:
  width: 300
  height: 300
  input_tensor: nhwc
  input_pixel_format: bgr
  labelmap_path: /openvino-model/coco_91cl_bkgr.txt

objects:
  track:
    - person
    - car

record:
  enabled: True
  retain:
    days: 7
    mode: motion
  events:
    retain:
      default: 30
      mode: motion 

birdseye:
  enabled: True
  mode: continuous

cameras:
  cancello:
    enabled: True
    ffmpeg:
      inputs:
        - path: rtsp://admin:test$@192.168.178.10/Streaming/channels/101/
          roles:
            - detect
            - record
    birdseye:
      mode: objects
  normale:
    enabled: True
    ffmpeg:
      inputs:
        - path: rtsp://admin:test@192.168.178.110/Streaming/channels/101/
          roles:
            - detect
            - record
    birdseye:
      mode: objects
  termica:
    enabled: True
    ffmpeg:
      inputs:
        - path: rtsp://admin:test@192.168.178.110/Streaming/channels/201/
          roles:
            - detect
            - record
    motion:
      mask:
        - 0,240,320,240,320,0,0,0
    birdseye:
      mode: objects

Relevant log output

2024-03-03 19:41:49.572854432  [INFO] Preparing Frigate...
2024-03-03 19:41:50.082785180  [INFO] Starting Frigate...
2024-03-03 19:42:09.007257663  [2024-03-03 19:42:09] frigate.app                    INFO    : Starting Frigate (0.13.2-6476f8a)
2024-03-03 19:42:20.067801175  [2024-03-03 19:42:20] frigate.config                 WARNING : Customizing more than a detector model path is unsupported.
2024-03-03 19:42:20.197252883  [2024-03-03 19:42:20] peewee_migrate.logs            INFO    : Starting migrations
2024-03-03 19:42:20.253328757  [2024-03-03 19:42:20] peewee_migrate.logs            INFO    : There is nothing to migrate
2024-03-03 19:42:20.263156051  [2024-03-03 19:42:20] frigate.app                    INFO    : Recording process started: 509
2024-03-03 19:42:20.268714533  [2024-03-03 19:42:20] frigate.app                    INFO    : go2rtc process pid: 89
2024-03-03 19:42:20.319825665  [2024-03-03 19:42:20] frigate.app                    INFO    : Output process started: 520
2024-03-03 19:42:20.344867659  [2024-03-03 19:42:20] detector.ov                    INFO    : Starting detection process: 518
2024-03-03 19:42:21.163183528  [2024-03-03 19:42:21] frigate.app                    INFO    : Camera processor started for cancello: 537
2024-03-03 19:42:21.172446548  [2024-03-03 19:42:21] frigate.app                    INFO    : Camera processor started for normale: 539
2024-03-03 19:42:21.181989599  [2024-03-03 19:42:21] frigate.app                    INFO    : Camera processor started for termica: 540
2024-03-03 19:42:21.191590069  [2024-03-03 19:42:21] frigate.app                    INFO    : Capture process started for cancello: 543
2024-03-03 19:42:21.202445593  [2024-03-03 19:42:21] frigate.app                    INFO    : Capture process started for normale: 547
2024-03-03 19:42:21.213020959  [2024-03-03 19:42:21] frigate.app                    INFO    : Capture process started for termica: 551
2024-03-03 19:42:21.638819036  [2024-03-03 19:42:21] frigate.app                    WARNING : The current SHM size of 64.0MB is too small, recommend increasing it to at least 68.3MB.
2024-03-03 19:42:22.310774195  �[35mE: [xLinkUsb] [    942310] [frigate.detecto] usb_find_device_with_bcd:266	Library has not been initialized when loaded�[0m
2024-03-03 19:42:22.321056477  �[35mE: [xLinkUsb] [    942321] [frigate.detecto] usb_find_device_with_bcd:266	Library has not been initialized when loaded�[0m
2024-03-03 19:42:22.611501943  [2024-03-03 19:42:22] frigate.detectors.plugins.openvino INFO    : Model Input Shape: [1,300,300,3]
2024-03-03 19:42:22.611608427  [2024-03-03 19:42:22] frigate.detectors.plugins.openvino INFO    : Model Output-0 Shape: [1,1,100,7]
2024-03-03 19:42:22.611712783  [2024-03-03 19:42:22] frigate.detectors.plugins.openvino INFO    : Model has 1 Output Tensors

FFprobe output from your camera

ffprobe version 5.1.4-0+deb12u1 Copyright (c) 2007-2023 the FFmpeg developers
  built with gcc 12 (Debian 12.2.0-14)
  configuration: --prefix=/usr --extra-version=0+deb12u1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libglslang --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librist --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libsvtav1 --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --disable-sndio --enable-libjxl --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-libplacebo --enable-librav1e --enable-shared
  libavutil      57. 28.100 / 57. 28.100
  libavcodec     59. 37.100 / 59. 37.100
  libavformat    59. 27.100 / 59. 27.100
  libavdevice    59.  7.100 / 59.  7.100
  libavfilter     8. 44.100 /  8. 44.100
  libswscale      6.  7.100 /  6.  7.100
  libswresample   4.  7.100 /  4.  7.100
  libpostproc    56.  6.100 / 56.  6.100
Input #0, rtsp, from 'rtsp://admin:G10c0land1a@192.168.178.110/Streaming/channels/201/':
  Metadata:
    title           : Media Presentation
  Duration: N/A, start: 0.040000, bitrate: N/A
  Stream #0:0: Video: h264 (High), yuvj420p(pc, bt709, progressive), 320x240, 25 tbr, 90k tbn

Frigate stats

No response

Operating system

Debian

Install method

Docker Compose

Coral version

CPU (no coral)

Network connection

Wired

Camera make and model

Hikvision

Any other information that may be helpful

No response

[NickM-27]

Your config has motion recordings enabled

[temuccio]

Yes, but not works. I don't see records in thermal camera. Il lun 4 mar 2024, 08:03 Nicolas Mowen ***@***.***> ha scritto:

…

Your config has motion recordings enabled — Reply to this email directly, view it on GitHub <#10224 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAELRPQ35SDDTTIUFPZ4XGTYWQMDVAVCNFSM6AAAAABEEV3E22VHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4DMNRSHAYTM> . You are receiving this because you authored the thread.Message ID: ***@***.*** com>

[NickM-27]

Where are you looking for them

[temuccio]

In events or in recordings button from cameras page. Il lun 4 mar 2024, 08:09 Nicolas Mowen ***@***.***> ha scritto:

…

Where are you looking for them — Reply to this email directly, view it on GitHub <#10224 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAELRPUSCOMLVP34ISRXEB3YWQM4PAVCNFSM6AAAAABEEV3E22VHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4DMNRSHA3TM> . You are receiving this because you authored the thread.Message ID: ***@***.*** com>

[NickM-27]

It will be on the recordings button, you can press on any hour to view the recordings in that hour

[temuccio]

Hi @NickM-27
this pages is empty....there isn't events.

Do I need to increase the sensitivity? If so, how?

[NickM-27]

you won't see events, you click on the dropdown and you can choose any hour and start watching recordings

[temuccio]

Hi @NickM-27
ok I can see the records with play...
It is possible to have an "event" (for example motion events) when I have the motion?
In this mode it is more simply to find an events.

[NickM-27]

No, events are for objects being detected. In the next version of frigate it will be easier to see when motion was detected and how much.

[ehn]

As a side note, I have three thermal cameras at one of my sites, and (my) Frigate+ model can sometimes detect people, cars, deer. It's not perfect, but it's a start.

[temuccio]

Hi @ehn
this is good news... From my perspective, thermal cameras have fewer false alarms. In this case, I am interested in Frigate+.
Is it possible to train the model, for example, with an Nvidia Jetson Nano?

[ehn]

The model isn't trained locally on your machine.

[temuccio]

Ok, it is only possible to send the image for new training? (https://docs.frigate.video/plus/improving_model/)