0.17.0 Release Candidate 3 #22074
Replies: 15 comments 42 replies
-
|
Does anyone use renovate for frigate updates and have a working config that includes beta and rc releases? I've tried so many things but can't seem to dial it in. |
Beta Was this translation helpful? Give feedback.
-
|
I have to say I am impressed with the improvements in RC3. After I was kicked off here I've forked Frigate to update all supporting structures so it will work with my new Blackwell GPU (SM 121, RTX 50xx), that is:
Each compile takes ~2.5 hours, so it is a long time between iterations, and I need 200GB of disk. (It's a VM) No love yet. I think I'll call it Cormorant. |
Beta Was this translation helpful? Give feedback.
-
|
I would like to suggest a modification to the documentation regarding hardware acceleration. I use a mini PC with an i3 1220p. A 12th generation processor and GPU. The documentation indicates a preset selection decision based on the CPU generation, however, in some cases, like mine, which uses XE architecture, the correct choice is QSY. According to the documentation, I was using VAAPI and was getting many ffmpeg errors and searching for answers in the wrong causes. The suggestion is to guide users to research the GPU architecture and not just look at the version. I believe the biggest problem lies in this intersection between 12th and 13th generation versions. |
Beta Was this translation helpful? Give feedback.
-
|
Anything after Beta 2, I get these errors on startup and facial recognition doesn't work. |
Beta Was this translation helpful? Give feedback.
-
|
Hey all, quick question concerning the Classification Models, when i create a New Classification for:
When I then try select the car it won't show in the list of potential pictures. Is there a way to "Upload" a picture so the system knows what I want. Or is that possible to select from the records which picture or in this case car I need. Maybe it would be possible to select it from "Tracked Object Details" Or did I miss something ? |
Beta Was this translation helpful? Give feedback.
-
|
Hello, Issues :
Suggestions :
|
Beta Was this translation helpful? Give feedback.
-
|
Lovely RC. Some feedback; I wish there was an option to multi-select snapshots for training. Currently you have to click every individual image and select the corresponding result for training. Selecting multiple and then assigning the correct object once would be a lot quicker. Also, when editing a classifiction state, you can't add another camera and/or change the area for monitoring (in case a camera FOV gets changed slightly because of cleaning it or something. Thank you! |
Beta Was this translation helpful? Give feedback.
-
any reason ??
|
Beta Was this translation helpful? Give feedback.
-
|
I am not sure if it is just coincidence or not, but after updating from RC1 to RC3, my person detection isn't really happening at all. It is missing heaps of people for my street cameras. I am currently using GTX 1070 after generating the yolov9 model in the instructions. This is how it is in the config I have object filters set to this on two cameras. Camera 1 Camera 2 I guess a good question would also be, is this the best model to use for that card? |
Beta Was this translation helpful? Give feedback.
-
|
ALERTS sometime not showing. This is happening since long time not only in 0.17 where to see what is the issue does it come in log?? |
Beta Was this translation helpful? Give feedback.
-
|
How far are we from the 0.17 release on :latest? I am itching to upgrade to 0.17, but not sure if I should jump into 0.17 RC3. |
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
-
|
I want to configure a state classification for a garage door. It is a flip open garage door. The states are open and closed. How do I handle the inbetween states when it is the process of opening or closing. Should I train it on images where the garage door is partially open? If I define a cutover point in the opening or closing process, the appearance of the door will be very similar at that cutover point for both states. |
Beta Was this translation helpful? Give feedback.
-
|
Hey all, Small question in the "explore" part. When you review a clip there used to be a button to switch to Full screen. This button is no longer present. In order to see it in full screen, the ... dots needs to be clicked and then select "View in History". Would it be an idea to bring the full screen button back in 0.18 as for 0.17 I understood no new function will be implemented. |
Beta Was this translation helpful? Give feedback.
-
|
Is it still possible to submit a detected face for classification from the explore screen? I seem to recall there being a button for this previously but there no longer seems to be |
Beta Was this translation helpful? Give feedback.






Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Beta docs: https://9eaa7bfe.frigate.pages.dev/
Images
Changes since RC2
Full changelog
Major Changes for 0.17.0
Breaking Changes
There are several breaking changes in this release, Frigate will attempt to update the configuration automatically. In some cases manual changes may be required. It is always recommended to back up your current config and database before upgrading:
frigate.dbfilegenaiconfig now only configures the provider. Other fields have moved underobjects -> genai. See the new GenAI documentation.record -> continuousandrecord -> motionare separate config fields. See the examples in the documentation.smallmodel, which performs well on both CPU and GPU. Thelargemodel is the same as 0.16's and is not as accurate as the upgradedsmallmodel in 0.17. Uselargeonly if you live in a region with multi-line plates and you are having issues detecting text on them with thesmallmodel.detectresolutionwidthandheightfor cameras in your config if Frigate hangs on startup.exec,expr, andechosources for go2rtc are now removed by default to reduce the security risk if an attacker has access to the configuration. This can be disabled using an environment variableGO2RTC_ALLOW_ARBITRARY_EXECA separate configuration for this for HA addon users will come in a later beta. See the documentation.New Features
Frigate 0.17 introduces several major new features.
Classification Model Training
Frigate 0.17 supports classification models in two separate types: state classification and object classification. These models are trained locally on your machine using
ImageNetviaMobileNetV2.State Classification
State classification allows you to choose a certain region of camera(s) with multiple states, and train on images showing these states. For example, you could create a state classification model to determine if a gate is currently open or closed.
See the documentation.
Object Classification
Object classification allows you to choose an object type, like
dog, and classify specific dogs. For example, you can train the model to classify your dogFidoand add a sub label, while not labeling unknown dogs. Another example would be classifying if a person in a construction site is wearing a helmet or not.See the documentation.
Custom Viewer Roles
Frigate 0.17 now has the ability to create additional viewer user roles to limit access to specific cameras. Users with the
adminrole can create a uniquely named role from the UI (orauth --> rolesin the config) and assign at least one camera to it. Users assigned to the new role will have:viewerrole has access to (Live, Review/History, Explore, Exports), but only to the assigned camerasSee the documentation.
Review Item Summary with GenAI
Frigate 0.17 supports using GenAI to summarize review items. Unlike object descriptions which add a searchable description, review summaries have a structured output that instruct the AI provider to generate a title, description, and classify the activity as dangerous, suspicious, or normal.
This information is displayed in the UI automatically making it easier to see when activity requires further review and easier to understand what is happening during a particular video segment.
See the documentation.
Semantic Search Triggers
Triggers utilize Semantic Search to automate actions when a tracked object matches a specified image or description. Triggers can be configured so that Frigate executes a specific actions when a tracked object's image or description matches a predefined image or text, based on a similarity threshold. Triggers are managed per camera and can be configured via the Frigate UI in the Settings page under the Triggers tab.
See the documentation.
Object Detector Improvements
Frigate 0.17 brings performance increases for many detectors as well as support for new object detection hardware.
Nvidia GPU Performance
Support for Nvidia GPUs has been enhanced by implementing CUDA Graphs. CUDA Graphs work to reduce the involvement of the CPU for each inference, leading to faster inference times and lower CPU usage. CUDA graphs do have some limitations based on the complexity of the model, which means that YOLO-NAS, Semantic Search, and LPR models are not accelerated with CUDA Graphs. They will still continue to run on GPU as they did before.
Intel OpenVINO
Frigate 0.17 supports running models on Intel NPUs, for many models performance on NPU is similar to GPU but more efficient, leaving room to run more enrichment features on the GPU.
OpenVINO has also had many optimizations put in place to reduce memory and CPU utilization for object detection.
RKNN
Frigate 0.17 brings several improvements to RKNN platform including:
largemodel sizes.Apple Silicon
Frigate 0.17 supports running object detection on Apple Silicon NPU. This is provided through the Apple Silicon Detector which runs on the host and connects via IPC proxy to Frigate, providing fast and efficient inferences when run within the same Apple device.
See the documentation.
YOLOv9 on Google Coral
Frigate 0.17 supports running a quantized version of
YOLOv9on Coral devices, bringing improved accuracy over the defaultmobiledetmodel. Note that due to hardware limitations, only a subset of the objects on the standard COCO labelmap is included. YOLOv9 Frigate+ models are not supported on Coral at this time.See the documentation.
New Community Supported Detectors
Frigate 0.17 has community support for several new object detectors:
Frontend Improvements
In addition to supporting the new features, the frontend has many improvements.
Detail Stream
History view in 0.17 supports an additional view mode, Detail. This mode shows a card for each review item, and expanding a card reveals all tracked objects and their lifecycle events. Selecting any lifecycle event seeks the video to that exact timestamp. You can also overlay a tracked object's path on the video to help with debugging.
Redesigned Tracked Object Details pane
The Tracked Object Details pane in Explore has been redesigned to streamline the layout and consolidate related information. The Object Lifecycle tab is now the Tracking Details tab, which displays video overlays of the tracked object instead of static images, giving a clearer and more intuitive view of its activity.
Revamped Settings
Frigate 0.17 has a revamped Settings menu with a sidebar that categorizes the available options. This brings more scalability which will make it easier to support full UI configuration in a future version.
NOTE: The Debug view has been moved to the single camera Live view instead of Settings. Access the Debug view by enabling the switch under the Live view settings (cog icon) menu.
Add Camera Wizard
Frigate 0.17 supports adding camera via the UI without manually modifying your configuration file. When installing and starting Frigate for the first time, the main dashboard will include a button to start adding cameras via the Wizard.
Access the Wizard from the
Cameras --> Managementpage in Settings.Update Without Restarting
Frigate 0.17 supports saving many more features dynamically. Cameras, zones, and masks will not require a restart to take effect when saved through the UI. More will come in future versions.
Configuration Safe Mode
If an invalid configuration is detected, Frigate will enter safe mode and highlight the location of the issue. While in safe mode, the frontend is limited to the configuration editor, making it easy to correct the problem directly in the UI without needing an external file editor.
Other Notable Frontend Improvements
Other Backend Features and Improvements
Audio Transcription and Analysis
Frigate 0.17 supports fully local audio transcription using either
sherpa-onnxorfaster-whisper. The single camera Live view in the Frigate UI supports live transcription of audio for streams defined with the audio role, and anyspeechevents in Explore can be transcribed and/or translated through the Transcribe button in the Tracked Object Details pane.See the documentation.
Process and Efficiency Improvements
Frigate 0.17 uses the forkserver spawn method, this allows for better segmented memory control and better process management. Some processes are also started with lower priority, allowing the most important processes to have more CPU time when it is required.
Review Item Improvements
Review items have been refined to behave more intuitively:
Revamped stationary object tracking. Stationary object tracking has been enhanced to use new features to reduce incorrectly marking objects as active:
Smarter handling of loitering objects. Stationary behavior is now dynamic based on object type. Objects that are normally stationary for long periods (e.g., cars) will no longer keep a review item active indefinitely when stopped inside a loitering zone. Objects that are not expected to remain still (e.g., people) will continue the review item as long as they stay within the zone.
Severity-based review item cutoff. Review items now end when a higher-severity event (such as an
alertfor arriving home) finishes. Ongoing lower-severity motion (e.g., passing cars) will no longer keep the higher-severity review item alive. In these cases, thealertends and a newdetectionreview item begins immediately.Enrichment Improvements
-,, etc. to ensure that plates are more consistently recognized as the same plate. Documentationdeviceconfig option. This is useful in cases when multiple GPUs are available. DocumentationOther Improvements
networking -> ipv6 -> enabled. DocumentationThis discussion was created from the release 0.17.0 Release Candidate 3.
Beta Was this translation helpful? Give feedback.
All reactions