Skip to content

Commit 7f3764d

Browse files
committed
Release AI-ModelZoo-4.0.0:
- Major PyTorch support for Image Classification (IC) and Object Detection (OD) - Support of STEdgeAI Core v3.0.0 - New training and evaluation scripts for PyTorch models - Expanded model selection and improved documentation - Unified workflow for TensorFlow and PyTorch - Performance and usability improvements - New use cases: Face Detection (FD), Arc Fault Detection (AFD), Re-Identification (ReID) - New mixed precision models (Weights 4-bits, Activations 8-bits) for IC and OD use cases - Support for Keras 3.8.0, TensorFlow 2.18.0, PyTorch 2.7.1, and ONNX 1.16.1 - Python software architecture rework - Docker-based setup available, with a ready-to-use image including the full software stack Signed-off-by: khaoula boutiche <[email protected]>
1 parent ea27f2e commit 7f3764d

File tree

1,474 files changed

+37730
-22876
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

1,474 files changed

+37730
-22876
lines changed

.gitattributes

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
.onnx filter=lfs diff=lfs merge=lfs -text
2+
.tflite filter=lfs diff=lfs merge=lfs -text
3+
*.keras filter=lfs diff=lfs merge=lfs -text
4+
*.onnx filter=lfs diff=lfs merge=lfs -text
5+
*.tflite filter=lfs diff=lfs merge=lfs -text

LICENSE.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,4 +10,8 @@ Software BOM for each use case:
1010
* [speech_enhancement](./speech_enhancement/LICENSE.md)
1111
* [hand_posture](./hand_posture/LICENSE.md)
1212
* [human_activity_recognition](./human_activity_recognition/LICENSE.md)
13-
13+
* [arc_fault_detection](./arc_fault_detection/LICENSE.md)
14+
* [depth_estimation](./depth_estimation/LICENSE.md)
15+
* [neural_style_transfer](./neural_style_transfer/LICENSE.md)
16+
* [re_identification](./re_identification/LICENSE.md)
17+
* [face_detection](./face_detection/LICENSE.md)

README.md

Lines changed: 28 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -2,32 +2,47 @@
22

33
Welcome to STM32 model zoo!
44

5+
6+
**🎉 We are excited to announce that the STM32 AI model zoo now includes comprehensive PyTorch support, joining TensorFlow and ONNX.
7+
It now features a vast library of PyTorch models, all seamlessly integrated with our end-to-end workflows. Whether you want to train, evaluate, quantize, benchmark, or deploy, you’ll find everything you need – plus the flexibility to choose between PyTorch, TensorFlow, and ONNX. Dive into the expanded <a href="https://github.com/STMicroelectronics/stm32ai-modelzoo/">STM32 model zoo</a> and take your AI projects further than ever on STM32 devices.**
8+
9+
---
10+
511
The STM32 AI model zoo is a collection of reference machine learning models that are optimized to run on STM32
612
microcontrollers.
713
Available on GitHub, this is a valuable resource for anyone looking to add AI capabilities to their STM32-based
814
projects.
915

1016
- A large collection of application-oriented models ready for re-training
11-
- Pre-trained models on reference datasets
17+
- Pre-trained models on reference datasets, available across several frameworks.
1218

1319
**Scripts to easily retrain, quantize, evaluate or benchmark any model from user datasets as well as application code examples automatically generated from user AI model can be found in the [stm32ai-modelzoo-services GitHub](https://github.com/STMicroelectronics/stm32ai-modelzoo-services)**
1420

1521

1622
These models can be useful for quick deployment if you are interested in the categories that they were trained. We also provide training scripts to do transfer learning or to train your own model from scratch on your custom dataset.
1723

18-
The performances on reference STM32 MCU, NPU and MPU are provided for float and quantized models.
24+
Performance metrics on reference STM32 MCU, NPU, and MPU are provided for both float and quantized models.
1925

2026

2127

2228
## What's new in releases :
29+
2330
<details open><summary><b>4.0:</b></summary>
2431

25-
### 📢 4.0 Release is coming soon! Scheduled for January 22, 2026.
26-
- This release will introduce new features and important changes.
32+
* Major PyTorch support for Image Classification (IC) and Object Detection (OD)
33+
* Support of **STEdgeAI Core v3.0.0**
34+
* New training and evaluation scripts for PyTorch models
35+
* Expanded model selection and improved documentation
36+
* Unified workflow for TensorFlow and PyTorch
37+
* Performance and usability improvements
38+
* New use cases: **Face Detection (FD)**, **Arc Fault Detection (AFD)**, **Re-Identification (ReID)**
39+
* New mixed precision models (Weights 4-bits, Activations 8-bits) for IC and OD use cases
40+
* Support for Keras 3.8.0, TensorFlow 2.18.0, PyTorch 2.7.1, and ONNX 1.16.1
41+
* Python software architecture rework
42+
* Docker-based setup available, with a ready-to-use image including the full software stack.
2743

28-
2944
</details>
30-
<details open><summary><b>3.2:</b></summary>
45+
<details><summary><b>3.2:</b></summary>
3146

3247
* Support for **STEdgeAI Core v2.2.0** (STM32Cube.AI v10.2.0).
3348
* Support of **X-Linux-AI v6.1.0** support for MPU.
@@ -39,7 +54,7 @@ The performances on reference STM32 MCU, NPU and MPU are provided for float and
3954
</details>
4055
<details><summary><b>3.1:</b></summary>
4156

42-
* Included additional models support (yolo_v11, st_yolo_x variants)
57+
* Included additional models support (yolov11n, st_yoloxn variants)
4358
</details>
4459
<details><summary><b>3.0:</b></summary>
4560

@@ -65,15 +80,18 @@ The performances on reference STM32 MCU, NPU and MPU are provided for float and
6580
|--------------------|------------------|-----------------|------------ |
6681
| [Image Classification](./image_classification/README.md) | Classifies the content of an image within a predefined set of classes. | [STM32H747I-DISCO](https://github.com/STMicroelectronics/stm32ai-modelzoo-services/blob/main/application_code/image_classification/STM32H7/README.md) <br> [NUCLEO-H743ZI2](https://github.com/STMicroelectronics/stm32ai-modelzoo-services/blob/main/application_code/image_classification/STM32H7/README.md) <br> [STM32MP257F-EV1](https://github.com/STMicroelectronics/stm32ai-modelzoo-services/blob/main/application_code/image_classification/STM32MP-LINUX/STM32MP2/README.md) <br> [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html) <br> | <div align="center" style="width:480px; margin: left;">![plot](./doc/img/output_application_ic.JPG) |
6782
| [Object Detection](./object_detection/README.md) | Detects, locates and estimates the occurences probability of predefined objects from input images. | [STM32H747I-DISCO](https://github.com/STMicroelectronics/stm32ai-modelzoo-services/blob/main/application_code/object_detection/STM32H7/README.md) <br> [STM32MP257F-EV1](https://github.com/STMicroelectronics/stm32ai-modelzoo-services/blob/main/application_code/object_detection/STM32MP-LINUX/STM32MP2/README.md) <br> [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html) <br> | <div align="center" style="width:480px; margin: left;">![plot](./doc/img/output_application_od.JPG) |
83+
| [Face Detection](./face_detection/README.md) | Detects, locates and estimates the occurences probability of predefined faces and keypoints from input images. | [STM32H747I-DISCO](https://github.com/STMicroelectronics/stm32ai-modelzoo-services/blob/main/application_code/face_detection/STM32H7/README.md) <br> [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html) <br> | <div align="center" style="width:480px; margin: left;">![plot](./doc/img/output_application_FD.png) |
6884
| [Pose Estimation](./pose_estimation/README.md) | Detects key points on some specific objects (people, hand, face, ...). | [STM32MP257F-EV1](https://github.com/STMicroelectronics/stm32ai-modelzoo-services/blob/main/application_code/pose_estimation/STM32MP-LINUX/STM32MP2/README.md) <br> [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html) <br> | <div align="center" style="width:480px; margin: left;">![plot](./doc/img/output_application_pe.JPG) |
6985
| [Semantic Segmentation](./semantic_segmentation/README.md) | Associates a label to every pixel in an image to recognize a collection of pixels that form distinct categories. | [STM32MP257F-EV1](https://github.com/STMicroelectronics/stm32ai-modelzoo-services/blob/main/application_code/STM32MP-LINUX/STM32MP2/README.md) <br> [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html) <br> | <div align="center" style="width:480px; margin: left;">![plot](./doc/img/output_application_semseg.JPG) |
7086
| [Instance Segmentation](./instance_segmentation/README.md) | Associates a label to every pixel in an image to recognize a collection of pixels that form distinct categories or instances of each category. | [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html) <br> | <div align="center" style="width:480px; margin: left;">![plot](./doc/img/output_application_instseg.JPG) |
7187
| [Depth Estimation](./depth_estimation/README.md) | Predict the distance to objects from an image as a pixel-wise depth map. | [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html) <br> | <div align="center" style="width:480px; margin: left;">![plot](./doc/img/output_application_de.JPG) |
7288
| [Neural Style Transfer](./neural_style_transfer/README.md) | applies the artistic style of one image to the content of another image. | [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html) <br> | <div align="center" style="width:480px; margin: left;">![plot](./doc/img/output_application_nst.JPG) |
73-
| [Audio Event Detection](./audio_event_detection/README.md) | Detection of a specific audio events. | [B-U585I-IOT02A ThreadX](https://github.com/STMicroelectronics/stm32ai-modelzoo-services/blob/main/application_code/sensing_thread_x/STM32U5/README.md) <br> [B-U585I-IOT02A FreeRTOS](https://github.com/STMicroelectronics/stm32ai-modelzoo-services/blob/main/application_code/sensing_free_rtos/STM32U5/README.md) <br> [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html) <br> | <div align="center" style="width:480px; margin: left;">![plot](./doc/img/output_application_aed.JPG) |
89+
| [Audio Event Detection](./audio_event_detection/README.md) | Detection of a specific audio events. | [B-U585I-IOT02A ](https://github.com/STMicroelectronics/stm32ai-modelzoo-services/blob/main/application_code/sensing/STM32U5/README.md) <br> [B-U585I-IOT02A](https://github.com/STMicroelectronics/stm32ai-modelzoo-services/blob/main/application_code/sensing/STM32U5/README.md) <br> [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html) <br> | <div align="center" style="width:480px; margin: left;">![plot](./doc/img/output_application_aed.JPG) |
7490
| [Speech Enhancement](./speech_enhancement/README.md) | Enhancement of the audio perception in a noisy environment. | [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html) <br> | <div align="center" style="width:480px; margin: left;">![plot](./doc/img/output_application_se.JPG) |
75-
| [Human Activity Recognition](./human_activity_recognition/README.md) | Recognizes various activities like walking, running, ... | [B-U585I-IOT02A](https://github.com/STMicroelectronics/stm32ai-modelzoo-services/blob/main/application_code/sensing_thread_x/STM32U5/README.md) <br> | <div align="center" style="width:480px; margin: left;">![plot](./doc/img/output_application_har.JPG) |
91+
| [Human Activity Recognition](./human_activity_recognition/README.md) | Recognizes various activities like walking, running, ... | [B-U585I-IOT02A](https://github.com/STMicroelectronics/stm32ai-modelzoo-services/blob/main/application_code/sensing/STM32U5/README.md) <br> | <div align="center" style="width:480px; margin: left;">![plot](./doc/img/output_application_har.JPG) |
7692
| [Hand Posture Recognition](./hand_posture/README.md) | Recognizes a set of hand postures using Time of Flight (ToF) sensor | [NUCLEO-F401RE](https://github.com/STMicroelectronics/stm32ai-modelzoo-services/blob/main/application_code/hand_posture/STM32F4/README.md) <br> | <div align="center" style="width:480px; margin: left;">![plot](./doc/img/output_application_hpr.JPG) |
93+
| [Arc Fault Detection](./arc_fault_detection/README.md) | Detects electrical arc faults from current signals. | [B-U585I-IOT02A](https://github.com/STMicroelectronics/stm32ai-modelzoo-services/blob/main/application_code/sensing/STM32U5/README.md) <br> | <div align="center" style="width:480px; margin: left;">![plot](./doc/img/output_application_afd.JPG) |
94+
| [Re-Identification](./re_identification/README.md) | Reidentifies a person or object across different images or video frames. | [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html) <br> | <div align="center" style="width:480px; margin: left;">![plot](./doc/img/output_application_reid.JPG)
7795
</div>
7896

7997

@@ -113,6 +131,7 @@ You should see the message `Git LFS initialized.` if the command runs successful
113131
**NOTE:** If you do not see the message `Git LFS initialized.`, visit the [GitHub documentation page](https://docs.github.com/en/repositories/working-with-files/managing-large-files/installing-git-large-file-storage) for more details and support.
114132

115133
### Clone the Repository
134+
In order to use the config files examples from the modelzoo-services, without the need to change the model_path, it is needed to clone the modelzoo below in the same folder as the modelzoo services.
116135

117136
```sh
118137
git clone https://github.com/STMicroelectronics/stm32ai-modelzoo.git

arc_fault_detection/LICENSE.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
# LICENSE.md
2+
3+
| Component | License | Copyright |
4+
|:--------- |:------- |:----------|
5+
| st_conv/ST_pretrainedmodel_custom_dataset | [SLA0044](./st_conv/ST_pretrainedmodel_custom_dataset/LICENSE.md) | STMicroelectronics |
6+
| st_dense/ST_pretrainedmodel_custom_dataset | [SLA0044](./st_dense/ST_pretrainedmodel_custom_dataset/LICENSE.md) | STMicroelectronics |
7+

arc_fault_detection/README.md

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
# Arc fault detection (AFD) STM32 model zoo
2+
3+
Models are stored depending on the way they have been trained :
4+
* `ST_pretrainedmodel_public_dataset` folder contains models trained by ST using public datasets
5+
* `ST_pretrainedmodel_custom_dataset` folder contains models trained by ST using custom datasets
6+
* `Public_pretrainedmodel_public_dataset` folder contains public models using public datasets
7+
8+
## List of available models families :
9+
* [st_dense](./st_dense/README.md)
10+
* [st_conv](./st_conv/README.md)

0 commit comments

Comments
 (0)