Skip to content

Commit 7e45992

Browse files
committed
Release AI-ModelZoo-3.1.0:
- Support for STEdgeAI Core v2.1.0 (STM32Cube.AI v10.1.0). - Application code for STM32N6 board is now directly available in the STM32 model zoo repository; eliminating the need for separate downloads. - Support of On device evaluation and On device prediction on the STM32N6570-DK boards integrated in evaluation and prediction services. - More models supported : Yolov11, LSTM model added in the Speech Enhancement, ST Yolo X variants. - ClearML support. - A few bug fixes and improvements like proper imports, OD metrics alignments. Signed-off-by: khaoula boutiche <[email protected]>
1 parent 46924c0 commit 7e45992

File tree

50,296 files changed

+18115285
-31821
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

50,296 files changed

+18115285
-31821
lines changed

README.md

Lines changed: 24 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,18 @@ The performances on reference STM32 MCU and MPU are provided for float and quant
1616
This project is organized by application, for each application you will have a step by step guide that will indicate how to train and deploy the models.
1717

1818
## What's new in releases :
19-
<details open><summary><b>3.0:</b></summary>
19+
<details open><summary><b>3.1:</b></summary>
20+
21+
* Support for `STEdgeAI Core v2.1.0` (STM32Cube.AI v10.1.0).
22+
* Application code for STM32N6 board is now directly available in the STM32 model zoo repository; eliminating the need for separate downloads.
23+
* Support of `On device evaluation` and `On device prediction` on the `STM32N6570-DK` boards integrated in evaluation and prediction services.
24+
* More models supported : Yolov11, LSTM model added in the Speech Enhancement, ST Yolo X variants.
25+
* ClearML support.
26+
* A few bug fixes and improvements like proper imports, OD metrics alignments.
27+
28+
29+
</details>
30+
<details><summary><b>3.0:</b></summary>
2031

2132
* Full support of the new [STM32N6570-DK](https://www.st.com/en/evaluation-tools/stm32n6570-dk) board.
2233
* Included additional models compatible with the `STM32N6`.
@@ -139,7 +150,7 @@ Object detection is used to detect, locate and estimate the occurrences probabil
139150
| [Tiny Yolo v2](https://github.com/STMicroelectronics/stm32ai-modelzoo/blob/master/object_detection/tiny_yolo_v2/README.md) | 224x224x3<br> 416x416x3<br> | Full OD Services | [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html)<br> |
140151
| [ST Yolo X](https://github.com/STMicroelectronics/stm32ai-modelzoo/blob/master/object_detection/st_yolo_x/README.md) | 256x256x3<br> 320x320x3<br> 416x416x3<br> 480x480x3<br> | Full OD Services | [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html)<br> |
141152
| [Yolo v8](https://github.com/stm32-hotspot/ultralytics/tree/main/examples/YOLOv8-STEdgeAI/stedgeai_models/object_detection) <br> Yolo v5u | 192x192x3<br> 256x256x3<br> 320x320x3<br> 416x416x3<br> | Evaluation / Benchmarking / Prediction / Deployment | [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html)<br> |
142-
153+
| Yolo v11 | 192x192x3<br> 256x256x3<br> 320x320x3<br> 416x416x3<br> | Evaluation / Benchmarking / Prediction | [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html)<br> |
143154

144155
[Full OD Services](object_detection/README.md) : training, evaluation, quantization, benchmarking, prediction, deployment
145156

@@ -302,11 +313,15 @@ Speech Enhancement is an algorithm that enhances audio perception in a noisy env
302313
![plot](./speech_enhancement/src/doc/img/output_application_se.JPG)
303314
</div>
304315

305-
<details open><summary><b>Speech Enhancement SE) Models</b></summary>
316+
<details open><summary><b>Speech Enhancement (SE) Models</b></summary>
306317

307318
| Models | Input Resolutions | Supported Services | Targets for deployment |
308319
|--------------------|------------------|-----------------------|-------------------|
309320
| [stft_tcnn](https://github.com/STMicroelectronics/stm32ai-modelzoo/blob/master/speech_enhancement/stft_tcnn/README.md) | 257x40 <br> | Full SE Services | [STM32N6570-DK](https://www.st.com/en/development-tools/stm32n6-ai.html) <br> |
321+
| [convlstm denoiser]() | 257x1 <br> | training, evaluation | None yet <br> |
322+
323+
Note that ConvLSTM denoiser models cannot be deployed yet. See the [Speech Enhancement top README](./speech_enhancement/README.md) for more information.
324+
310325

311326
[Full SE Services](./speech_enhancement/README.md) : training, evaluation, quantization, benchmarking, deployment
312327

@@ -355,8 +370,11 @@ This allows to recognize a set of hand postures using Time of Flight (ToF) senso
355370
|--------------------|------------------|-----------------------|-------------------|
356371
| [ST CNN 2D Hand Posture](https://github.com/STMicroelectronics/stm32ai-modelzoo/blob/master/hand_posture/CNN2D_ST_HandPosture/README.md) | 64x50x1<br> | training / Evaluation / Benchmarking / Deployment | [NUCLEO-F401RE](application_code/hand_posture/STM32F4) with X-NUCLEO-53LxA1 Time-of-Flight Nucleo expansion board<br> |
357372

373+
</details>
374+
358375
Hand Posture Recognition top readme **[here](./hand_posture/README.md)**
359376

377+
360378
## <a id="Hugging Face">Hugging Face host</a>
361379
The Model Zoo Dashboard is hosted in a Docker environment under the [STMicroelectronics Organization](https://huggingface.co/STMicroelectronics). This dashboard is developed using Dash Plotly and Flask, and it operates within a Docker container.
362380
It can also run locally if Docker is installed on your system. The dashboard provides the following features:
@@ -373,9 +391,9 @@ You can also find our models on Hugging Face under the [STMicroelectronics Organ
373391

374392
## Available tutorials and utilities
375393

376-
* [stm32ai_model_zoo_colab.ipynb](tutorials/notebooks/stm32ai_model_zoo_colab.ipynb): a Jupyter notebook that can be
394+
* [stm32ai_model_zoo.ipynb](tutorials/notebooks/stm32ai_model_zoo.ipynb): a Jupyter notebook that can be
377395
easily deployed on Colab to exercise STM32 model zoo training scripts.
378-
* [stm32ai_devcloud.ipynb](tutorials/notebooks/stm32ai_devcloud.ipynb): a Jupyter notebook that shows how to
396+
* [stedgeai_devcloud.ipynb](tutorials/notebooks/stedgeai_devcloud.ipynb): a Jupyter notebook that shows how to
379397
access to the STM32Cube.AI Developer Cloud through [ST Python APIs](common/stm32ai_dc) (based on REST API) instead of
380398
using the web application https://stedgeai-dc.st.com.
381399
* [stm32ai_quantize_onnx_benchmark.ipynb](tutorials/notebooks/stm32ai_quantize_onnx_benchmark.ipynb):
@@ -511,4 +529,4 @@ Depending on which version of Windows OS you are using or where you place the pr
511529
512530
```bash
513531
git config --system core.longpaths true
514-
```
532+
```

__init__.py

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,23 @@
1+
# /*---------------------------------------------------------------------------------------------
2+
# * Copyright (c) 2022 STMicroelectronics.
3+
# * All rights reserved.
4+
# * This software is licensed under terms that can be found in the LICENSE file in
5+
# * the root directory of this software component.
6+
# * If no LICENSE file comes with this software, it is provided AS-IS.
7+
# *--------------------------------------------------------------------------------------------*/
8+
9+
__all__ = [
10+
"audio_event_detection",
11+
"common",
12+
"hand_posture",
13+
"human_activity_recognition",
14+
"image_classification",
15+
"instance_segmentation",
16+
"object_detection",
17+
"pose_estimation",
18+
"semantic_segmentation",
19+
"speech_enhancement",
20+
"tutorials",
21+
"application_code",
22+
]
23+
221 KB
Binary file not shown.
222 KB
Binary file not shown.
233 KB
Binary file not shown.
234 KB
Binary file not shown.
3.42 MB
Binary file not shown.
Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,21 @@
1+
#!\bin\bash
2+
3+
pathCubeIde="<Path_to_cube ide>"
4+
pathProg="<Path_to_cube_programmer_plug_in>/tools/bin"
5+
el=$pathCubeIde$pathProg"/ExternalLoader/MX66UW1G45G_STM32N6570-DK.stldr"
6+
prog=$pathCubeIde$pathProg"/STM32_Programmer_CLI.exe"
7+
8+
bin=$1"_"$2".bin"
9+
fsbl="fsbl_fw_lrun_v1.2.0.bin"
10+
weight=$1"_weights.bin"
11+
12+
echo "please connect the board and switch BOOT1 to Rigth position"
13+
echo "when done, press a key to continue ..."
14+
read -n 1 -s
15+
echo "flashing the application "$bin" with weigth "$weight
16+
17+
$prog -c port=swd mode=HOTPLUG ap=1 --extload $el -w $fsbl 0x70000000
18+
$prog -c port=swd mode=HOTPLUG ap=1 --extload $el -w $bin 0x70100000
19+
$prog -c port=swd mode=HOTPLUG ap=1 --extload $el -w $weight 0x70180000
20+
21+
echo "please power cycle the board after switching BOOT1 to Left position"
59.6 KB
Binary file not shown.
376 KB
Binary file not shown.

0 commit comments

Comments
 (0)