You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/content.md
+205-3Lines changed: 205 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -60,7 +60,7 @@ Here is an overview of the board's main components, as shown in the images above
60
60
-**Digital Microphones**: the dual MP34DT05 digital MEMS microphones are omnidirectional and operate via a capacitive sensing element
61
61
with a high (64 dB) signal-to-noise ratio. The microphones have been configured to provide separate left and right audio over a single PDM stream.
62
62
63
-
The sensing element, capable of detecting acoustic waves, is manufactured using a specialized silicon micromachining process dedicated to produce audio sensors.
63
+
The sensing element, capable of detecting acoustic waves, is manufactured using a specialized silicon micromachining process dedicated to produce audio sensors.
64
64
65
65
-**Micro SD Card Slot**: a Micro SD card slot is available under the Portenta Vision Shield board. Available libraries allow reading and
66
66
writing to FAT16/32 formatted cards
@@ -288,6 +288,7 @@ led.off()
288
288
289
289
raise (Exception("Please reset the camera to see the new file."))
290
290
```
291
+
We recommend you use [VLC](https://www.videolan.org/vlc/) to play the video.
291
292
292
293

293
294
@@ -542,8 +543,209 @@ When a person is in the field of view of the camera, you should see the inferenc
542
543
543
544
### Microphone
544
545
545
-
The Portenta Vision Shield features two microphones, based on the MP34DT05 ultra-compact, low-power, omnidirectional, digital MEMS microphone.
546
+
The Portenta Vision Shield features two omnidirectional microphones, based on the MP34DT05 ultra-compact, low-power, and digital MEMS microphone.
You can analyze frequencies present in sounds alongside their harmonic features using this example.
559
+
560
+
By measuring the sound level on each microphone we can easily know from where the sound is coming, an interesting capability for robotics and AIoT applications.
With this script running you will be able to see the Fast Fourier Transform result in the image viewport. Also, the sound level on each microphone channel.
636
+
637
+

638
+
639
+
#### Speech Recognition Example
640
+
641
+
You can easily implement sound/voice recognition applications using Machine Learning on the edge, this means that the Portenta H7 plus the Vision Shield can run these algorithms locally.
642
+
643
+
For this example, we are going to test a [pre-trained model]((https://raw.githubusercontent.com/iabdalkader/microspeech-yesno-model/main/model.tflite)) that can recognize the `yes` and `no` keywords
644
+
645
+
First, download the `.tflite`[model](https://raw.githubusercontent.com/iabdalkader/microspeech-yesno-model/main/model.tflite) and copy it to the H7 local storage.
646
+
647
+
Use the following script to run the example. It can also be found on **File > Examples > Audio > micro_speech.py** in the OpenMV IDE.
First, connect the Vision Shield - Ethernet to the Portenta H7. Now connect the USB-C® cable to the Portenta H7 and your computer. Lastly, connect the Ethernet cable to the Portenta Vision Shield's Ethernet port and your router or modem.
693
+
694
+
Now you are ready to test the connectivity with the following Python script. This example lets you know if an Ethernet cable is connected successfully to the shield.
0 commit comments