Skip to content

Commit 37cc238

Browse files
committed
Environment setup
1 parent 086d25f commit 37cc238

File tree

11 files changed

+128
-0
lines changed

11 files changed

+128
-0
lines changed
1.83 MB
Loading
1.96 MB
Loading
120 KB
Loading
492 KB
Loading
232 KB
Loading
626 KB
Loading
377 KB
Loading
388 KB
Loading
Lines changed: 128 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,128 @@
1+
---
2+
title: 'Portenta Vision Shield User Manual'
3+
difficulty: beginner
4+
compatible-products: [portenta-vision-shield]
5+
description: 'Learn about the hardware and software features of the Arduino® Portenta Vision Shield.'
6+
tags:
7+
- Camera
8+
- Sensors
9+
- Machine Learning
10+
author: 'Christopher Mendez'
11+
hardware:
12+
- hardware/04.pro/shields/portenta-vision-shield
13+
software:
14+
- ide-v1
15+
- ide-v2
16+
- web-editor
17+
- iot-cloud
18+
---
19+
20+
## Overview
21+
22+
This user manual will guide you through a practical journey covering the most interesting features of the Arduino Portenta Vision Shield. With this user manual, you will learn how to set up, configure and use this Arduino board.
23+
24+
## Hardware and Software Requirements
25+
### Hardware Requirements
26+
27+
- [Portenta Vision Shield Ethernet](https://store.arduino.cc/collections/shields-carriers/products/arduino-portenta-vision-shield-ethernet) (x1) or [Portenta Vision Shield LoRa®](https://store.arduino.cc/collections/shields-carriers/products/arduino-portenta-vision-shield-lora%C2%AE)
28+
- [Portenta H7](https://store.arduino.cc/products/portenta-h7) (x1) or [Portenta C33](https://store.arduino.cc/products/portenta-c33) (x1)
29+
- [USB-C® cable cable](https://store.arduino.cc/products/usb-cable2in1-type-c) (x1)
30+
31+
### Software Requirements
32+
33+
- [OpenMV IDE](https://openmv.io/pages/download)
34+
- [Arduino IDE 1.8.10+](https://www.arduino.cc/en/software), [Arduino IDE 2.0+](https://www.arduino.cc/en/software), or [Arduino Web Editor](https://create.arduino.cc/editor)
35+
- To create custom Machine Learning models, the Machine Learning Tools add-on integrated into the [Arduino Cloud](https://create.arduino.cc/iot/) is needed. In case you do not have an Arduino Cloud account, you will need to create one first.
36+
37+
## Product Overview
38+
39+
The Arduino Portenta Vision Shield is an add-on board providing machine vision capabilities and additional connectivity to the Portenta family of Arduino boards, designed to meet the needs of industrial automation. The Portenta Vision Shield connects via a high-density connector to the Portenta boards with minimal hardware and software setup.
40+
41+
The included HM-01B0 camera module has been pre-configured to work with the OpenMV libraries provided by Arduino. Based on the specific application requirements, the Portenta Vision Shield is available in two configurations with either Ethernet or LoRa® connectivity.
42+
43+
### Board Architecture Overview
44+
45+
The Portenta Vision Shield LoRa® brings industry-rated features to your Portenta. This hardware add-on will let you run embedded computer vision applications, connect wirelessly via LoRa® to the Arduino Cloud or your own infrastructure, and activate your system upon the detection of sound events.
46+
47+
![Vision Shield main components (top view)](assets/arch-top.png)
48+
![Vision Shield main components (bottom view)](assets/arch-bottom.png)
49+
50+
Here is an overview of the board's main components, as shown in the images above:
51+
52+
- **Power Regulator**: the Portenta H7/C33 supplies 3.3 V power to the LoRa® module (ASX00026 only), Ethernet communication (ASX00021 only), Micro SD slot and dual microphones via the 3.3 V output of the high-density connectors. An onboard LDO regulator supplies a 2.8 V output (300 mA) for the camera module.
53+
54+
- **Camera**: the Himax HM-01B0 Module is a very low-power camera with 320x320 resolution and a maximum of 60 FPS depending on the operating mode. Video data is transferred over a configurable 8-bit interconnect with support for frame and line synchronization. The module delivered with the Portenta Vision Shield is the monochrome version. Configuration is achieved via an I2C connection with the compatible Portenta boards microcontrollers.
55+
56+
HM-01B0 offers very low-power image acquisition and provides the possibility to perform motion detection without main processor interaction. The“Always-on” operation provides the ability to turn on the main processor when movement is detected with minimal power consumption.
57+
58+
***The Portenta C33 is not compatible with the camera of the Portenta Vision Shield***.
59+
60+
- **Digital Microphones**: the dual MP34DT05 digital MEMS microphones are omnidirectional and operate via a capacitive sensing element
61+
with a high (64 dB) signal-to-noise ratio. The microphones have been configured to provide separate left and right audio over a single PDM stream.
62+
63+
The sensing element, capable of detecting acoustic waves, is manufactured using a specialized silicon micromachining process dedicated to produce audio sensors.
64+
65+
- **Micro SD Card Slot**: a Micro SD card slot is available under the Portenta Vision Shield board. Available libraries allow reading and
66+
writing to FAT16/32 formatted cards
67+
68+
- **Ethernet (ASX00021 Only)**: ethernet connector allows connecting to 10/100 Base TX networks using the Ethernet PHY available on the Portenta
69+
board.
70+
71+
- **LoRa® Module (ASX00026 Only)**: LoRa® connectivity is provided by the Murata CMWX1ZZABZ module. This module contains an STM32L0 processor
72+
along with a Semtech SX1276 Radio. The processor is running on Arduino open-source firmware based on Semtech code.
73+
74+
### Shield Environment Setup
75+
76+
Connect the Vision Shield with a Portenta H7 through their High-Density connectors and verify they are correctly aligned.
77+
78+
<div style="text-align: center;">
79+
<video width="100%" controls="true">
80+
<source src="assets/h7_vision-shield.mp4" type="video/mp4"/>
81+
</video>
82+
</div>
83+
84+
#### With OpenMV IDE
85+
86+
Before you can start programming MicroPython scripts for the Vision Shield, you need to download and install the OpenMV IDE.
87+
88+
Open the [OpenMV](https://openmv.io/pages/download) download page in your browser, download the latest version available for your operating system, and follow the instructions of the installer.
89+
90+
![OpenMV Download Page](assets/openmv-down.png)
91+
92+
Open the **OpenMV IDE** and connect the Portenta H7 to your computer via the USB cable if you have not done so yet.
93+
94+
![The OpenMV IDE after starting it](assets/first-open.png)
95+
96+
Click on the "connect" symbol at the bottom of the left toolbar.
97+
98+
![Click the connect button to attach the Portenta H7 to the OpenMV IDE](assets/click-connect.png)
99+
100+
If your Portenta H7 does not have the latest firmware, a pop-up will ask you to install it. Your board will enter in DFU mode and its green LED will start fading.
101+
102+
Select `Install the latest release firmware`. This will install the latest OpenMV firmware on the H7. You can leave the option of erasing the internal file system unselected and click `OK`.
103+
104+
![Install the latest version of the OpenMV firmware](assets/first-connect.png)
105+
106+
Portenta H7's green LED will start flashing while the OpenMV firmware is being uploaded to the board. A loading bar will start showing you the flashing progress.
107+
108+
Wait until the green LED stops flashing and fading. You will see a message saying `DFU firmware update complete!` when the process is done.
109+
110+
![Installing firmware on H7 board in OpenMV](assets/flashing.png)
111+
112+
The board will start flashing its blue LED when it is ready to be connected. After confirming the completion dialog, the Portenta H7 should already be connected to the OpenMV IDE, otherwise, click the "connect" button (plug symbol) once again (the blue blinking should stop).
113+
114+
![When the H7 is successfully connected a green play button appears](assets/ready-connected.png)
115+
116+
While using the Portenta H7 with OpenMV, the RGB LED of the board can be used to inform the user about its current status. Some of the most important ones are the following:
117+
118+
🟢 **Blinking Green:** Your Portenta H7 onboard bootloader is running. The onboard bootloader runs for a few seconds when your H7 is powered via USB to allow OpenMV IDE to reprogram your Portenta.
119+
120+
🔵 **Blinking Blue:** Your Portenta H7 is running the default __main.py__ script onboard.
121+
122+
If you overwrite the __main.py__ script on your Portenta H7, then it will run whatever code you loaded on it instead.
123+
124+
***If the LED is blinking blue but OpenMV IDE cannot connect to your Portenta H7, please make sure you are connecting your Portenta H7 to your PC with a USB cable that supplies both data and power.***
125+
126+
**Blinking White:** Your Portenta H7 firmware is panicking because of a hardware failure. Please check that your Vision Shield's camera module is installed securely.
127+
128+
***If you tap the Portenta H7 reset button once, the board resets. If you tap it twice, the board enters Device Firmware Upgrade (DFU) mode and its green LED starts blinking and fading.***

0 commit comments

Comments
 (0)