diff --git a/.github/workflows/workflow-validate.yaml b/.github/workflows/workflow-validate.yaml index e3eb45f42a..1057becf1d 100644 --- a/.github/workflows/workflow-validate.yaml +++ b/.github/workflows/workflow-validate.yaml @@ -17,7 +17,7 @@ jobs: - uses: actions/checkout@v4 - name: Run spell check run: | - pip install codespell + pip install codespell==2.3.0 codespell -I "scripts/resources/spell-check-ignore-list.txt" --skip="*.svg,*.dxf,*.pdf" ./content/ lint: diff --git a/content/hardware/03.nano/boards/nano-esp32/certifications/Arduino_ABX00083-CERT_RoHS_with or without headers.pdf b/content/hardware/03.nano/boards/nano-esp32/certifications/Arduino_ABX00083-CERT_RoHS_with or without headers.pdf index df083547bc..4e7041d933 100644 Binary files a/content/hardware/03.nano/boards/nano-esp32/certifications/Arduino_ABX00083-CERT_RoHS_with or without headers.pdf and b/content/hardware/03.nano/boards/nano-esp32/certifications/Arduino_ABX00083-CERT_RoHS_with or without headers.pdf differ diff --git a/content/hardware/_unlisted/boards/pro-4g-gnss-module-global/certifications/Arduino_TPX00200-CERT_FCC.pdf b/content/hardware/04.pro/modules/pro-4g-module/certifications/Arduino_TPX00200-CERT_FCC.pdf similarity index 100% rename from content/hardware/_unlisted/boards/pro-4g-gnss-module-global/certifications/Arduino_TPX00200-CERT_FCC.pdf rename to content/hardware/04.pro/modules/pro-4g-module/certifications/Arduino_TPX00200-CERT_FCC.pdf diff --git a/content/hardware/_unlisted/boards/pro-4g-gnss-module-global/certifications/Arduino_TPX00200-CERT_IC.pdf b/content/hardware/04.pro/modules/pro-4g-module/certifications/Arduino_TPX00200-CERT_IC.pdf similarity index 100% rename from content/hardware/_unlisted/boards/pro-4g-gnss-module-global/certifications/Arduino_TPX00200-CERT_IC.pdf rename to content/hardware/04.pro/modules/pro-4g-module/certifications/Arduino_TPX00200-CERT_IC.pdf diff --git a/content/hardware/_unlisted/boards/pro-4g-gnss-module-global/certifications/Arduino_TPX00200-DoC_CE.pdf b/content/hardware/04.pro/modules/pro-4g-module/certifications/Arduino_TPX00200-DoC_CE.pdf similarity index 100% rename from content/hardware/_unlisted/boards/pro-4g-gnss-module-global/certifications/Arduino_TPX00200-DoC_CE.pdf rename to content/hardware/04.pro/modules/pro-4g-module/certifications/Arduino_TPX00200-DoC_CE.pdf diff --git a/content/hardware/_unlisted/boards/pro-4g-gnss-module-global/certifications/Arduino_TPX00200-DoC_FCC.pdf b/content/hardware/04.pro/modules/pro-4g-module/certifications/Arduino_TPX00200-DoC_FCC.pdf similarity index 100% rename from content/hardware/_unlisted/boards/pro-4g-gnss-module-global/certifications/Arduino_TPX00200-DoC_FCC.pdf rename to content/hardware/04.pro/modules/pro-4g-module/certifications/Arduino_TPX00200-DoC_FCC.pdf diff --git a/content/hardware/_unlisted/boards/pro-4g-gnss-module-global/certifications/Arduino_TPX00200-DoC_UKCA.pdf b/content/hardware/04.pro/modules/pro-4g-module/certifications/Arduino_TPX00200-DoC_UKCA.pdf similarity index 100% rename from content/hardware/_unlisted/boards/pro-4g-gnss-module-global/certifications/Arduino_TPX00200-DoC_UKCA.pdf rename to content/hardware/04.pro/modules/pro-4g-module/certifications/Arduino_TPX00200-DoC_UKCA.pdf diff --git a/content/hardware/_unlisted/boards/pro-4g-module-emea/certifications/Arduino_TPX00201-DoC_CE.pdf b/content/hardware/04.pro/modules/pro-4g-module/certifications/Arduino_TPX00201-DoC_CE.pdf similarity index 100% rename from content/hardware/_unlisted/boards/pro-4g-module-emea/certifications/Arduino_TPX00201-DoC_CE.pdf rename to content/hardware/04.pro/modules/pro-4g-module/certifications/Arduino_TPX00201-DoC_CE.pdf diff --git a/content/hardware/_unlisted/boards/pro-4g-module-emea/certifications/Arduino_TPX00201-DoC_UKCA.pdf b/content/hardware/04.pro/modules/pro-4g-module/certifications/Arduino_TPX00201-DoC_UKCA.pdf similarity index 100% rename from content/hardware/_unlisted/boards/pro-4g-module-emea/certifications/Arduino_TPX00201-DoC_UKCA.pdf rename to content/hardware/04.pro/modules/pro-4g-module/certifications/Arduino_TPX00201-DoC_UKCA.pdf diff --git a/content/hardware/04.pro/modules/pro-4g-module/datasheet/datasheet.md b/content/hardware/04.pro/modules/pro-4g-module/datasheet/datasheet.md index d18fb165f0..8a00add6cd 100644 --- a/content/hardware/04.pro/modules/pro-4g-module/datasheet/datasheet.md +++ b/content/hardware/04.pro/modules/pro-4g-module/datasheet/datasheet.md @@ -67,8 +67,7 @@ The supported frequency bands, and digital audio functions of the EMEA variant ( | WCDMA | B1/B5/B8 | | GSM | EGSM900/DCS1800 | | Digital Audio (PCM) | Supported | -| Type Allocation Code (TAC) | 86335307 | -| NCC ID (EU) | CCAJ22Y00010T2 | +| Type Allocation Code (TAC) | 86194007 |

The supported frequency bands, GNSS, and digital audio functions of the Global variant (SKU: TPX00200) of the Pro 4G Module are shown in the table below. @@ -84,8 +83,8 @@ The supported frequency bands, GNSS, and digital audio functions of the Global v | GSM | 850/900/1800/1900 | | GNSS (Optional) | GPS, GLONASS, BeiDou (COMPASS), Galileo, QZSS | | Digital Audio (PCM) | Supported | -| Type Allocation Code (TAC) | 86408106 | -| FCC ID (USA) | XMR201903EG25G | +| Type Allocation Code (TAC) | 86340907 | +| FCC ID (USA) | 2AN9S-TPX00200 |

@@ -720,7 +719,6 @@ The following figure describes the space factor of mating plugs. | IC (Canada) | No | Yes | | RoHS | Yes | Yes | | REACH | Yes | Yes | -| NCC (EU) | Yes | No | ### Declaration of Conformity CE DoC (EU) @@ -835,5 +833,6 @@ Hereby, Arduino S.r.l. declares that this product is in compliance with essentia | **Date** | **Revision** | **Changes** | | :--------: | :----------: | :---------------------------------------------------: | +| 16/01/2025 | 3 | TAC and FCC ID information updated | | 23/12/2024 | 2 | TAC, FCC/NCC ID and frequency range information added | | 09/04/2024 | 1 | First release | \ No newline at end of file diff --git a/content/hardware/04.pro/modules/pro-4g-module/product.md b/content/hardware/04.pro/modules/pro-4g-module/product.md index 86fbe5c553..bc77bf59a8 100644 --- a/content/hardware/04.pro/modules/pro-4g-module/product.md +++ b/content/hardware/04.pro/modules/pro-4g-module/product.md @@ -5,7 +5,7 @@ primary_button_url: /tutorials/portenta-mid-carrier/user-manual primary_button_title: Mid Carrier User Manual secondary_button_url: /tutorials/portenta-max-carrier/user-manual secondary_button_title: Max Carrier User Manual -certifications: [CE, UKCA] +certifications: [CE, UKCA, FCC, IC] sku: [TPX00200, TPX00201] --- diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_Block_Diagram.png b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_Block_Diagram.png new file mode 100644 index 0000000000..3a66752aea Binary files /dev/null and b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_Block_Diagram.png differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_Connectors.png b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_Connectors.png new file mode 100644 index 0000000000..a1ead19cbd Binary files /dev/null and b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_Connectors.png differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_Ethernet_Pinout.png b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_Ethernet_Pinout.png new file mode 100644 index 0000000000..7ce9e38f58 Binary files /dev/null and b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_Ethernet_Pinout.png differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_LoRa_Pinout.png b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_LoRa_Pinout.png new file mode 100644 index 0000000000..70c977ee0c Binary files /dev/null and b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_LoRa_Pinout.png differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_Outline.png b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_Outline.png new file mode 100644 index 0000000000..8acbee53ac Binary files /dev/null and b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_Outline.png differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_Power_Tree.png b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_Power_Tree.png new file mode 100644 index 0000000000..8babb125b3 Binary files /dev/null and b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/Vision_Shield_Power_Tree.png differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_HD_pinout.png b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_HD_pinout.png deleted file mode 100644 index 982df07bf5..0000000000 Binary files a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_HD_pinout.png and /dev/null differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_connectors_bot.png b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_connectors_bot.png deleted file mode 100644 index f68a5467f2..0000000000 Binary files a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_connectors_bot.png and /dev/null differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_connectors_top.png b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_connectors_top.png deleted file mode 100644 index 2dc23adcac..0000000000 Binary files a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_connectors_top.png and /dev/null differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_mounting.png b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_mounting.png deleted file mode 100644 index 88780b1662..0000000000 Binary files a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_mounting.png and /dev/null differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_outline.png b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_outline.png deleted file mode 100644 index 48e34551ce..0000000000 Binary files a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_outline.png and /dev/null differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_topology_bot.png b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_topology_bot.png deleted file mode 100644 index 2872cd8f5b..0000000000 Binary files a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_topology_bot.png and /dev/null differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_topology_top.png b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_topology_top.png deleted file mode 100644 index 07def3816e..0000000000 Binary files a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/assets/visionShield_topology_top.png and /dev/null differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/datasheet.md b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/datasheet.md index 4c6027f1d7..f676ab3bd4 100644 --- a/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/datasheet.md +++ b/content/hardware/04.pro/shields/portenta-vision-shield/datasheet/datasheet.md @@ -1,6 +1,6 @@ --- identifier: ASX00021-ASX00026 -title: Arduino® Portenta Vision Shield +title: Arduino® Portenta Vision Shield Rev 2 type: pro variant: 'Collective Datasheet' --- @@ -8,204 +8,199 @@ variant: 'Collective Datasheet' ![](assets/featured.jpg) # Description -The Arduino Portenta Vision Shield is an add-on board providing machine vision capabilities and additional connectivity to the Portenta family of Arduino boards, designed to meet the needs of industrial automation. The Portenta Vision Shield connects via a high-density connector to the Portenta boards with minimal hardware and software setup. -# Target Areas -Industry, Surveillance +

Enhance your industrial automation and surveillance projects with the Arduino Portenta Vision Shield. This add-on board integrates with the Portenta family, offering advanced machine vision capabilities and extended connectivity. The Portenta Vision Shield's compact design and High-Density connector ensure a quick and efficient setup. It transforms your Portenta family board into a powerful tool for real-time image processing and edge computing, suitable for demanding industrial environments.

-# Features -Note: This board needs the Arduino Portenta H7 or Portenta C33 to function. -- **Himax HM-01B0 camera module** - - Ultra-Low-Power Image Sensor designed for always-on vision devices and applications - - High-sensitivity 3.6 μ BrightSenseTM pixel technology - - Window, vertical flip and horizontal mirror readout - - Programmable black level calibration target, frame size, frame rate, exposure, analog gain (up to 8x) and digital gain (up to 4x) - - Automatic exposure and gain control loop with support for 50 Hz / 60 Hz flicker avoidance - - Motion Detection circuit with programmable ROI and detection threshold with digital output to serve as an interrupt +# Target Areas +Industrial automation, surveillance, machine vision and edge computing - - **Supported resolutions** - - QQVGA (160x120) at 15, 30, 60 and 120 FPS - - QVGA (320x240) at 15, 30 and 60 FPS +# CONTENTS +## Application Examples - - **Power** - - \< 1.1 mW QQVGA resolution at 30 FPS, - - \< 2 mW QVGA resolution at 30 FPS +

+The Portenta Vision Shield is an add-on and a gateway to innovative solutions in various industries. Explore the possibilities of integrating advanced machine vision and edge computing into your projects with the following application examples: +

-- **2x MP34DT06JTR MEMS PDM Digital Microphone** +- **Industrial automation:** Elevate your automation systems with the Portenta Vision Shield, enabling precise and real-time image processing for: + -

Quality control: Use the Portenta Vision Shield in production lines to automatically detect product defects and ensure that only high-quality items pass through.

+ -

Predictive maintenance: Use machine vision to monitor equipment and identify early signs of wear or failure, reducing downtime and maintenance costs.

+ -

Automated sorting: Integrate the Portenta Vision Shield into conveyor systems to automatically sort items based on color, shape, or size, improving efficiency and accuracy.

- - AOP = 122.5 dB SPL - - 64 dB signal-to-noise ratio - - Omnidirectional sensitivity - - –26 dBFS ± 1 dB sensitivity +- **Surveillance:** Enhance security and monitoring systems with advanced visual capabilities provided by the Portenta Vision Shield for: + -

Real-time threat detection: Deploy the Portenta Vision Shield in security systems to identify and alert authorities of potential threats, such as unauthorized access or suspicious activities, in real-time.

+ -

Perimeter surveillance: Implement the Portenta Vision Shield in perimeter security to detect intrusions or breaches, triggering immediate responses and minimizing risks.

-- **MIPI 20-pin compatible JTAG Connector** +- **Machine vision and edge computing:** Unlock the potential of edge computing with the Portenta Vision Shield, bringing powerful processing capabilities directly to the field for: + -

Smart agriculture: Use the Portenta Vision Shield to monitor crops and soil conditions, identifying issues such as pest infestations or nutrient deficiencies, and enabling precise interventions to optimize yield.

+ -

Autonomous vehicles: Integrate the Portenta Vision Shield into autonomous systems to enhance navigation and obstacle detection, ensuring safe and efficient operation in various environments.

+ -

Robotics: Empower robots with the ability to see and interpret their surroundings using the Portenta Vision Shield, enabling complex tasks such as object recognition and manipulation in dynamic settings.

-- **Memory** +- **Audio analysis and sound-based applications:** Leverage the high-performance microphone of the Portenta Vision Shield for advanced audio processing and sound recognition in various scenarios: + -

Acoustic monitoring: Monitor environments for specific sounds, such as machinery noise patterns, to detect anomalies or predict maintenance needs in industrial settings.

+ -

Voice-activated systems: Integrate the microphone into hands-free control systems, enabling voice commands for enhanced accessibility and convenience in smart devices.

+ -

Anomaly detection: Use the microphone for real-time detection of unusual sounds, such as breaking glass or alarms in security or safety systems.

- - Micro SD Card Slot +## Features -# Contents -## The Board -The included HM-01B0 camera module has been pre-configured to work with the OpenMV libraries provided by Arduino. Based on the specific application requirements, the Portenta Vision Shield is available in two configurations with either Ethernet or LoRa® connectivity. Ethernet is designed for integration of the Portenta into wired networks and providing high bandwidth. In situations requiring long-range operation at low bandwidth, LoRa® connectivity is the way to go. The multi-core processor of the Portenta H7 makes embedded vision possible by minimizing the data bandwidth required. +### General Specifications Overview +

The Portenta Vision Shield expands the capabilities of the Portenta H7 (any variant) or Portenta C33 family boards, adding advanced vision and audio processing features to them.

-### Product Variants -The Portenta Vision Shield is available in two variants: -* Ethernet variant (ASX00021) -* LoRa® variant (ASX00026) +
+

Important note: The Portenta Vision Shield has two hardware revisions, distinguished only by the onboard camera sensor; all other features of the shield remain identical across both revisions. +

+Below is a summary of the shield's key components and their specifications. -### Application Examples -Thanks to the low power consumption of the Portenta Vision Shield, it is well suited for bringing machine learning to a wide range of Industry 4.0 and IoT applications. +| **Feature** | **Description** | +|------------------------|-------------------------------------------------------------------------------------| +| Onboard Camera (Rev 1) | 1/11″ 320 x 320 QVGA 60FPS CMOS image sensor (HM01B0) | +| Onboard Camera (Rev 2) | 1/6″ 640 x 480 VGA 60FPS CMOS image sensor (HM0360) | +| Onboard Microphone | Ultra-compact, low-power, omnidirectional, digital MEMS microphone (x2) (MP34DT06J) | +| External Memory | Onboard microSD card slot | +| Onboard LoRa® Module | CMWX1ZZABZ-078 (only in LoRa® variant, SKU: ASX00026) | +| Onboard RJ45 Connector | For Ethernet capabilities (only in Ethernet variant, SKU: ASX00021) | +| Dimensions | 66.04 x 25.40 mm | +| Weight | 8 g | +| Pinout Features | Onboard High-Density connectors easily connect the shield to Portenta family boards | -- **Industrial production:** The included HM-01B0 camera along with the OpenMV libraries allows for quality control of items within a manufacturing or packaging plant. The small footprint, low power consumption and LoRa®/Ethernet connectivity allow for the module to be deployed essentially anywhere so that defects are identified quickly and removed from the production environment. +
+

The Portenta C33 board is not compatible with the onboard camera of the Portenta Vision Shield, it is only compatible with the shield's advanced audio and connectivity features (Ethernet or LoRa® depending of the variant). +

-- **Predictive maintenance:** The combination of machine vision and machine learning capabilities of the Portenta Vision Shield and the Portenta H7 opens up possibilities for predictive maintenance based on subtle differences in the visual representation of machinery. These capabilities are further enhanced with the two MP34DT05 MEMS microphones included in the Portenta Vision Shield. +
-- **Surveillance:** The Portenta Vision Shield is able to provide surveillance capabilities in areas with low Wi-Fi® penetration (e.g. warehouses) and large areas - (e.g. shopping centers). The OpenMV libraries enable the Portenta Vision Shield to identify objects and alert the operator via LoRa® while saving a snapshot on the microSD storage slot. +### Included Accessories -### Related Products -The Portenta Vision Shield is developed as an add-on shield compatible with the following Portenta boards: -* Portenta H7 (ABX00042) -* Portenta H7 Lite (ABX00045) -* Portenta H7 Lite Connected (ABX00046) -* Portenta C33 (ABX00074). **Only connectivity. Not compatible with the Portenta Vision Shield camera** +- No accessories are included +### Related Products -## Ratings - -### Absolute Maximum +- Portenta H7 (SKU: ABX00042) +- Portenta H7 Lite (SKU: ABX00045) +- Portenta H7 Lite Connected (SKU: ABX00046) +- Portenta C33 (SKU: ABX00074) +- Arduino USB Type-C® Cable 2-in-1 (SKU: TPX00094) -| **Symbol** | **Description** | **Min** | **Typ** | **Max** | **Unit** | -| ---------- | -------------------------------- | ------- | ------- | ------- | -------- | -| VINMax | Input voltage from HD Connectors | -0.3 | - | 3.3 | V | -### Thermal +
-| **Symbol** | **Description** | **Min** | **Typ** | **Max** | **Unit** | -| ---------- | --------------------- | ------- | ------- | ------- | -------- | -| TST | Storage Temperature | -30 | | 85 | °C | -| TOP | Operating Temperature | -40 | | 85 | °C | +## Ratings -
+### Recommended Operating Conditions -## Functional Overview +

+The table below provides a comprehensive guideline for the optimal use of the Portenta Vision Shield, outlining typical operating conditions and design limits. The operating conditions of the Portenta Vision Shield are largely a function based on its component's specifications.

-### Board Topology -![Top view](assets/visionShield_topology_top.png) +| **Parameter** | **Symbol** | **Min** | **Typ** | **Max** | **Unit** | +|:--------------------------------:|:---------------:|:-------:|:-------:|:-------:|:--------:| +| Supply Input Voltage1 | VIN | - | 3.3 | 3.3 | V | +| Operating Temperature | TOP | -40 | - | 85 | °C | -![Bottom view](assets/visionShield_topology_bot.png) +1 Portenta Vision Shield powered through a Portenta family board. -| Ref. | Description | Ref. | Description | -| ------ | ---------------------------------------------- | ---- | -------------------------------------------------- | -| U1 | Voltage Regulator | J3 | LoRa® Radio Antenna U.FL Connector (ASX00026 Only) | -| U2,U3 | ST MP34DT06JTR Digital Microphones | J7 | Ethernet Connector (ASX00021 Only) | -| M1 | Murata CMWX1ZZABZ LoRa® Module (ASX00026 Only) | J9 | Micro SD Card Connector | -| J1, J2 | High-Density Connectors | CN1 | JTAG Connector | -| CAM1 | Camera Module Himax HM-01B0 | | | +
+The Portenta Vision Shield can be only powered through its High-Density Connectors (VCC pin). +
-### Power -The Portenta H7/C33 supplies 3.3 V power to the LoRa® module (ASX00026 only), Ethernet communication (ASX00021 only), Micro SD slot and dual microphones via the 3.3 V output of the high-density connectors. An onboard LDO regulator supplies a 2.8 V output (300 mA) for the camera module. +
-### Camera Module +## Functional Overview -The Himax HM-01B0 Module is a very low-power camera with 324x324 resolution and a maximum of 60 FPS depending on the operating mode. Video data is transferred over a configurable 8-bit interconnect with support for frame and line synchronization. The module delivered with the Portenta Vision Shield is the monochrome version. Configuration is achieved via an I2C connection with the compatible Portenta boards microcontrollers. +

The core of the Portenta Vision Shield is its integration with the Portenta family boards, leveraging their processing power for advanced vision and audio applications. The Portenta Vision Shield is equipped with key peripherals, such as dual MEMS microphones (MP34DT06J) and a high-performance camera module (HM01B0 on Rev 1 and HM0360 on Rev 2), all directly interfaced with the main Portenta family board. Two different variants of the shield offer advanced connectivity capabilities, via Ethernet (variant SKU: ASX00021) and via LoRa® variant (SKU: ASX00026).

-HM-01B0 offers very low-power image acquisition and provides the possibility to perform motion detection without main processor interaction. The “Always-on” operation provides the ability to turn on the main processor when movement is detected with minimal power consumption. +### Pinout -***Note: The Portenta C33 is not compatible with the camera of the Portenta Vision Shield*** +

The pinout for the Portenta Vision Shield Ethernet is shown in the figure below.

+![](assets/Vision_Shield_Ethernet_Pinout.png) -### Digital Microphones +
-The dual MP34DT05 digital MEMS microphones are omnidirectional and operate via a capacitive sensing element with a high (64 dB) signal-to-noise ratio. The microphones have been configured to provide separate left and right audio over a single PDM stream. +

The pinout for the Portenta Vision Shield LoRa® is shown in the figure below.

-The sensing element, capable of detecting acoustic waves, is manufactured using a specialized silicon micromachining process dedicated to produce audio sensors. +![](assets/Vision_Shield_LoRa_Pinout.png) +
-### Micro SD Card Slot +### Block Diagram -A Micro SD card slot is available under the Portenta Vision Shield board. Available libraries allow reading and writing to FAT16/32 formatted cards. +

An overview of the high-level architecture of the Portenta Vision Shield (Ethernet variant in the left and LoRa® variant on the right) is illustrated in the figure below.

+![](assets/Vision_Shield_Block_Diagram.png) -### Ethernet (ASX00021 Only) +
-Ethernet connector allows connecting to 10/100 Base TX networks using the Ethernet PHY available on the Portenta board. +### Power Supply +

The Portenta Vision Shield is powered exclusively through the VCC pins (+3V3) of its High Density Connectors (J1-J2). These connectors are designed to be used with boards from the Portenta family, such as the Portenta H7 board (any variant) or the Portenta C33 board. The power is supplied directly from the connected Portenta family board, which acts as the power source for the Portenta Vision Shield.

-### LoRa® Module (ASX00026 Only) +

The detailed figure below illustrates the power architecture of the Portenta Vision Shield (Ethernet variant in the left and LoRa® variant on the right).

-LoRa® connectivity is provided by the Murata CMWX1ZZABZ module. This module contains an STM32L0 processor along with a Semtech SX1276 Radio. The processor is running on Arduino open-source firmware based on Semtech code. +![](assets/Vision_Shield_Power_Tree.png) -## Board Operation +
-### Getting Started – OpenMV +## Device Operation -The Portenta Vision Shield and Portenta H7 are supported under OpenMV. In order to easily use OpenMV download the latest OpenMV IDE **[1]** and follow the Portenta Vision Shield official documentation **[2]** to learn how to create OpenMV vision applications. +### Getting Started – OpenMV IDE -### Getting Started – IDE +

The Portenta Vision Shield and the Portenta H7 boards are supported under OpenMV. In order to easily use OpenMV download the latest OpenMV IDE version [1] and follow the Portenta Vision Shield official documentation [2] to learn how to create OpenMV vision applications.

-If you want to program your Arduino board while offline you need to install the Arduino Desktop IDE **[3]**. To connect the board to your computer, you will need a USB cable. This also provides power to the board, as indicated by the LED. +### Getting Started - Arduino IDE +

If you want to program your Portenta family board offline, install the Arduino Desktop IDE [3]. To connect the Portenta family board to your computer, you will need a USB-C® cable.

-### Getting Started – Arduino Cloud Editor (Create) +### Getting Started - Arduino Cloud Editor -All Arduino and Genuino boards, including this one, work out-of-the-box on the Arduino Cloud Editor **[4]** by just installing a simple plugin. +

All Arduino devices work out of the box on the Arduino Cloud Editor [4] by installing a simple plugin. The Arduino Cloud Editor is hosted online. Therefore, it will always be up-to-date with all the latest features and support for all boards and devices. Follow [5] to start coding on the browser and upload your sketches onto your device.

-The Arduino Cloud Editor is hosted online, therefore it will always be up-to-date with the latest features and support for all boards. Follow **[5]** to start coding on the browser and upload your sketches onto your board. +### Getting Started - Arduino Cloud +

All Arduino IoT-enabled products are supported on Arduino Cloud, which allows you to log, graph, and analyze sensor data, trigger events, and automate your home or business. Take a look at the official documentation [5] to know more.

-### Getting Started – Arduino Cloud +### Sample Sketches -All Arduino IoT-enabled products are supported on Arduino Cloud which allows you to Log, graph and analyze sensor data, trigger events, and automate your home or business. +

Sample sketches for the Portenta Vision Shield can be found either in the “Examples” menu in the Arduino IDE or the “Portenta Vision Shield Documentation” section of Arduino documentation [2].

### Online Resources -Now that you have gone through the basics of what you can do with the board you can explore the endless possibilities it provides by checking exciting projects on ProjectHub **[6]**, the Arduino Library Reference **[7]** and the online store **[8]** where you will be able to complement your board with sensors, actuators and more. -### Board Recovery -All Arduino boards have a built-in bootloader which allows flashing the board via USB. In case a sketch locks up the processor and the board is not reachable anymore via USB it is possible to enter bootloader mode by double-tapping the reset button right after the power-up. +

Now that you have gone through the basics of what you can do with the device, you can explore the endless possibilities it provides by checking exciting projects on Arduino Project Hub [6], the Arduino Library Reference [7], and the online store [8] where you will be able to complement your Portenta family board with additional extensions, sensors, and actuators.

+ +
-## Connector Pinouts -### JTAG +## Mechanical Information -| Pin | Function | Type | Description | -| ---------------------------- | -------- | ------------- | ---------------------------------------------- | -| 1 | VDDIO | Power | Positive Reference voltage for debug interface | -| 2 | SWD | I/O | Single Wire Debug Data | -| 3,5,9 | GND | Power | Negative reference voltage for debug interface | -| 4 | SCK | Output | Single Wire Debug Clock | -| 6 | SWO | I/O | Single Wire Debug Trace | -| 10 | RESET | Input | CPU Reset | -| 7,11,12,13,14,15,17,18,19,20 | NC | Not Connected | | +

The Portenta Vision Shield is a double-sided board measuring 66.04 x 25.40 mm. It features an RJ45 connector that overhangs the top edge (present only in the Ethernet variant, SKU: ASX00021), an onboard camera positioned near the center of the board, and a LoRa® module located near the bottom edge (only in the LoRa® variant, SKU: ASX00026). The Portenta Vision Shield also includes two High-Density connectors at the bottom edge, enabling quick and efficient integration with Portenta Family boards.

+### Board Dimensions -
+

The outline and mounting hole dimensions of the Portenta Vision Shield are shown in the figure below, with all measurements in millimeters (mm). The board shown below is the Ethernet variant of the Portenta Vision Shield (SKU: ASX00021).

-### High-Density Connector -![High-density connector pinout](assets/visionShield_HD_pinout.png) + -## Mechanical Information -### Board Outline -![Board dimensions](assets/visionShield_outline.png) +The Portenta Vision Shield has four 2.25 mm drilled mounting holes for mechanical fixing. -### Mounting Instructions -![Mounting details](assets/visionShield_mounting.png) +### Board Connectors -### Connector and Component Positions -![Connectors positions TOP](assets/visionShield_connectors_top.png) +

The connectors of the Portenta Vision Shield are placed on the top and bottom side of the shield; their placement are shown in the figures below; all the dimensions are in mm. The shield shown below is the Ethernet variant (SKU: ASX00021).

-![Connectors positions BOTTOM](assets/visionShield_connectors_bot.png) +![](assets/Vision_Shield_Connectors.png) +

The Portenta Vision Shield was designed to be used with a Portenta family board. However, you can also design your own hardware and use the Portenta Vision Shield via its High-Density connectors by following to the Portenta family standard.

+
## Certifications + ### Declaration of Conformity CE/RED DoC (EU) -We declare under our sole responsibility that the products above are in conformity with the essential requirements of the following EU Directives and therefore qualify for free movement within markets comprising the European Union (EU) and European Economic Area (EEA). + +

We declare under our sole responsibility that the products above are in conformity with the essential requirements of the following EU Directives and therefore qualify for free movement within markets comprising the European Union (EU) and European Economic Area (EEA).

### Declaration of Conformity to EU RoHS & REACH 191 11/26/2018 -Arduino boards are in compliance with Directive 2011/65/EU of the European Parliament and Directive 2015/863/EU of the Council of 4 June 2015 on the restriction of the use of certain hazardous substances in electrical and electronic equipment. + +

Arduino boards are in compliance with Directive 2011/65/EU of the European Parliament and Directive 2015/863/EU of the Council of 4 June 2015 on the restriction of the use of certain hazardous substances in electrical and electronic equipment.

| **Substance** | **Maximum Limit (ppm)** | | -------------------------------------- | ----------------------- | @@ -215,92 +210,73 @@ Arduino boards are in compliance with Directive 2011/65/EU of the European Parli | Hexavalent Chromium (Cr6+) | 1000 | | Poly Brominated Biphenyls (PBB) | 1000 | | Poly Brominated Diphenyl ethers (PBDE) | 1000 | -| Bis(2-Ethylhexyl} phthalate (DEHP) | 1000 | +| Bis(2-Ethylhexyl) phthalate (DEHP) | 1000 | | Benzyl butyl phthalate (BBP) | 1000 | | Dibutyl phthalate (DBP) | 1000 | | Diisobutyl phthalate (DIBP) | 1000 | -Exemptions : No exemptions are claimed. +Exemptions: No exemptions are claimed. -Arduino Boards are fully compliant with the related requirements of European Union Regulation (EC) 1907 /2006 concerning the Registration, Evaluation, Authorization and Restriction of Chemicals (REACH). We declare none of the SVHCs (https://echa.europa.eu/web/guest/candidate-list-table), the Candidate List of Substances of Very High Concern for authorization currently released by ECHA, is present in all products (and also package) in quantities totaling in a concentration equal or above 0.1%. To the best of our knowledge, we also declare that our products do not contain any of the substances listed on the "Authorization List" (Annex XIV of the REACH regulations) and Substances of Very High Concern (SVHC) in any significant amounts as specified by the Annex XVII of Candidate list published by ECHA (European Chemical Agency) 1907 /2006/EC. +

Arduino boards are fully compliant with the related requirements of European Union Regulation (EC) 1907 /2006 concerning the Registration, Evaluation, Authorization and Restriction of Chemicals (REACH). We declare none of the SVHCs (https://echa.europa.eu/web/guest/candidate-list-table), the Candidate List of Substances of Very High Concern for authorization currently released by ECHA, is present in all products (and also package) in quantities totaling in a concentration equal or above 0.1%. To the best of our knowledge, we also declare that our products do not contain any of the substances listed on the "Authorization List" (Annex XIV of the REACH regulations) and Substances of Very High Concern (SVHC) in any significant amounts as specified by the Annex XVII of Candidate list published by ECHA (European Chemical Agency) 1907 /2006/EC.

### Conflict Minerals Declaration -As a global supplier of electronic and electrical components, Arduino is aware of our obligations with regards to laws and regulations regarding Conflict Minerals, specifically the Dodd-Frank Wall Street Reform and Consumer Protection Act, Section 1502. Arduino does not directly source or process conflict minerals such as Tin, Tantalum, Tungsten, or Gold. Conflict minerals are contained in our products in the form of solder, or as a component in metal alloys. As part of our reasonable due diligence Arduino has contacted component suppliers within our supply chain to verify their continued compliance with the regulations. Based on the information received thus far we declare that our products contain Conflict Minerals sourced from conflict-free areas. + +

As a global supplier of electronic and electrical components, Arduino is aware of our obligations with regards to laws and regulations regarding Conflict Minerals, specifically the Dodd-Frank Wall Street Reform and Consumer Protection Act, Section 1502. Arduino does not directly source or process conflict minerals such as Tin, Tantalum, Tungsten, or Gold. Conflict minerals are contained in our products in the form of solder, or as a component in metal alloys. As part of our reasonable due diligence Arduino has contacted component suppliers within our supply chain to verify their continued compliance with the regulations. Based on the information received thus far we declare that our products contain Conflict Minerals sourced from conflict-free areas.

## FCC Caution -Any Changes or modifications not expressly approved by the party responsible for compliance could void the user's authority to operate the equipment. -This device complies with part 15 of the FCC Rules. Operation is subject to the following two conditions: (1) This device may not cause harmful interference, and (2) this device must accept any interference received, including interference that may cause undesired operation. +

Any changes or modifications not expressly approved by the party responsible for compliance could void the user's authority to operate the equipment. This device complies with part 15 of the FCC Rules. Operation is subject to the following two conditions: (1) This device may not cause harmful interference, and (2) this device must accept any interference received, including interference that may cause undesired operation.

+ FCC RF Radiation Exposure Statement: 1. This Transmitter must not be co-located or operating in conjunction with any other antenna or transmitter. 2. This equipment complies with RF radiation exposure limits set forth for an uncontrolled environment. -3. This equipment should be installed and operated with a minimum distance 20 cm between the radiator& your body. - - - - - - - - - - - - - - - - - - -
Antenna manufacturer: - Dynaflex -
Antenna Model: - 2G-3G-4G ADHESIVE MOUNT ANTENNA DIPOLE -
Antenna type: - External omnidirectional dipole antenna -
Antenna gain: - -1 dBi -
+3. This equipment should be installed and operated with a minimum distance 20 cm between the radiator and your body. -**Important:** The operating temperature of the EUT can’t exceed 85℃ and shouldn’t be lower than -40℃. +| **Feature** | **Description** | +|--------------------------|---------------------------------------------| +| **Antenna Manufacturer** | Dynaflex | +| **Antenna Model** | 2G-3G-4G ADHESIVE MOUNT ANTENNA DIPOLE | +| **Antenna Type** | External omnidirectional dipole antenna | +| **Antenna Gain** | -1 dBi | -Hereby, Arduino S.r.l. declares that this product is in compliance with essential requirements and other relevant provisions of Directive 201453/EU. This product is allowed to be used in all EU member states. +**Important:** The operating temperature of the EUT can’t exceed 85℃ and shouldn’t be lower than -40℃. -| Frequency bands | Maximum Output Power (ERP) | -| --------------- | -------------------------- | -| 863-870 MHz | 0.73 dBm | +

Hereby, Arduino S.r.l. declares that this product is in compliance with essential requirements and other relevant provisions of Directive 201453/EU. This product is allowed to be used in all EU member states.

+| **Frequency bands** | **Maximum Output Power (ERP)** | +|---------------------|--------------------------------| +| 863-870 MHz | 0.73 dBm | ## Company Information - -| Company name | Arduino S.r.l. | -| --------------- | ------------------------------------------ | -| Company Address | Via Andrea Appiani, 25 20900 MONZA (Italy) | +| **Company name** | **Arduino S.r.l.** | +|------------------|----------------------------------------------| +| Company address | Via Andrea Appiani, 25 - 20900 Monza (Italy) | ## Reference Documentation -| **Ref** | **Link** | -| ------------------------------------ | ------------------------------------------------------------------------ | -| OpenMV IDE | https://openmv.io/pages/download | -| Portenta Vision Shield Documentation | https://docs.arduino.cc/hardware/portenta-vision-shield | -| Arduino IDE (Desktop) | https://www.arduino.cc/en/Main/Software | -| Arduino IDE (Cloud) | https://create.arduino.cc/editor | -| Cloud IDE Getting Started | https://docs.arduino.cc/arduino-cloud/guides/overview | -| ProjectHub | https://create.arduino.cc/projecthub?by=part&part_id=11332&sort=trending | -| Library Reference | https://www.arduino.cc/reference/en/ | -| Arduino Store | https://store.arduino.cc/ | - -## Change Log - -| **Date** | **Revision** | **Changes** | -|------------|--------------|----------------------------------------| -| 03/09/2024 | 5 | Cloud Editor updated from Web Editor | -| 20/11/2023 | 4 | Structure Updates. FCC Caution Updated | -| 15/11/2023 | 3 | Updates as a Collective Datasheet | -| 13/01/2022 | 2 | Information update | -| 03/03/2021 | 1 | First Release | +| **No.** | **Reference** | **Link** | +|:-------:|:------------------------------------:|---------------------------------------------------------| +| 1 | OpenMV IDE | https://openmv.io/pages/download | +| 2 | Portenta Vision Shield Documentation | https://docs.arduino.cc/hardware/portenta-vision-shield | +| 3 | Arduino IDE (Desktop) | https://www.arduino.cc/en/software | +| 4 | Arduino IDE (Cloud) | https://create.arduino.cc/editor | +| 5 | Cloud IDE Getting Started | https://docs.arduino.cc/arduino-cloud/guides/overview | +| 6 | Project Hub | https://projecthub.arduino.cc/ | +| 7 | Library Reference | https://www.arduino.cc/reference/en/ | +| 8 | Arduino Store | https://store.arduino.cc/ | + +## Document Revision History + +| **Date** | **Revision** | **Changes** | +|:----------:|:------------:|----------------------------------------| +| 17/01/25 | 7 | Revamp fixes | +| 30/12/2024 | 6 | Datasheet structure revamp | +| 03/09/2024 | 5 | Cloud Editor updated from Web Editor | +| 20/11/2023 | 4 | Structure Updates, FCC Caution updated | +| 15/11/2023 | 3 | Updates as a collective datasheet | +| 13/01/2022 | 2 | Information update | +| 03/03/2021 | 1 | First release | \ No newline at end of file diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/arch-top-c.png b/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/arch-top-c.png new file mode 100644 index 0000000000..630150fa76 Binary files /dev/null and b/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/arch-top-c.png differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/arch-top.png b/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/arch-top.png deleted file mode 100644 index 1386478371..0000000000 Binary files a/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/arch-top.png and /dev/null differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/ml-inference-2.png b/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/ml-inference-2.png new file mode 100644 index 0000000000..6cff6525d4 Binary files /dev/null and b/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/ml-inference-2.png differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/ml-inference.png b/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/ml-inference.png deleted file mode 100644 index 3497aa61a9..0000000000 Binary files a/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/ml-inference.png and /dev/null differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/model-speech.png b/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/model-speech.png new file mode 100644 index 0000000000..f820a8e521 Binary files /dev/null and b/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/model-speech.png differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/person-detect-4.gif b/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/person-detect-4.gif new file mode 100644 index 0000000000..30a0dd5d69 Binary files /dev/null and b/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/person-detect-4.gif differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/person-detect.gif b/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/person-detect.gif deleted file mode 100644 index f9a8be4e8a..0000000000 Binary files a/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/person-detect.gif and /dev/null differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/resolutions-2.png b/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/resolutions-2.png new file mode 100644 index 0000000000..66ac7e2113 Binary files /dev/null and b/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/resolutions-2.png differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/resolutions.png b/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/resolutions.png deleted file mode 100644 index dc5fd315f4..0000000000 Binary files a/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/assets/resolutions.png and /dev/null differ diff --git a/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/content.md b/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/content.md index 8c8f058135..d17f1f6fb3 100644 --- a/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/content.md +++ b/content/hardware/04.pro/shields/portenta-vision-shield/tutorials/user-manual/content.md @@ -7,7 +7,7 @@ tags: - Camera - Sensors - Machine Learning -author: 'Christopher Mendez' +author: 'Christopher Méndez' hardware: - hardware/04.pro/shields/portenta-vision-shield software: @@ -38,22 +38,27 @@ This user manual will guide you through a practical journey covering the most in The Arduino Portenta Vision Shield is an add-on board providing machine vision capabilities and additional connectivity to the Portenta family of Arduino boards, designed to meet the needs of industrial automation. The Portenta Vision Shield connects via a high-density connector to the Portenta boards with minimal hardware and software setup. -The included HM-01B0 camera module has been pre-configured to work with the OpenMV libraries provided by Arduino. Based on the specific application requirements, the Portenta Vision Shield is available in two configurations with either Ethernet or LoRa® connectivity. +***The Portenta Vision Shield has two hardware revisions, distinguished only by the onboard camera sensor; all other features of the shield remain identical across both revisions.*** + +- The Portenta Vision Shield (**Rev 1**) includes the **HM01B0** (1/11" 320 x 320 VGA 60FPS) CMOS camera module. +- The Portenta Vision Shield (**Rev 2**) includes the **HM0360** (1/6" 640 x 480 VGA 60FPS) CMOS camera module. + +The included camera module has been pre-configured to work with the OpenMV libraries provided by Arduino. Based on the specific application requirements, the Portenta Vision Shield is available in two configurations with either Ethernet or LoRa® connectivity. ### Board Architecture Overview The Portenta Vision Shield LoRa® brings industry-rated features to your Portenta. This hardware add-on will let you run embedded computer vision applications, connect wirelessly via LoRa® to the Arduino Cloud or your own infrastructure, and activate your system upon the detection of sound events. -![Vision Shield main components (top view)](assets/arch-top.png) +![Vision Shield main components (top view)](assets/arch-top-c.png) ![Vision Shield main components (bottom view)](assets/arch-bottom.png) Here is an overview of the board's main components, as shown in the images above: - **Power Regulator**: the Portenta H7/C33 supplies 3.3 V power to the LoRa® module (ASX00026 only), Ethernet communication (ASX00021 only), Micro SD slot and dual microphones via the 3.3 V output of the high-density connectors. An onboard LDO regulator supplies a 2.8 V output (300 mA) for the camera module. -- **Camera**: the Himax HM-01B0 Module is a very low-power camera with 320x320 resolution and a maximum of 60 FPS depending on the operating mode. Video data is transferred over a configurable 8-bit interconnect with support for frame and line synchronization. The module delivered with the Portenta Vision Shield is the monochrome version. Configuration is achieved via an I2C connection with the compatible Portenta boards microcontrollers. +- **Camera**: the Himax HM01B0 (320x320) and HM0360 (640x480) modules are very low-power cameras with a maximum of 60 FPS depending on the operating mode. Video data is transferred over a configurable 8-bit interface with support for frame and line synchronization. The module delivered with the Portenta Vision Shield is the monochrome version. Configuration is achieved via an I2C connection with the compatible Portenta boards microcontrollers. - HM-01B0 offers very low-power image acquisition and provides the possibility to perform motion detection without main processor interaction. The“Always-on” operation provides the ability to turn on the main processor when movement is detected with minimal power consumption. + Himax modules offers very low-power image acquisition and provides the possibility to perform motion detection without main processor interaction. The “Always-on” operation provides the ability to turn on the main processor when movement is detected with minimal power consumption. ***The Portenta C33 is not compatible with the camera of the Portenta Vision Shield*** @@ -76,7 +81,7 @@ along with a Semtech SX1276 Radio. The processor is running on Arduino open-sour Connect the Vision Shield with a Portenta H7 through their High-Density connectors and verify they are correctly aligned.
-
@@ -189,19 +194,25 @@ From the above example script, we can highlight the main functions: - `sensor.set_framesize()` lets you define the image frame size in terms of pixels. [Here](https://docs.openmv.io/library/omv.sensor.html#sensor.set_framesize) you can find all the different options. - To leverage full sensor resolution with the Vision Shield camera module `HM01B0`, use `sensor.B320X320`. + ![Different resolutions examples](assets/resolutions-2.png) - ![Different resolutions examples](assets/resolutions.png) + Here are some tested settings for your camera setup: + + | **Resolution** | **Setting** | **Compatibility** | **Note** | + | :------------: | :---------------: | :---------------: | :--------------------: | + | 320 x 240 | `sensor.QVGA` | HM01B0 and HM0360 | | + | 320 x 320 | `sensor.B320X320` | HM01B0 | Full sensor resolution | + | 640 x 480 | `sensor.VGA` | HM0360 | Full sensor resolution | - `sensor.snapshot()` lets you take a picture and return the image so you can save it, stream it or process it. ## Camera -The Portenta Vision Shields's main feature is its onboard camera, based on the HM01B0 ultralow power CMOS image sensor. It is perfect for Machine Learning applications such as object detection, image classification, machine/computer vision, robotics, IoT, and more. +The Portenta Vision Shields's main feature is its onboard camera, based on the HM01B0 or HM0360 ultra low power CMOS image sensor. It is perfect for Machine Learning applications such as object detection, image classification, machine/computer vision, robotics, IoT, and more. ![Onboard camera sensor](assets/camera.png) -**Main Camera Features** +### HM01B0 Camera Features - Ultra-Low-Power Image Sensor designed for always-on vision devices and applications - High-sensitivity 3.6 μ BrightSenseTM pixel technology Window, vertical flip and horizontal mirror readout @@ -211,15 +222,35 @@ The Portenta Vision Shields's main feature is its onboard camera, based on the H **Supported Resolutions** -- QQVGA (160x120) at 15, 30, 60 and 120 FPS +- QQVGA (160x120) at 15, 30, and 60 FPS - QVGA (320x240) at 15, 30 and 60 FPS - B320X320 (320x320) at 15, 30 and 45 FPS **Power Consumption** -- < 1.1 mW QQVGA resolution at 30 FPS, +- < 1.1 mW QQVGA resolution at 30 FPS - < 2 mW QVGA resolution at 30 FPS - < 4 mW QVGA resolution at 60 FPS +### HM0360 Camera Features + +- Ultra-Low-Power, high sensitivity, low noise VGA sensor +- On-chip auto exposure / gain and zone detection +- Automatic wake and sleep operation with programmable event interrupt to host processor +- Pre-metered exposure provides well exposed first frame and after extended sleep (blanking) period +- Embedded line provides metadata such as frame count, AE statistics, zone trigger and other interrupt event information + +**Supported Resolutions** + +- QQVGA (160x120) at 15, 30, and 60 FPS +- QVGA (320x240) at 15, 30 and 60 FPS +- VGA (640x480) at 15, 30 and 60 FPS + +**Power Consumption** + +- 140 µA QVGA resolution at 2 FPS +- 3.2 mA QVGA resolution at 60 FPS +- 7.8 mA VGA resolution at 60 FPS + The Vision Shield is primarily intended to be used with the OpenMV MicroPython ecosystem. So, it's recommended to use this IDE for machine vision applications. ### Snapshot Example @@ -233,7 +264,7 @@ import machine sensor.reset() # Reset and initialize the sensor. sensor.set_pixformat(sensor.GRAYSCALE) # Set pixel format to RGB565 (or GRAYSCALE) -sensor.set_framesize(sensor.B320X320) # Set frame size to QVGA (320x240) +sensor.set_framesize(sensor.QVGA) # Set frame size to QVGA (320x240) sensor.skip_frames(time=2000) # Wait for settings take effect. led = machine.LED("LED_BLUE") @@ -412,7 +443,7 @@ import time sensor.reset() sensor.set_pixformat(sensor.GRAYSCALE) -sensor.set_framesize(sensor.B320X320) +sensor.set_framesize(sensor.QVGA) sensor.skip_frames(time=2000) sensor.set_auto_gain(False) # must turn this off to prevent image washout... clock = time.clock() @@ -439,8 +470,10 @@ This script will draw a circle on each detected face and will print their coordi ```python import sensor import time -import tf +import ml +from ml.utils import NMS import math +import image sensor.reset() # Reset and initialize the sensor. sensor.set_pixformat(sensor.GRAYSCALE) # Set pixel format to RGB565 (or GRAYSCALE) @@ -449,12 +482,14 @@ sensor.set_windowing((240, 240)) # Set 240x240 window. sensor.skip_frames(time=2000) # Let the camera adjust. min_confidence = 0.4 +threshold_list = [(math.ceil(min_confidence * 255), 255)] # Load built-in FOMO face detection model -labels, net = tf.load_builtin_model("fomo_face_detection") +model = ml.Model("fomo_face_detection") +print(model) # Alternatively, models can be loaded from the filesystem storage. -# net = tf.load('', load_to_fb=True) +# model = ml.Model('.tflite', load_to_fb=True) # labels = [line.rstrip('\n') for line in open("labels.txt")] colors = [ # Add more colors if you are detecting more than 7 types of classes at once. @@ -467,31 +502,50 @@ colors = [ # Add more colors if you are detecting more than 7 types of classes (255, 255, 255), ] + +# FOMO outputs an image per class where each pixel in the image is the centroid of the trained +# object. So, we will get those output images and then run find_blobs() on them to extract the +# centroids. We will also run get_stats() on the detected blobs to determine their score. +# The Non-Max-Supression (NMS) object then filters out overlapping detections and maps their +# position in the output image back to the original input image. The function then returns a +# list per class which each contain a list of (rect, score) tuples representing the detected +# objects. +def fomo_post_process(model, inputs, outputs): + n, oh, ow, oc = model.output_shape[0] + nms = NMS(ow, oh, inputs[0].roi) + for i in range(oc): + img = image.Image(outputs[0][0, :, :, i] * 255) + blobs = img.find_blobs( + threshold_list, x_stride=1, area_threshold=1, pixels_threshold=1 + ) + for b in blobs: + rect = b.rect() + x, y, w, h = rect + score = ( + img.get_statistics(thresholds=threshold_list, roi=rect).l_mean() / 255.0 + ) + nms.add_bounding_box(x, y, x + w, y + h, score, i) + return nms.get_bounding_boxes() + + clock = time.clock() while True: clock.tick() img = sensor.snapshot() - # detect() returns all objects found in the image (split out per class already) - # we skip class index 0, as that is the background, and then draw circles of the center - # of our objects - - for i, detection_list in enumerate( - net.detect(img, thresholds=[(math.ceil(min_confidence * 255), 255)]) - ): + for i, detection_list in enumerate(model.predict([img], callback=fomo_post_process)): if i == 0: continue # background class if len(detection_list) == 0: continue # no detections for this class? - print("********** %s **********" % labels[i]) - for d in detection_list: - [x, y, w, h] = d.rect() + print("********** %s **********" % model.labels[i]) + for (x, y, w, h), score in detection_list: center_x = math.floor(x + (w / 2)) center_y = math.floor(y + (h / 2)) - print(f"x {center_x}\ty {center_y}") - img.draw_circle((center_x, center_y, 12), color=colors[i], thickness=2) + print(f"x {center_x}\ty {center_y}\tscore {score}") + img.draw_circle((center_x, center_y, 12), color=colors[i]) print(clock.fps(), "fps", end="\n") ``` @@ -506,9 +560,7 @@ Use the following example script to run the **person detection** model. ```python import sensor import time -import tf -import math -import uos, gc +import ml sensor.reset() # Reset and initialize the sensor. sensor.set_pixformat(sensor.GRAYSCALE) # Set pixel format to RGB565 (or GRAYSCALE) @@ -516,30 +568,28 @@ sensor.set_framesize(sensor.QVGA) # Set frame size to QVGA (320x240) sensor.set_windowing((240, 240)) # Set 240x240 window. sensor.skip_frames(time=2000) # Let the camera adjust. -net = tf.load('person_detection.tflite', load_to_fb=True) +model = ml.Model('person_detection.tflite', load_to_fb=True) labels = [line.rstrip('\n') for line in open("person_detection.txt")] - +sorted_labels = sorted(labels, reverse=False) clock = time.clock() while True: clock.tick() img = sensor.snapshot() - - for obj in net.classify(img, min_scale = 1.0, scale_mul= 0.8, x_overlap = 0.5, y_overlap = 0.5): - print("*********** \nDetections at [x=%d,y=%d, w=%d, h=%d]" % obj.rect()) - img.draw_rectangle(obj.rect()) - predictions_list = list(zip(labels,obj.output())) - - for i in range(len(predictions_list)): - print ("%s = %f" % (predictions_list[i][0], predictions_list[i][1])) - - print(clock.fps(), "fps", end="\n") + + sorted_list = sorted( + zip(sorted_labels, model.predict([img])[0].flatten().tolist()), key=lambda x: x[1] + ) + for i in range(len(sorted_labels)): + print("%s = %f" % (sorted_list[i][0], sorted_list[i][1])) + + print(clock.fps(), "fps") ``` When a person is in the field of view of the camera, you should see the inference result for `person` rising above 70% of certainty. -![Person detection example running](assets/person-detect.gif) +![Person detection example running](assets/person-detect-4.gif) ## Microphone @@ -640,48 +690,70 @@ With this script running you will be able to see the Fast Fourier Transform resu You can easily implement sound/voice recognition applications using Machine Learning on the edge, this means that the Portenta H7 plus the Vision Shield can run these algorithms locally. -For this example, we are going to test a [pre-trained model]((https://raw.githubusercontent.com/iabdalkader/microspeech-yesno-model/main/model.tflite)) that can recognize the `yes` and `no` keywords +Use the following script to run the example. It can also be found on **File > Examples > Audio > micro_speech.py** in the OpenMV IDE. + +```python +import time +from ml.apps import MicroSpeech + + +def callback(label, scores): + print(f'\nHeard: "{label}" @{time.ticks_ms()}ms Scores: {scores}') + + +# By default, the MicroSpeech object uses the built-in audio preprocessor (float) and the +# micro speech module for audio preprocessing and speech recognition, respectively. The +# user can override both by passing two models: +# MicroSpeech(preprocessor=ml.Model(...), micro_speech=ml.Model(...), labels=["label",...]) +speech = MicroSpeech() + +# Starts the audio streaming and processes incoming audio to recognize speech commands. +# If a callback is passed, listen() will loop forever and call the callback when a keyword +# is detected. Alternatively, `listen()` can be called with a timeout (in ms), and it +# returns if the timeout expires before detecting a keyword. +speech.listen(callback=callback, threshold=0.70) +``` + +In the example from above you can notice that there is no model defined explicitly, this is because it will use the default built-in model pre-trained to recognize the **yes** and **no** keywords. + +You can run the script and say the keywords, if any is recognized, the *Serial Terminal* will print the heard word and the inference scores. + +#### Custom Speech Recognition Model + +You can easily run custom speech recognition models also. To show you how, we are going to replicate the **yes** and **no** example but this time using the `.tflite` model file. First, download the `.tflite` [model](https://raw.githubusercontent.com/iabdalkader/microspeech-yesno-model/main/model.tflite) and copy it to the H7 local storage. -Use the following script to run the example. It can also be found on **File > Examples > Audio > micro_speech.py** in the OpenMV IDE. +![Speech recognition model directory](assets/model-speech.png) + +Copy and paste the following script based in the original example: ```python -import audio import time -import tf -import micro_speech -import pyb +import ml +from ml.apps import MicroSpeech labels = ["Silence", "Unknown", "Yes", "No"] -led_red = pyb.LED(1) -led_green = pyb.LED(2) +def callback(label, scores): + print(f'\nHeard: "{label}" @{time.ticks_ms()}ms Scores: {scores}') -model = tf.load("/model.tflite") -speech = micro_speech.MicroSpeech() -audio.init(channels=1, frequency=16000, gain_db=24, highpass=0.9883) +speech = MicroSpeech(micro_speech=ml.Model('model.tflite', load_to_fb=True), labels=labels) -# Start audio streaming -audio.start_streaming(speech.audio_callback) +speech.listen(callback=callback, threshold=0.70) +``` -while True: - # Run micro-speech without a timeout and filter detections by label index. - idx = speech.listen(model, timeout=0, threshold=0.70, filter=[2, 3]) - led = led_green if idx == 2 else led_red - print(labels[idx]) - for i in range(0, 4): - led.on() - time.sleep_ms(25) - led.off() - time.sleep_ms(25) +As you can see, there are some differences between the original example from which we can highlight the following: -# Stop streaming -audio.stop_streaming() -``` -Now, just say `yes` or `no` and you will see the inference result in the OpenMV Serial Monitor. +- The `ml` module was imported +- A labels list was created including the model labels in a specific order +- The `MicroSpeech()` function has been populated with the model and labels list as arguments. + +Now, just say `yes` or `no` and you will see the inference result in the OpenMV Serial Terminal just as with the original example. + +![Speech recognition example](assets/ml-inference-2.png) -![Speech recognition example](assets/ml-inference.png) +***If you want to create a custom model `.tflite` file, you can do it with your own keywords or sounds using [Edge Impulse](https://docs.edgeimpulse.com/docs/edge-ai-hardware/mcu/arduino-portenta-h7).*** ## Machine Learning Tool @@ -759,7 +831,7 @@ The **Portenta Vision Shield - Ethernet** gives you the possibility of connectin First, connect the Vision Shield - Ethernet to the Portenta H7. Now connect the USB-C® cable to the Portenta H7 and your computer. Lastly, connect the Ethernet cable to the Portenta Vision Shield's Ethernet port and your router or modem. -Now you are ready to test the connectivity with the following Python script. This example lets you know if an Ethernet cable is connected successfully to the shield. +Now you are ready to test the connectivity with the following MicroPython script. This example lets you know if an Ethernet cable is connected successfully to the shield. ```python import network @@ -814,6 +886,8 @@ Run the script and the current date and time will be printed in the OpenMV IDE S ![Ethernet connection example script](assets/ntp.png) +***If you want to learn more, check the other Ethernet examples in the OpenMV IDE.*** + ## LoRa® (ASX00026) The **Vision Shield - LoRa®** can extend our project connectivity by leveraging it LoRa® module for long-range communication in remote areas with a lack of internet access. Powered by the Murata CMWX1ZZABZ module which contains an STM32L0 processor along with a Semtech SX1276 Radio. @@ -824,7 +898,14 @@ To test the LoRa® connectivity, first, connect the Vision Shield - LoRa® to th ***Follow this [guide](https://docs.arduino.cc/tutorials/portenta-vision-shield/things-network-openmv) to learn how to set up and create your __end device__ on The Things Network.*** -The following Python script lets you connect to The Things Network using LoRaWAN® and send a `Hello World` message to it. +Important hardware LoRa® configurations are listed below: + +| **Setting** | **Compatibility** | +| :-----------------: | :---------------: | +| LoRaWAN MAC Version | V1.0.2 | +| Class | A or C | + +The following MicroPython script lets you connect to The Things Network using LoRaWAN® and send a `Hello World` message to it. ```python from lora import * @@ -879,7 +960,7 @@ Find the frequency used in your country for **The Things Network** on this [list ```python lora = Lora(band=BAND_AU915, poll_ms=60000, debug=False) # change the band with yours e.g BAND_US915 ``` -Define your application `appEUI` and `appKey` in the Python script so the messages are correctly authenticated by the network server. +Define your application `appEUI` and `appKey` in the MicroPython script so the messages are correctly authenticated by the network server. ```python appEui = "*****************" # now called JoinEUI diff --git a/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/4g_module.jpg b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/4g_module.jpg new file mode 100644 index 0000000000..b0355a50bd Binary files /dev/null and b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/4g_module.jpg differ diff --git a/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/kit_power_supply.png b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/kit_power_supply.png new file mode 100644 index 0000000000..30c6cf83af Binary files /dev/null and b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/kit_power_supply.png differ diff --git a/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/nicla_sense_me.jpg b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/nicla_sense_me.jpg new file mode 100644 index 0000000000..a422948b45 Binary files /dev/null and b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/nicla_sense_me.jpg differ diff --git a/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/portenta_h7.jpg b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/portenta_h7.jpg new file mode 100644 index 0000000000..fabca662e2 Binary files /dev/null and b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/portenta_h7.jpg differ diff --git a/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/portenta_mid_carrier.jpg b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/portenta_mid_carrier.jpg new file mode 100644 index 0000000000..caa8ee3134 Binary files /dev/null and b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/portenta_mid_carrier.jpg differ diff --git a/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/proto-kit-example-mechanical-1.png b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/proto-kit-example-mechanical-1.png new file mode 100644 index 0000000000..0d444c544d Binary files /dev/null and b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/proto-kit-example-mechanical-1.png differ diff --git a/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/proto-kit-example-mechanical-2.png b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/proto-kit-example-mechanical-2.png new file mode 100644 index 0000000000..54eef92b0e Binary files /dev/null and b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/proto-kit-example-mechanical-2.png differ diff --git a/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/proto-kit-perspective-dismounted.png b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/proto-kit-perspective-dismounted.png new file mode 100644 index 0000000000..074ff1a793 Binary files /dev/null and b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/proto-kit-perspective-dismounted.png differ diff --git a/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/proto-kit-perspective.png b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/proto-kit-perspective.png new file mode 100644 index 0000000000..d01781cadb Binary files /dev/null and b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/assets/proto-kit-perspective.png differ diff --git a/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/datasheet.md b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/datasheet.md new file mode 100644 index 0000000000..60a18f9867 --- /dev/null +++ b/content/hardware/05.pro-solutions/solutions-and-kits/portenta-proto-kit-me/datasheet/datasheet.md @@ -0,0 +1,348 @@ +--- +identifier: AKX00073 +title: Arduino® Portenta Proto Kit ME +type: pro +author: José Bagur +--- + +![](assets/proto-kit-perspective.png) + +# Description + +

Expand your environmental monitoring and motion detection projects with the Arduino Portenta Proto Kit ME (Motion Environment). This kit integrates multiple Arduino Pro products, offering a complete toolkit for collecting data in applications such as predictive maintenance, asset tracking, smart building systems and industrial automation. Designed for reliability and efficiency, the kit features robust sensing capabilities and seamless Cloud connectivity enabled by the Arduino Pro 4G Module. Leverage the Portenta Proto Kit ME to accelerate your prototyping process and transition smoothly from functional prototypes to final products.

+ +# Target Areas + +Predictive maintenance, asset tracking, smart building systems, industrial automation, research and development + +# CONTENTS +## Application Examples + +

The Arduino Portenta Proto Kit ME (Motion Environment) is not just a prototyping platform, it is a versatile toolkit for innovation in motion detection and environmental monitoring, designed for applications across industrial automation, smart buildings and logistics. Discover how the Portenta Proto Kit ME can bring your ideas to life through the following application examples:

+ +- **Industrial automation**: Enhance operational efficiency and reliability with the Portenta Proto Kit ME, offering solutions for: + -

Predictive maintenance: Use the Nicla Sense ME to collect environmental data such as temperature, humidity and motion to monitor equipment health. Combine this data with the Portenta H7 board for advanced processing and Cloud integration to detect anomalies, schedule proactive maintenance and minimize downtime.

+ -

High-speed test rigs: Design modular and scalable test benches for industrial applications, integrating motion detection, environmental monitoring and data exchange. Use the Portenta Proto Kit ME to perform sensor calibration, load testing and real-time functional evaluations, transmitting data to the Cloud for analysis.

+ -

Remotely monitored machinery: Build systems for real-time monitoring and control using the Nicla Sense ME for motion and environmental sensing. Integrate with the Portenta H7 board and leverage Cloud connectivity to monitor equipment status, adjust parameters and receive alerts remotely, ensuring efficient operations.

+ +- **Building automation/smart cities**: Create smarter, more connected environments with the Portenta Proto Kit ME, enabling innovative solutions such as: + -

Environmental monitoring: Use the Nicla Sense ME to track indoor air quality, temperature and humidity in real time. Process the data locally with the Portenta H7 board to make informed decisions for optimizing indoor environments, improving comfort and ensuring energy efficiency.

+ -

Intrusion detection systems: Develop motion-sensitive security systems using the Nicla Sense ME to detect unauthorized movement or environmental anomalies. Send alerts to designated devices via the Arduino Pro 4G Module for immediate action and remote monitoring.

+ -

Smart logistics: Monitor goods in transit with the Nicla Sense ME to track motion, environmental conditions and vibration. Use cloud connectivity with the Portenta H7 board for seamless data transmission and analytics, enabling efficient logistics management and goods protection.

+ +- **Smart mobility**: Enable innovative applications in transportation and logistics with advanced motion and environmental sensing: + -

Vibration monitoring: Use the Nicla Sense ME to detect vibrations during transit, ensuring the safety of delicate goods or identifying potential issues in vehicle performance.

+ -

Route optimization: Collect motion and environmental data to optimize delivery routes, integrating real-time insights through Cloud analytics for enhanced operational efficiency.

+ +## Features +### Kit Contents + +

The Arduino Portenta Proto Kit ME includes all the hardware components necessary to prototype motion detection and environmental monitoring applications effectively. Below is the list of included items and its main features and specifications:

+ +- Portenta H7 (SKU: ABX00042) (x1) +- Nicla Sense ME (SKU: ABX00050) (x1) +- Portenta Mid Carrier (SKU: ASX00055) (x1) +- Portenta Mid Carrier Proto Shield (x1) +- Arduino Pro 4G GNSS Module Global (SKU: TPX00200) (x1) +- Modulinos (x6): + - Knob (encoder with push button) (x1) + - Pixels (8x RGB LEDs) (x1) + - Distance (Time-of-Flight sensor) (x1) + - Movement (6-axis IMU) (x1) + - Buttons (3x push buttons and LEDs) (x1) + - Buzzer (x1) + - Thermo (temperature and humidity sensor) (x1) + +![Exploded view of the Portenta Proto Kit ME, showcasing most of the kit's components.](assets/proto-kit-perspective-dismounted.png) + +
+ +#### Portenta H7 (SKU: ABX00042) + +

The Portenta H7 is a dual-core microcontroller board powered by the STMicroelectronics® STM32H747XI, featuring a 32-bit Arm® Cortex®-M7 running at 480 MHz and a Cortex®-M4 at 240 MHz. It includes advanced graphics capabilities and operates within an industrial temperature range (-40 °C to 85 °C).

+ +Portenta H7 board + +Below is a summary of the most important specifications of the Portenta H7 board: + +| **Feature** | **Specification** | +|----------------------------|-------------------------------------------------------------------------------------------| +| **Microcontroller** | STMicroelectronics® STM32H747XI Dual 32-bit Arm® Cortex®-M7 and Cortex®-M4 | +| **USB Connector** | USB-C® | +| **Digital I/O Pins** | 78 (High-Density Pins) | +| **Analog Input Pins** | 8 (High-Density Pins) | +| **PWM Pins** | 10 (High-Density Pins) | +| **Wireless Connectivity** | Wi-Fi® 2.4 GHz 802.11 b/g/n, Bluetooth® 4.1 (Murata® LBEE5KL1DX) | +| **Ethernet Connectivity** | RMII 10/100 Mbps (LAN8742AI) | +| **Secure Element** | NXP® SE050C2 and Microchip® ATECC608 | +| **Clock Speed** | 480 MHz (M7 core), 240 MHz (M4 core) | +| **Memory** | 2 MB Flash, 1 MB RAM (internal); 16 MB NOR Flash, 8 MB SDRAM (external) | +| **Board Dimensions** | 66.04 mm x 25.40 mm | + +
+

+ For detailed information about the Portenta H7 board, please refer to its corresponding documentation available on Arduino Docs: + + Portenta H7 Official Documentation [8] + +

+
+ +
+ +#### Nicla Sense ME (SKU: ABX00050) + +

The Nicla Sense ME is a compact microcontroller board powered by the Nordic Semiconductor® nRF52832, featuring a 32-bit Arm® Cortex®-M4 running at 64 MHz. This board is designed for environmental monitoring and motion sensing applications, integrating multiple high-performance sensors.

+ +Nicla Sense ME board + +Below is a summary of the most important specifications of the Nicla Sense ME board: + +| **Feature** | **Specification** | +|---------------------------|----------------------------------------------------------------------------------------------------------------------| +| **Microcontroller** | Nordic Semiconductor® nRF52832 32-bit Arm® Cortex®-M4 | +| **USB Connector** | Micro-USB | +| **Digital I/O Pins** | 10 | +| **Analog Input Pins** | 2 | +| **PWM Pins** | 12 | +| **Wireless Connectivity** | Bluetooth® 5.0 (u-blox® ANNA-B112) | +| **Onboard Sensors** | BHI260AP (IMU), BMP390 (barometric sensor), BMM150 (geomagnetic sensor), BME688 (gas, temperature, humidity sensors) | +| **Clock Speed** | 64 MHz | +| **Memory** | 512 kB Flash, 64 kB SRAM (internal); 2 MB QSPI Flash (external) | +| **Onboard Interfaces** | SPI (x1), I2C (x1), UART (x1) | +| **Dimensions** | 22.86 mm x 22.86 mm | + +
+

+ For detailed information about the Nicla Sense ME board, please refer to its corresponding documentation available on Arduino Docs: + + Nicla Sense ME Official Documentation [9] + +

+
+ +
+ +#### Portenta Mid Carrier (SKU: ASX00055) + +

The Arduino Portenta Mid Carrier expands connectivity options for Portenta family boards, including Ethernet, USB-A, mPCIe, CAN, MicroSD, and 4G. It also features JTAG pins for debugging and supports I2C, SPI, PWM, digital, and analog I/Os.

+ +Portenta Mid Carrier + +Below is a summary of the most important specifications of the Portenta Mid Carrier: + +| **Feature** | **Specification** | +|------------------------------|----------------------------------------------------------------------------------------------------------------------------------------------| +| **Compatible Boards** | Portenta X8, Portenta H7 (except MIPI Camera), Portenta C33 (except MIPI Camera) | +| **Camera Interfaces** | MIPI Connector (x1), Arducam Connector (x1), USB-A (x1) | +| **Display Interface** | DSI (x1) | +| **Communication Interfaces** | 4G (mPCIe, x1), Ethernet (x1), SPI (x2), I2C (x3), UART (x4), CAN FD (x2, one without transceiver), I2S (x1), SAI (x1), PDM (x1), SPDIF (x1) | +| **User Interface** | Power On Push Button (x1) | +| **Storage** | MicroSD card slot (x1) | +| **Hardware Debugging** | JTAG/SWD | +| **Power Supply** | Board operating voltage (VIN): +5 VDC; Maximum current provided: 2 A | +| **Dimensions** | 114 mm x 86.5 mm | + +
+

+ For detailed information about the Portenta Mid Carrier, please refer to its corresponding documentation available on Arduino Docs: + + Portenta Mid Carrier Official Documentation [10] + +

+
+ +
+ +#### Arduino Pro 4G GNSS Module Global (SKU: TPX00200) + +

Designed in the widely used Mini PCI Express (mPCIe) format, this module provides global LTE Cat.4 connectivity, 4G support, and GNSS capabilities.

+ +Arduino Pro 4G GNSS Module + +Below is a summary of the most important specifications of the Arduino Pro 4G GNSS Module Global: + +| **Feature** | **Specification** | +|---------------------------|-----------------------------------------------------------------------------------------------| +| **Module Format** | Mini PCI Express (mPCIe), PCI Express Mini Card 1.2 Standard Interface | +| **Cellular Connectivity** | LTE Cat.4 with 2G/3G fallback | +| **GNSS** | GPS, GLONASS, BeiDou, Galileo, QZSS (Protocol: NMEA 0180, Update Rate: 1 Hz) | +| **LTE Characteristics** | RF Bandwidth: 1.4, 3, 5, 10, 15, 20 MHz; Download: 150 Mbps; Upload: 50 Mbps | +| **UMTS Characteristics** | DC-HSDPA: 42 Mbps (Download); HSUPA: 5.76 Mbps (Upload); WCDMA: 384 kbps | +| **GSM Characteristics** | EDGE: 296 kbps (Download), 236.8 kbps (Upload); GPRS: 107 kbps (Download), 85.6 kbps (Upload) | +| **Antenna Connectors** | Main, diversity and GNSS antenna receptacles | +| **Power Supply** | +3.3 VDC | +| **Interfaces** | USB, UART, PCM/I2C | +| **Certifications** | CE, ROHS, REACH, UKCA, FCC, IC | +| **Dimensions** | 30 mm x 51 mm | +| **Temperature Range** | Operating: -35 °C to +75 °C; Extended: -40 °C to +80 °C; Storage: -40 °C to +90 °C | + +
+

+ For detailed information about the Arduino Pro 4G GNSS Module Global, please refer to its corresponding documentation available on Arduino Docs: + + Arduino Pro 4G GNSS Module Official Documentation [11] + +

+
+ +
+ +### Kit Included Accessories + +- +24 VDC/1A power supply (x1) +- M2.5 nut (x2) +- M2.5 screw (x2) +- M2.5 washer (x2) +- M2.5 x 7 spacer (x2) +- QWIIC cable (x7) +- USB-A to USB-C® cable (x1) +- USB-A to Micro USB cable (x1) +- Arduino Pro 4G Module antennas kit (SKU: TPX002199) (x1) + +### Kit Related Products + +- Arduino X8 (SKU:ABX00074) +- Arduino Nicla Voice (SKU:ABX00061) +- Arduino Nicla Vision (SKU: ABX00051) +- Arduino Portenta C33 (SKU: ABX00049) + +
+ +## Ratings + +### Recommended Operating Conditions + +

+The table below provides a comprehensive guideline for the optimal use of the Arduino Portenta Proto Kit ME, outlining typical operating conditions and design limits. The operating conditions of the Portenta Proto Kit ME are largely a function based on its component's specifications. +

+ +| **Parameter** | **Symbol** | **Min** | **Typ** | **Max** | **Unit** | +|:------------------------------------------:|:---------------:|:-------:|:-------:|:-------:|:--------:| +| Input Voltage of the Power Jack Connector¹ | VPJC | 7.0 | - | 30 | V | +| Operating Temperature² | TO | -40 | - | 85 | °C | + +1 Onboard power jack connector of the Portenta Mid Carrier Proto Shield. +2 The operating temperature represents the range for the entire kit and not just an individual component. + +
+

Note: While the kit can be powered through different pins and connectors, the recommended method is to use the power jack connector of the Portenta Mid Carrier Proto Shield. Any alternative power options should be carefully evaluated by consulting the individual power specifications of each component to avoid potential damage.

+
+ +
+ +## Kit Power Supply + +

The Arduino Portenta Proto Kit ME can be powered through one of the following recommended methods:

+ +-

Portenta Mid Carrier Proto Shield onboard power jack: Provides a dedicated connection to power the kit using a +7 to 30 VDC input. The kit includes a compatible +24 VDC/1A power supply intended to be used with this power jack.

+-

USB-C® connector on the Portenta H7 board: Allows powering the kit with +5 VDC through the Portenta H7's USB-C® port or the terminal pins on the Portenta Mid Carrier.

+ +![Power options of the Portenta Proto Kit ME](assets/kit_power_supply.png) + +
+

Tip: To ensure reliable performance, always prioritize using the dedicated power jack on the Portenta Mid Carrier Proto Shield and the kit's provided power supply for configurations requiring higher power stability.

+
+ +
+

Safety Note: Always disconnect power before making hardware changes to the kit. Ensure that power specifications are within the recommended limits to avoid damage to components.

+
+ +
+ +## Device Operation + +### Getting Started - IDE + +

If you want to program your Arduino Portenta Proto Kit ME offline, install the Arduino Desktop IDE [1]. To connect the Portenta H7 to your computer, you will need a USB-C® cable. Additionally, to program or interact with the Nicla Sense ME, ensure you have a Micro USB cable compatible with the board.

+ +### Getting Started - Arduino Cloud Editor + +

All components of the Portenta Proto Kit ME work seamlessly on the Arduino Cloud Editor [2] by installing a simple plugin. The Arduino Cloud Editor is hosted online, ensuring it is always up-to-date with the latest features and support for all boards and devices. Follow [3] to start coding in the browser and upload your sketches onto the Portenta H7 or other components.

+ +### Getting Started - Arduino Cloud + +

The Portenta Proto Kit ME is fully supported on Arduino Cloud, enabling you to log, graph, and analyze sensor data, trigger events and automate processes for industrial, business, or smart home applications via the Portenta H7 board. Take a look at the official documentation [3] to learn more about how to integrate the kit into your IoT projects.

+ +### Sample Sketches + +

Sample sketches for the Portenta Proto Kit ME can be found either in the “Examples” menu in the Arduino IDE or the “Portenta Proto Kit ME Documentation” section of Arduino documentation [4]. These examples include basic and advanced applications showcasing motion and environmental monitoring capabilities.

+ +### Online Resources + +

Now that you have gone through the basics of what you can do with the Portenta Proto Kit ME, you can explore the endless possibilities it provides by checking exciting projects on Arduino Project Hub [5], the Arduino Library Reference [6] and the ACE-220 online course [7]. The Enterprise Prototyping with Portenta Proto Kit ME (ACE-220) course is a resource designed to help you master prototyping in embedded electronics and IoT. Gain hands-on experience with the kit and accelerate your journey from concept to innovation by building functional prototypes tailored for industrial and IoT applications.

+ +
+ +## Mechanical Information + +

+The Arduino Portenta Proto Kit ME offers significant mechanical flexibility, supporting multiple configurations based on the combination of components used. This section provides the main dimensions of one possible configuration for reference. For detailed mechanical specifications of each individual component, please consult the corresponding documentation available on Arduino Docs. +

+ +### Kit Dimensions + +

+The figures below show the main dimensions of the kit in a stacked configuration that includes the Portenta H7 board, the Portenta Mid Carrier, the Portenta Mid Carrier Proto Shield, the Arduino Pro 4G Module, one Modulino (Pixels), and the Nicla Sense ME board. All dimensions are in millimeters (mm). +

+ +-

Top View: Displays the width and length of the stacked components configuration of the kit.

+ +![](assets/proto-kit-example-mechanical-1.png) + +
+ +-

Side View: Displays the height of the stacked components configuration of the kit.

+ +![](assets/proto-kit-example-mechanical-2.png) + +
+ +## Product Compliance + +

The Arduino Portenta Proto Kit ME is composed of multiple individual Arduino products, each of which complies with specific regulations and certifications. For detailed product compliance information, please refer to the corresponding datasheets of each component included in the kit:

+ +- [Portenta H7 Documentation](https://docs.arduino.cc/hardware/portenta-h7/) **[8]** +- [Nicla Sense ME Documentation](https://docs.arduino.cc/hardware/nicla-sense-me/) **[9]** +- [Portenta Mid Carrier Documentation](https://docs.arduino.cc/hardware/portenta-mid-carrier/) **[10]** +- [Arduino Pro 4G Module Documentation](https://docs.arduino.cc/hardware/pro-4g-module/) **[11]** + + +## FCC Caution + +

The components of the Arduino Portenta Proto Kit ME are subject to individual FCC regulations. Please refer to the FCC documentation linked in each Arduino component's datasheet for specific compliance details:

+ +- [Portenta H7 Documentation](https://docs.arduino.cc/hardware/portenta-h7/) **[8]** +- [Nicla Sense ME Documentation](https://docs.arduino.cc/hardware/nicla-sense-me/) **[9]** +- [Portenta Mid Carrier Documentation](https://docs.arduino.cc/hardware/portenta-mid-carrier/) **[10]** +- [Arduino Pro 4G Module Documentation](https://docs.arduino.cc/hardware/pro-4g-module/) **[11]** + +## Company Information + +| **Company name** | **Arduino S.r.l.** | +|:----------------:|:--------------------------------------------:| +| Company address | Via Andrea Appiani, 25 - 20900 Monza (Italy) | + +## Reference Documentation + +| **No.** | **Reference** | **Link** | +|:-------:|:-----------------------------------:|---------------------------------------------------------| +| 1 | Arduino IDE (Desktop) | https://www.arduino.cc/en/software | +| 2 | Arduino Cloud Editor | https://create.arduino.cc/editor | +| 3 | Arduino Cloud - Getting Started | https://docs.arduino.cc/arduino-cloud/guides/overview/ | +| 4 | Portenta Proto Kit ME Documentation | https://docs.arduino.cc/hardware/portenta-proto-kit-me/ | +| 5 | Arduino Project Hub | https://create.arduino.cc/projecthub | +| 6 | Arduino Library Reference | https://docs.arduino.cc/language-reference/ | +| 7 | ACE-220 Online Course | https://academy.arduino.cc/courses/ace-220 | +| 8 | Portenta H7 Documentation | https://docs.arduino.cc/hardware/portenta-h7/ | +| 9 | Nicla Sense ME Documentation | https://docs.arduino.cc/hardware/nicla-sense-me/ | +| 10 | Portenta Mid Carrier Documentation | https://docs.arduino.cc/hardware/portenta-mid-carrier/ | +| 11 | Arduino Pro 4G Module Documentation | https://docs.arduino.cc/hardware/pro-4g-module/ | + +## Document Revision History + +| **Date** | **Revision** | **Changes** | +|:----------:|:------------:|:--------------:| +| 20/01/2025 | 3 | Format fixes | +| 16/01/2025 | 2 | Review changes | +| 10/01/2025 | 1 | First release | \ No newline at end of file diff --git a/content/hardware/06.nicla/boards/nicla-sense-env/datasheet/datasheet.md b/content/hardware/06.nicla/boards/nicla-sense-env/datasheet/datasheet.md index 4f5c8b50f9..024a14849b 100644 --- a/content/hardware/06.nicla/boards/nicla-sense-env/datasheet/datasheet.md +++ b/content/hardware/06.nicla/boards/nicla-sense-env/datasheet/datasheet.md @@ -242,6 +242,13 @@ The Nicla Sense Env has one reset button and two LEDs, an orange and an RGB LED, | RoHS | | REACH | | WEEE | +| VCCI (Japan) | + +### Japan VCCI Statement + +

+This is a VCCI Class B compliant product. +

### Declaration of Conformity CE DoC (EU) @@ -305,6 +312,7 @@ As a global supplier of electronic and electrical components, Arduino is aware o ## Document Revision History -| **Date** | **Revision** | **Changes** | -|:----------:|:------------:|:-------------------:| -| 10/10/2024 | 1 | First release | \ No newline at end of file +| **Date** | **Revision** | **Changes** | +|:----------:|:------------:|:------------------------------------------------------:| +| 14/01/2025 | 2 | Update on Product Compliance with Japan VCCI Statement | +| 10/10/2024 | 1 | First release | \ No newline at end of file diff --git a/content/hardware/_unlisted/boards/pro-4g-gnss-module-global/product.md b/content/hardware/_unlisted/boards/pro-4g-gnss-module-global/product.md deleted file mode 100644 index 8b51256c89..0000000000 --- a/content/hardware/_unlisted/boards/pro-4g-gnss-module-global/product.md +++ /dev/null @@ -1,5 +0,0 @@ ---- -title: Pro 4G GNSS Module (Global) -sku: [TPX00200] -certifications: [CE, UKCA, FCC, IC] ---- \ No newline at end of file diff --git a/content/hardware/_unlisted/boards/pro-4g-module-emea/product.md b/content/hardware/_unlisted/boards/pro-4g-module-emea/product.md deleted file mode 100644 index 4ef47b1b3b..0000000000 --- a/content/hardware/_unlisted/boards/pro-4g-module-emea/product.md +++ /dev/null @@ -1,5 +0,0 @@ ---- -title: Pro 4G Module (EMEA) -sku: [TPX00201] -certifications: [CE, UKCA] ---- \ No newline at end of file